[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:15.150171  3725 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.163.126:38921
I20260709 12:08:15.151661  3725 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:15.152669  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:15.167892  3732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.168515  3731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.167934  3734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.265652  3733 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:08:16.265787  3725 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:08:16.269371  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.269593  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.269744  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598896269728 us; error 0 us; skew 500 ppm
I20260709 12:08:16.270486  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.275480  3725 webserver.cc:533] Webserver started at http://127.3.163.126:33813/ using document root <none> and password file <none>
I20260709 12:08:16.276269  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.276453  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.276871  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.282382  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/master-0-root/instance:
uuid: "9a82d7ef62f949afa3f5b177b4fbe168"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-s43n"
I20260709 12:08:16.289654  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:08:16.294287  3740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.295265  3725 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.004s
I20260709 12:08:16.295560  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/master-0-root
uuid: "9a82d7ef62f949afa3f5b177b4fbe168"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-s43n"
I20260709 12:08:16.295855  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.349128  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.350483  3725 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:16.350883  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.417496  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.126:38921
I20260709 12:08:16.417544  3791 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.126:38921 every 8 connection(s)
I20260709 12:08:16.424965  3792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:16.445694  3792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168: Bootstrap starting.
I20260709 12:08:16.451123  3792 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:16.452759  3792 log.cc:826] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:16.456724  3792 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168: No bootstrap required, opened a new log
I20260709 12:08:16.476044  3792 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a82d7ef62f949afa3f5b177b4fbe168" member_type: VOTER }
I20260709 12:08:16.476536  3792 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:16.476739  3792 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a82d7ef62f949afa3f5b177b4fbe168, State: Initialized, Role: FOLLOWER
I20260709 12:08:16.477615  3792 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a82d7ef62f949afa3f5b177b4fbe168" member_type: VOTER }
I20260709 12:08:16.478071  3792 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:16.478307  3792 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:16.478574  3792 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:16.482517  3792 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a82d7ef62f949afa3f5b177b4fbe168" member_type: VOTER }
I20260709 12:08:16.483134  3792 leader_election.cc:304] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a82d7ef62f949afa3f5b177b4fbe168; no voters: 
I20260709 12:08:16.484768  3792 leader_election.cc:290] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:16.485082  3795 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:16.487426  3795 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 1 LEADER]: Becoming Leader. State: Replica: 9a82d7ef62f949afa3f5b177b4fbe168, State: Running, Role: LEADER
I20260709 12:08:16.488245  3795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a82d7ef62f949afa3f5b177b4fbe168" member_type: VOTER }
I20260709 12:08:16.489254  3792 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:16.497812  3796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a82d7ef62f949afa3f5b177b4fbe168" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a82d7ef62f949afa3f5b177b4fbe168" member_type: VOTER } }
I20260709 12:08:16.497917  3797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a82d7ef62f949afa3f5b177b4fbe168. Latest consensus state: current_term: 1 leader_uuid: "9a82d7ef62f949afa3f5b177b4fbe168" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a82d7ef62f949afa3f5b177b4fbe168" member_type: VOTER } }
I20260709 12:08:16.498457  3796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.498520  3797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:16.502856  3804 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:16.513767  3804 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:16.515942  3725 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:16.530218  3804 catalog_manager.cc:1383] Generated new cluster ID: 656c69ba06e0489299fee6e6facb51bc
I20260709 12:08:16.530514  3804 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:16.561446  3804 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:16.562885  3804 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:16.579612  3804 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168: Generated new TSK 0
I20260709 12:08:16.580454  3804 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:16.646247  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.653676  3814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.654914  3815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.657859  3817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.658401  3725 server_base.cc:1061] running on GCE node
I20260709 12:08:16.659109  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.659298  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.659466  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598896659449 us; error 0 us; skew 500 ppm
I20260709 12:08:16.660038  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.663767  3725 webserver.cc:533] Webserver started at http://127.3.163.65:39051/ using document root <none> and password file <none>
I20260709 12:08:16.664278  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.664446  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.664706  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.665741  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-0-root/instance:
uuid: "3f77563bb56b48e8b5516f39f7de329b"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-s43n"
I20260709 12:08:16.670847  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:08:16.674811  3822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.675525  3725 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:16.675776  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "3f77563bb56b48e8b5516f39f7de329b"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-s43n"
I20260709 12:08:16.676051  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.709210  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.710480  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.712965  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.717151  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.717350  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.717581  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.717767  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.808166  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:35977
I20260709 12:08:16.808243  3884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:35977 every 8 connection(s)
I20260709 12:08:16.814872  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:16.826146  3889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.829787  3890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:16.834268  3893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.835399  3725 server_base.cc:1061] running on GCE node
I20260709 12:08:16.836346  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.836586  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.836798  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598896836781 us; error 0 us; skew 500 ppm
I20260709 12:08:16.837592  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.839927  3885 heartbeater.cc:344] Connected to a master server at 127.3.163.126:38921
I20260709 12:08:16.840306  3885 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.841213  3725 webserver.cc:533] Webserver started at http://127.3.163.66:38711/ using document root <none> and password file <none>
I20260709 12:08:16.841286  3885 heartbeater.cc:507] Master 127.3.163.126:38921 requested a full tablet report, sending...
I20260709 12:08:16.841915  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.842187  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.842506  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.843904  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-1-root/instance:
uuid: "83c2cfa6d0224cfa8c47c23938228055"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-s43n"
I20260709 12:08:16.844005  3757 ts_manager.cc:194] Registered new tserver with Master: 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977)
I20260709 12:08:16.846163  3757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54706
I20260709 12:08:16.850276  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.002s
I20260709 12:08:16.855353  3897 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.856107  3725 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:08:16.856410  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-1-root
uuid: "83c2cfa6d0224cfa8c47c23938228055"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-s43n"
I20260709 12:08:16.856740  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:16.874903  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:16.876395  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:16.878829  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:16.882205  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:16.882445  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.882709  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:16.882915  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:16.964030  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.66:39179
I20260709 12:08:16.964351  3959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.66:39179 every 8 connection(s)
I20260709 12:08:16.970315  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 12:08:16.982978  3960 heartbeater.cc:344] Connected to a master server at 127.3.163.126:38921
I20260709 12:08:16.983356  3960 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:16.984439  3960 heartbeater.cc:507] Master 127.3.163.126:38921 requested a full tablet report, sending...
I20260709 12:08:16.986701  3757 ts_manager.cc:194] Registered new tserver with Master: 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179)
W20260709 12:08:16.984444  3964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.988426  3757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54722
W20260709 12:08:16.991724  3963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.992553  3725 server_base.cc:1061] running on GCE node
W20260709 12:08:16.993749  3966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.994539  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.994760  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.994918  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598896994901 us; error 0 us; skew 500 ppm
I20260709 12:08:16.995405  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.997661  3725 webserver.cc:533] Webserver started at http://127.3.163.67:37211/ using document root <none> and password file <none>
I20260709 12:08:16.998101  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.998277  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.998509  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.999684  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-2-root/instance:
uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-s43n"
I20260709 12:08:17.003944  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:17.007023  3971 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.007803  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:17.008051  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-2-root
uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-s43n"
I20260709 12:08:17.008307  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598894987430-3725-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.021121  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.022181  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.023437  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.026041  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.026226  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.026427  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.026574  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.109177  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.67:33591
I20260709 12:08:17.109323  4033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.67:33591 every 8 connection(s)
I20260709 12:08:17.124267  4034 heartbeater.cc:344] Connected to a master server at 127.3.163.126:38921
I20260709 12:08:17.124617  4034 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.125326  4034 heartbeater.cc:507] Master 127.3.163.126:38921 requested a full tablet report, sending...
I20260709 12:08:17.127079  3757 ts_manager.cc:194] Registered new tserver with Master: e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.128008  3725 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01311474s
I20260709 12:08:17.128342  3757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54732
I20260709 12:08:17.176903  3757 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54746:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:17.180274  3757 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:17.272787  3925 tablet_service.cc:1511] Processing CreateTablet for tablet 79674a77f5594f268319177a6bd75697 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.274394  3925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79674a77f5594f268319177a6bd75697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.275599  3848 tablet_service.cc:1511] Processing CreateTablet for tablet b94cbd879b8446fca90f5d3d9e4539d8 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.277064  3846 tablet_service.cc:1511] Processing CreateTablet for tablet e1f6ebe0d2c4438fb2764880b5e06519 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.278127  3999 tablet_service.cc:1511] Processing CreateTablet for tablet 79674a77f5594f268319177a6bd75697 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.279362  3999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79674a77f5594f268319177a6bd75697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.279767  3850 tablet_service.cc:1511] Processing CreateTablet for tablet 79674a77f5594f268319177a6bd75697 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:17.282014  3849 tablet_service.cc:1511] Processing CreateTablet for tablet 5dea1f3c4a274a9ea3e151fbe574e024 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.283223  3997 tablet_service.cc:1511] Processing CreateTablet for tablet b94cbd879b8446fca90f5d3d9e4539d8 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.284526  3997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94cbd879b8446fca90f5d3d9e4539d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.284233  3847 tablet_service.cc:1511] Processing CreateTablet for tablet 47cecb63c96c4d7b980eb14ea7b74e07 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.286006  3996 tablet_service.cc:1511] Processing CreateTablet for tablet 47cecb63c96c4d7b980eb14ea7b74e07 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.286887  3845 tablet_service.cc:1511] Processing CreateTablet for tablet ae1433bb8a4240b794266a989e3383e1 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.282040  3998 tablet_service.cc:1511] Processing CreateTablet for tablet 5dea1f3c4a274a9ea3e151fbe574e024 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.288534  3848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94cbd879b8446fca90f5d3d9e4539d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.289106  3844 tablet_service.cc:1511] Processing CreateTablet for tablet 57dd296690df43afb08242b672cf5416 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.290305  3844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dd296690df43afb08242b672cf5416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.292191  3843 tablet_service.cc:1511] Processing CreateTablet for tablet 445e336543f44338a49c46c2b8c3f0da (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.293471  3843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445e336543f44338a49c46c2b8c3f0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.297152  3842 tablet_service.cc:1511] Processing CreateTablet for tablet aed8f2cb992e4998ae12c83c7e7ed7a2 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.298357  3842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed8f2cb992e4998ae12c83c7e7ed7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.301153  3998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dea1f3c4a274a9ea3e151fbe574e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.302546  3920 tablet_service.cc:1511] Processing CreateTablet for tablet ae1433bb8a4240b794266a989e3383e1 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.303241  3923 tablet_service.cc:1511] Processing CreateTablet for tablet b94cbd879b8446fca90f5d3d9e4539d8 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:17.303755  3920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1433bb8a4240b794266a989e3383e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.304540  3923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b94cbd879b8446fca90f5d3d9e4539d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.305859  3919 tablet_service.cc:1511] Processing CreateTablet for tablet 57dd296690df43afb08242b672cf5416 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.307654  3921 tablet_service.cc:1511] Processing CreateTablet for tablet e1f6ebe0d2c4438fb2764880b5e06519 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.308087  3918 tablet_service.cc:1511] Processing CreateTablet for tablet 445e336543f44338a49c46c2b8c3f0da (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.309156  3996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47cecb63c96c4d7b980eb14ea7b74e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.305923  3922 tablet_service.cc:1511] Processing CreateTablet for tablet 47cecb63c96c4d7b980eb14ea7b74e07 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:17.300781  3924 tablet_service.cc:1511] Processing CreateTablet for tablet 5dea1f3c4a274a9ea3e151fbe574e024 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:17.309190  3846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f6ebe0d2c4438fb2764880b5e06519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.310820  3917 tablet_service.cc:1511] Processing CreateTablet for tablet aed8f2cb992e4998ae12c83c7e7ed7a2 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.310111  3921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f6ebe0d2c4438fb2764880b5e06519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.319593  3850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79674a77f5594f268319177a6bd75697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.319196  3922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47cecb63c96c4d7b980eb14ea7b74e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.325852  3845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1433bb8a4240b794266a989e3383e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.328982  3919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dd296690df43afb08242b672cf5416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.329891  3849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dea1f3c4a274a9ea3e151fbe574e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.329073  3994 tablet_service.cc:1511] Processing CreateTablet for tablet ae1433bb8a4240b794266a989e3383e1 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:17.331214  3993 tablet_service.cc:1511] Processing CreateTablet for tablet 57dd296690df43afb08242b672cf5416 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:17.334707  3994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1433bb8a4240b794266a989e3383e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.323005  3995 tablet_service.cc:1511] Processing CreateTablet for tablet e1f6ebe0d2c4438fb2764880b5e06519 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:17.336140  3993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dd296690df43afb08242b672cf5416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.336455  3917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed8f2cb992e4998ae12c83c7e7ed7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.343327  3992 tablet_service.cc:1511] Processing CreateTablet for tablet 445e336543f44338a49c46c2b8c3f0da (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:17.342883  3847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47cecb63c96c4d7b980eb14ea7b74e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.346441  3995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f6ebe0d2c4438fb2764880b5e06519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.344061  3991 tablet_service.cc:1511] Processing CreateTablet for tablet aed8f2cb992e4998ae12c83c7e7ed7a2 (DEFAULT_TABLE table=test-workload [id=7c3074cfc2ad4ca194b32eb50a1ace4c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:17.351884  3992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445e336543f44338a49c46c2b8c3f0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.350266  3924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dea1f3c4a274a9ea3e151fbe574e024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.353649  3991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aed8f2cb992e4998ae12c83c7e7ed7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.358855  3918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445e336543f44338a49c46c2b8c3f0da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.478307  4052 tablet_bootstrap.cc:492] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
W20260709 12:08:17.505729  3805 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:17.532716  4052 tablet_bootstrap.cc:654] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.559896  4053 tablet_bootstrap.cc:492] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:17.563537  4054 tablet_bootstrap.cc:492] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:17.591957  4054 tablet_bootstrap.cc:654] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.592718  4052 tablet_bootstrap.cc:492] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:17.593240  4052 ts_tablet_manager.cc:1403] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.006s
I20260709 12:08:17.596357  4052 raft_consensus.cc:359] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.597180  4052 raft_consensus.cc:385] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.597510  4052 raft_consensus.cc:740] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.597756  4053 tablet_bootstrap.cc:654] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.598348  4052 consensus_queue.cc:260] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.603673  4052 ts_tablet_manager.cc:1434] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 12:08:17.604004  4054 tablet_bootstrap.cc:492] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:17.604437  4054 ts_tablet_manager.cc:1403] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.004s
I20260709 12:08:17.604583  3885 heartbeater.cc:499] Master 127.3.163.126:38921 was elected leader, sending a full tablet report...
I20260709 12:08:17.604928  4052 tablet_bootstrap.cc:492] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
I20260709 12:08:17.607421  4054 raft_consensus.cc:359] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.608114  4054 raft_consensus.cc:385] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.608387  4054 raft_consensus.cc:740] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.609091  4054 consensus_queue.cc:260] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.611485  4052 tablet_bootstrap.cc:654] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.615249  4054 ts_tablet_manager.cc:1434] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 12:08:17.615885  3960 heartbeater.cc:499] Master 127.3.163.126:38921 was elected leader, sending a full tablet report...
I20260709 12:08:17.627799  4054 tablet_bootstrap.cc:492] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:17.631206  4053 tablet_bootstrap.cc:492] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:17.631618  4053 ts_tablet_manager.cc:1403] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.137s	user 0.005s	sys 0.010s
I20260709 12:08:17.632473  4052 tablet_bootstrap.cc:492] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:17.632920  4052 ts_tablet_manager.cc:1403] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.000s
I20260709 12:08:17.633347  4054 tablet_bootstrap.cc:654] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.634872  4053 raft_consensus.cc:359] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.635596  4053 raft_consensus.cc:385] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.635946  4053 raft_consensus.cc:740] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.636092  4052 raft_consensus.cc:359] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.636864  4052 raft_consensus.cc:385] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.637277  4052 raft_consensus.cc:740] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.636897  4053 consensus_queue.cc:260] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.637972  4052 consensus_queue.cc:260] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.640070  4052 ts_tablet_manager.cc:1434] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:17.640947  4052 tablet_bootstrap.cc:492] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
I20260709 12:08:17.641525  4034 heartbeater.cc:499] Master 127.3.163.126:38921 was elected leader, sending a full tablet report...
I20260709 12:08:17.647030  4052 tablet_bootstrap.cc:654] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.658658  4052 tablet_bootstrap.cc:492] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:17.659063  4052 ts_tablet_manager.cc:1403] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:08:17.660145  4054 tablet_bootstrap.cc:492] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:17.660609  4054 ts_tablet_manager.cc:1403] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.011s
I20260709 12:08:17.661758  4053 ts_tablet_manager.cc:1434] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 12:08:17.661705  4052 raft_consensus.cc:359] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.662457  4052 raft_consensus.cc:385] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.662771  4052 raft_consensus.cc:740] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.663416  4052 consensus_queue.cc:260] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.665012  4053 tablet_bootstrap.cc:492] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:17.665738  4052 ts_tablet_manager.cc:1434] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:08:17.666627  4052 tablet_bootstrap.cc:492] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
I20260709 12:08:17.665051  4054 raft_consensus.cc:359] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.666997  4054 raft_consensus.cc:385] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.667346  4054 raft_consensus.cc:740] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.672725  4052 tablet_bootstrap.cc:654] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.672559  4054 consensus_queue.cc:260] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.674971  4053 tablet_bootstrap.cc:654] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.676750  4059 raft_consensus.cc:493] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.677235  4059 raft_consensus.cc:515] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.680215  4059 leader_election.cc:290] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.690215  4052 tablet_bootstrap.cc:492] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:17.690649  4052 ts_tablet_manager.cc:1403] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.002s
I20260709 12:08:17.694621  4053 tablet_bootstrap.cc:492] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:17.695060  4053 ts_tablet_manager.cc:1403] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.004s
I20260709 12:08:17.697791  4053 raft_consensus.cc:359] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.698449  4053 raft_consensus.cc:385] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.698740  4053 raft_consensus.cc:740] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.703320  4053 consensus_queue.cc:260] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.713359  4053 ts_tablet_manager.cc:1434] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:08:17.714262  4052 raft_consensus.cc:359] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.714932  4052 raft_consensus.cc:385] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.715214  4052 raft_consensus.cc:740] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.717831  3860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
I20260709 12:08:17.718096  4062 raft_consensus.cc:493] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.718592  3860 raft_consensus.cc:2468] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 0.
I20260709 12:08:17.718508  4062 raft_consensus.cc:515] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.720147  3900 leader_election.cc:304] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:17.723676  4052 consensus_queue.cc:260] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.725363  4053 tablet_bootstrap.cc:492] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:17.724900  4062 leader_election.cc:290] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977)
I20260709 12:08:17.725502  4059 raft_consensus.cc:2804] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.726341  4059 raft_consensus.cc:493] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.726676  4059 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:17.733378  3961 tablet.cc:2406] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:17.736850  4054 ts_tablet_manager.cc:1434] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.076s	user 0.021s	sys 0.025s
I20260709 12:08:17.737697  4054 tablet_bootstrap.cc:492] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:17.738574  4059 raft_consensus.cc:515] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.740522  4059 leader_election.cc:290] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.741971  3860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:17.741650  4052 ts_tablet_manager.cc:1434] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:08:17.742499  3860 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.743173  4052 tablet_bootstrap.cc:492] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
I20260709 12:08:17.745587  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:17.746223  4009 raft_consensus.cc:2468] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 0.
I20260709 12:08:17.748324  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:17.749362  4009 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.753501  3860 raft_consensus.cc:2468] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 1.
I20260709 12:08:17.754593  3900 leader_election.cc:304] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:17.755048  4054 tablet_bootstrap.cc:654] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.756786  4009 raft_consensus.cc:2468] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 1.
I20260709 12:08:17.757247  4059 raft_consensus.cc:2804] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.757688  4059 raft_consensus.cc:697] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:17.759394  4059 consensus_queue.cc:237] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.763713  4053 tablet_bootstrap.cc:654] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.769200  4054 tablet_bootstrap.cc:492] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:17.771798  4054 ts_tablet_manager.cc:1403] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
I20260709 12:08:17.773402  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
I20260709 12:08:17.774909  4052 tablet_bootstrap.cc:654] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.774573  4054 raft_consensus.cc:359] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.775255  4054 raft_consensus.cc:385] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.775557  4054 raft_consensus.cc:740] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
W20260709 12:08:17.776047  3974 leader_election.cc:343] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.776335  4054 consensus_queue.cc:260] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.784432  4054 ts_tablet_manager.cc:1434] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:08:17.785310  4054 tablet_bootstrap.cc:492] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:17.789121  3755 catalog_manager.cc:5697] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.791986  4054 tablet_bootstrap.cc:654] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.792726  3860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
W20260709 12:08:17.794137  3974 leader_election.cc:343] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.794548  3974 leader_election.cc:304] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:17.795171  4052 tablet_bootstrap.cc:492] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:17.795603  4052 ts_tablet_manager.cc:1403] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 12:08:17.795643  4062 raft_consensus.cc:2749] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.798269  4052 raft_consensus.cc:359] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.798969  4052 raft_consensus.cc:385] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.799239  4052 raft_consensus.cc:740] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.804482  4053 tablet_bootstrap.cc:492] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:17.804929  4053 ts_tablet_manager.cc:1403] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.080s	user 0.005s	sys 0.018s
I20260709 12:08:17.807443  4054 tablet_bootstrap.cc:492] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:17.807790  4054 ts_tablet_manager.cc:1403] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.016s
I20260709 12:08:17.807703  4053 raft_consensus.cc:359] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.808404  4053 raft_consensus.cc:385] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.808712  4053 raft_consensus.cc:740] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.809369  4053 consensus_queue.cc:260] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.802572  4052 consensus_queue.cc:260] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.810205  4054 raft_consensus.cc:359] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.810875  4054 raft_consensus.cc:385] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.811138  4054 raft_consensus.cc:740] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.811836  4054 consensus_queue.cc:260] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.814208  4054 ts_tablet_manager.cc:1434] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:08:17.815114  4054 tablet_bootstrap.cc:492] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:17.819039  4052 ts_tablet_manager.cc:1434] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:08:17.821444  4054 tablet_bootstrap.cc:654] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.823585  4053 ts_tablet_manager.cc:1434] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:08:17.824463  4053 tablet_bootstrap.cc:492] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:17.827517  4052 tablet_bootstrap.cc:492] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
I20260709 12:08:17.833313  4054 tablet_bootstrap.cc:492] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:17.834354  4054 ts_tablet_manager.cc:1403] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 12:08:17.837030  4054 raft_consensus.cc:359] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.837736  4054 raft_consensus.cc:385] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.838016  4054 raft_consensus.cc:740] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.838891  4059 raft_consensus.cc:493] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.839038  4062 raft_consensus.cc:493] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.839316  4059 raft_consensus.cc:515] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.839797  4062 raft_consensus.cc:515] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.841823  4059 leader_election.cc:290] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.843176  3860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
I20260709 12:08:17.843482  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dd296690df43afb08242b672cf5416" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
I20260709 12:08:17.843642  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dd296690df43afb08242b672cf5416" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
I20260709 12:08:17.844332  3859 raft_consensus.cc:2468] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 0.
W20260709 12:08:17.844480  3900 leader_election.cc:343] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:17.844765  3974 leader_election.cc:343] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.838670  4054 consensus_queue.cc:260] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.842129  4062 leader_election.cc:290] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179)
I20260709 12:08:17.845237  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:17.845888  4009 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 0.
I20260709 12:08:17.847132  4054 ts_tablet_manager.cc:1434] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:08:17.847476  3898 leader_election.cc:304] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 3f77563bb56b48e8b5516f39f7de329b
I20260709 12:08:17.848225  4059 raft_consensus.cc:2804] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.848556  4059 raft_consensus.cc:493] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.848682  3974 leader_election.cc:304] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:17.848917  4059 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.849423  4062 raft_consensus.cc:2804] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.849781  4062 raft_consensus.cc:493] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.850106  4062 raft_consensus.cc:3060] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.848027  4054 tablet_bootstrap.cc:492] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:17.853228  4059 raft_consensus.cc:515] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.855687  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
W20260709 12:08:17.857013  3900 leader_election.cc:343] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.857987  4059 leader_election.cc:290] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.858922  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:17.859436  4009 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.860402  4054 tablet_bootstrap.cc:654] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.865710  4052 tablet_bootstrap.cc:654] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.865525  4009 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 1.
I20260709 12:08:17.868096  3898 leader_election.cc:304] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 3f77563bb56b48e8b5516f39f7de329b
I20260709 12:08:17.864419  4062 raft_consensus.cc:515] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.869366  4059 raft_consensus.cc:2804] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.870065  4059 raft_consensus.cc:697] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:17.870958  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dd296690df43afb08242b672cf5416" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:17.870931  4059 consensus_queue.cc:237] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.871587  3859 raft_consensus.cc:3060] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.878151  3859 raft_consensus.cc:2468] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 1.
I20260709 12:08:17.879317  3974 leader_election.cc:304] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:17.880679  4062 leader_election.cc:290] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179)
I20260709 12:08:17.881398  4062 raft_consensus.cc:2804] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.881824  4062 raft_consensus.cc:697] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 LEADER]: Becoming Leader. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:17.882566  4062 consensus_queue.cc:237] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.880967  4053 tablet_bootstrap.cc:654] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.888273  4068 raft_consensus.cc:493] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.888717  4068 raft_consensus.cc:515] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.890776  4068 leader_election.cc:290] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.892874  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dd296690df43afb08242b672cf5416" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:17.892936  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
W20260709 12:08:17.894232  3898 leader_election.cc:343] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:17.894347  3974 leader_election.cc:343] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.894915  4052 tablet_bootstrap.cc:492] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:17.895016  4057 raft_consensus.cc:493] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.896000  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
I20260709 12:08:17.896240  4057 raft_consensus.cc:515] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
W20260709 12:08:17.897403  3900 leader_election.cc:343] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.897799  3900 leader_election.cc:304] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055; no voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:17.898500  4068 raft_consensus.cc:2749] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.898890  4057 leader_election.cc:290] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.900636  4054 tablet_bootstrap.cc:492] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:17.901142  4054 ts_tablet_manager.cc:1403] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.014s
I20260709 12:08:17.906526  4054 raft_consensus.cc:359] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.907214  4054 raft_consensus.cc:385] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.907482  4054 raft_consensus.cc:740] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.910059  4052 ts_tablet_manager.cc:1403] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.004s
I20260709 12:08:17.908147  4054 consensus_queue.cc:260] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.922286  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:17.923815  4054 ts_tablet_manager.cc:1434] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
W20260709 12:08:17.924309  3823 leader_election.cc:343] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.925832  4054 tablet_bootstrap.cc:492] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:17.927955  4059 raft_consensus.cc:493] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.928388  4059 raft_consensus.cc:515] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.929638  4057 raft_consensus.cc:493] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.930758  4052 raft_consensus.cc:359] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.931658  4052 raft_consensus.cc:385] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.932199  4052 raft_consensus.cc:740] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.929927  3756 catalog_manager.cc:5697] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:17.931602  3755 catalog_manager.cc:5697] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d reported cstate change: term changed from 0 to 1, leader changed from <none> to e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67). New cstate: current_term: 1 leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:17.933050  4059 leader_election.cc:290] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.933307  4052 consensus_queue.cc:260] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.934661  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:17.931798  4057 raft_consensus.cc:515] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.935951  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
W20260709 12:08:17.936497  3898 leader_election.cc:343] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.938442  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
W20260709 12:08:17.940999  3900 leader_election.cc:343] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.941428  3900 leader_election.cc:304] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055; no voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:17.943534  4059 raft_consensus.cc:2749] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.950067  4057 leader_election.cc:290] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.950268  4052 ts_tablet_manager.cc:1434] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.009s
I20260709 12:08:17.950431  4053 tablet_bootstrap.cc:492] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:17.950793  4053 ts_tablet_manager.cc:1403] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.000s
I20260709 12:08:17.951046  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
W20260709 12:08:17.952302  3823 leader_election.cc:343] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.952690  4053 raft_consensus.cc:359] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.954962  4053 raft_consensus.cc:385] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.955174  4052 tablet_bootstrap.cc:492] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
I20260709 12:08:17.955331  4053 raft_consensus.cc:740] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.956141  4053 consensus_queue.cc:260] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.956499  4054 tablet_bootstrap.cc:654] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.956936  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
W20260709 12:08:17.957206  3825 leader_election.cc:343] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.957523  3935 raft_consensus.cc:2468] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 0.
I20260709 12:08:17.957731  3825 leader_election.cc:304] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b; no voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:17.961303  3825 leader_election.cc:304] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:17.962071  4057 raft_consensus.cc:2749] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:17.962733  4057 raft_consensus.cc:2804] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:17.961953  4053 ts_tablet_manager.cc:1434] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:08:17.963088  4057 raft_consensus.cc:493] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:17.963645  4057 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.963940  4053 tablet_bootstrap.cc:492] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:17.965330  4052 tablet_bootstrap.cc:654] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.979359  4088 raft_consensus.cc:493] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:17.979826  4088 raft_consensus.cc:515] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.982553  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
I20260709 12:08:17.982697  4052 tablet_bootstrap.cc:492] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:17.982668  4057 raft_consensus.cc:515] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.983319  4052 ts_tablet_manager.cc:1403] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 12:08:17.984066  4088 leader_election.cc:290] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
W20260709 12:08:17.986971  3825 leader_election.cc:343] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.987738  4057 leader_election.cc:290] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:17.986512  4053 tablet_bootstrap.cc:654] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.992174  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:17.991974  4052 raft_consensus.cc:359] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:17.993130  4052 raft_consensus.cc:385] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.993935  4052 raft_consensus.cc:740] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.993660  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:17.995317  3934 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.995977  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:17.997886  4054 tablet_bootstrap.cc:492] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:17.998332  4054 ts_tablet_manager.cc:1403] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.009s
W20260709 12:08:17.996194  3823 leader_election.cc:343] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:17.998976  3823 leader_election.cc:304] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b; no voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:17.999739  4057 raft_consensus.cc:2749] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:18.000101  3823 leader_election.cc:343] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.001121  4054 raft_consensus.cc:359] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.001806  4054 raft_consensus.cc:385] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.002084  4054 raft_consensus.cc:740] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.002324  3934 raft_consensus.cc:2468] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 1.
I20260709 12:08:17.996639  4052 consensus_queue.cc:260] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.003376  3825 leader_election.cc:304] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:18.004130  4088 raft_consensus.cc:2804] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.004560  4088 raft_consensus.cc:697] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:18.005659  4052 ts_tablet_manager.cc:1434] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:08:18.005338  4088 consensus_queue.cc:237] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.006548  4052 tablet_bootstrap.cc:492] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
I20260709 12:08:18.002799  4054 consensus_queue.cc:260] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.012104  4054 ts_tablet_manager.cc:1434] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:08:18.013010  4054 tablet_bootstrap.cc:492] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:18.013715  4053 tablet_bootstrap.cc:492] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:18.014206  4053 ts_tablet_manager.cc:1403] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.007s
I20260709 12:08:18.017197  4053 raft_consensus.cc:359] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.017864  4053 raft_consensus.cc:385] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.018159  4053 raft_consensus.cc:740] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.018918  4053 consensus_queue.cc:260] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.019755  4054 tablet_bootstrap.cc:654] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.022665  4053 ts_tablet_manager.cc:1434] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:18.023552  4053 tablet_bootstrap.cc:492] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:18.023910  4052 tablet_bootstrap.cc:654] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.025432  4057 raft_consensus.cc:493] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.025859  4057 raft_consensus.cc:515] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.027705  4057 leader_election.cc:290] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.029127  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
I20260709 12:08:18.029716  3934 raft_consensus.cc:2468] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 0.
I20260709 12:08:18.030666  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:18.030804  3825 leader_election.cc:304] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:18.031244  4009 raft_consensus.cc:2468] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 0.
I20260709 12:08:18.031497  4057 raft_consensus.cc:2804] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.031859  4057 raft_consensus.cc:493] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.032156  4057 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.032294  4053 tablet_bootstrap.cc:654] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.038241  4057 raft_consensus.cc:515] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.040063  4057 leader_election.cc:290] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.040711  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:18.041260  3934 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.044023  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:18.044520  4009 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.047042  3934 raft_consensus.cc:2468] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 1.
I20260709 12:08:18.048054  3825 leader_election.cc:304] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:18.048763  4088 raft_consensus.cc:2804] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.049211  4088 raft_consensus.cc:697] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:18.049938  4088 consensus_queue.cc:237] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.062526  4052 tablet_bootstrap.cc:492] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:18.065846  4052 ts_tablet_manager.cc:1403] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.017s
I20260709 12:08:18.065316  4009 raft_consensus.cc:2468] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 1.
I20260709 12:08:18.052330  3755 catalog_manager.cc:5697] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.073187  4053 tablet_bootstrap.cc:492] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:18.073280  4054 tablet_bootstrap.cc:492] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:18.074254  4053 ts_tablet_manager.cc:1403] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.010s
I20260709 12:08:18.074338  4054 ts_tablet_manager.cc:1403] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.003s
I20260709 12:08:18.076891  4054 raft_consensus.cc:359] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.077500  4054 raft_consensus.cc:385] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.077251  4053 raft_consensus.cc:359] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.077879  4054 raft_consensus.cc:740] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.078035  4053 raft_consensus.cc:385] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.078385  4053 raft_consensus.cc:740] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.078663  4054 consensus_queue.cc:260] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.080857  4054 ts_tablet_manager.cc:1434] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:08:18.073935  4052 raft_consensus.cc:359] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.081715  4052 raft_consensus.cc:385] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.082024  4052 raft_consensus.cc:740] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.082661  4052 consensus_queue.cc:260] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.084161  4052 ts_tablet_manager.cc:1434] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:08:18.083513  3756 catalog_manager.cc:5697] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.084826  4052 tablet_bootstrap.cc:492] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b: Bootstrap starting.
I20260709 12:08:18.081722  4054 tablet_bootstrap.cc:492] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055: Bootstrap starting.
I20260709 12:08:18.091017  4054 tablet_bootstrap.cc:654] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.091486  4052 tablet_bootstrap.cc:654] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.099197  4052 tablet_bootstrap.cc:492] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b: No bootstrap required, opened a new log
I20260709 12:08:18.099611  4052 ts_tablet_manager.cc:1403] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:08:18.102062  4052 raft_consensus.cc:359] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.102710  4052 raft_consensus.cc:385] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.103001  4052 raft_consensus.cc:740] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.103860  4052 consensus_queue.cc:260] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.106619  4054 tablet_bootstrap.cc:492] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055: No bootstrap required, opened a new log
I20260709 12:08:18.106767  4052 ts_tablet_manager.cc:1434] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:08:18.107117  4054 ts_tablet_manager.cc:1403] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.000s
I20260709 12:08:18.108971  4054 raft_consensus.cc:359] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.109634  4054 raft_consensus.cc:385] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.109932  4054 raft_consensus.cc:740] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.079239  4053 consensus_queue.cc:260] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.111266  4054 consensus_queue.cc:260] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.112277  4053 ts_tablet_manager.cc:1434] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:08:18.113191  4053 tablet_bootstrap.cc:492] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:18.113587  4054 ts_tablet_manager.cc:1434] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:18.118646  4053 tablet_bootstrap.cc:654] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.128983  4088 raft_consensus.cc:493] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.129437  4088 raft_consensus.cc:515] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.131387  4088 leader_election.cc:290] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.132050  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
I20260709 12:08:18.132536  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:18.133253  4009 raft_consensus.cc:2468] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 0.
I20260709 12:08:18.134649  3823 leader_election.cc:304] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:18.132635  3934 raft_consensus.cc:2468] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 0.
I20260709 12:08:18.135344  4088 raft_consensus.cc:2804] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.135679  4088 raft_consensus.cc:493] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.135985  4088 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.136796  4053 tablet_bootstrap.cc:492] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:18.137233  4053 ts_tablet_manager.cc:1403] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:08:18.140401  4053 raft_consensus.cc:359] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.141091  4053 raft_consensus.cc:385] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.141363  4053 raft_consensus.cc:740] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.141459  4088 raft_consensus.cc:515] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.142076  4053 consensus_queue.cc:260] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.143007  4088 leader_election.cc:290] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.144097  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:18.144245  4053 ts_tablet_manager.cc:1434] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:18.144385  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:18.144618  3934 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.144910  4009 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.145241  4053 tablet_bootstrap.cc:492] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:18.150804  4009 raft_consensus.cc:2468] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 1.
I20260709 12:08:18.151871  3823 leader_election.cc:304] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:18.152065  4053 tablet_bootstrap.cc:654] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.153432  4088 raft_consensus.cc:2804] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.154119  4088 raft_consensus.cc:697] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:18.154947  4088 consensus_queue.cc:237] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.156316  3934 raft_consensus.cc:2468] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 1.
I20260709 12:08:18.163775  3755 catalog_manager.cc:5697] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.165891  4088 raft_consensus.cc:493] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.166353  4088 raft_consensus.cc:515] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.166749  4053 tablet_bootstrap.cc:492] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:18.167217  4053 ts_tablet_manager.cc:1403] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:08:18.169025  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
I20260709 12:08:18.169322  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:18.169597  3934 raft_consensus.cc:2468] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 0.
I20260709 12:08:18.170027  4009 raft_consensus.cc:2468] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 0.
I20260709 12:08:18.170703  3825 leader_election.cc:304] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:18.171437  4057 raft_consensus.cc:2804] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.171783  4057 raft_consensus.cc:493] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.172091  4057 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.178532  4057 raft_consensus.cc:515] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.172957  4053 raft_consensus.cc:359] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.180114  4053 raft_consensus.cc:385] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.180295  4102 raft_consensus.cc:493] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.181492  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:18.181855  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:18.181978  4053 raft_consensus.cc:740] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.182142  3934 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.182339  4088 leader_election.cc:290] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.182677  4053 consensus_queue.cc:260] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.183090  4009 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.184581  4053 ts_tablet_manager.cc:1434] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 12:08:18.185420  4053 tablet_bootstrap.cc:492] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d: Bootstrap starting.
I20260709 12:08:18.189590  3934 raft_consensus.cc:2468] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 1.
I20260709 12:08:18.190570  4053 tablet_bootstrap.cc:654] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.190640  3825 leader_election.cc:304] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:18.191642  4102 raft_consensus.cc:515] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.197850  4009 raft_consensus.cc:2468] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 1.
I20260709 12:08:18.198339  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
I20260709 12:08:18.180974  4057 leader_election.cc:290] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.199563  4057 raft_consensus.cc:2804] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.200033  4057 raft_consensus.cc:697] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:18.201316  4102 leader_election.cc:290] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.202121  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:18.202931  4008 raft_consensus.cc:2393] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f77563bb56b48e8b5516f39f7de329b in current term 1: Already voted for candidate 83c2cfa6d0224cfa8c47c23938228055 in this term.
I20260709 12:08:18.200850  4057 consensus_queue.cc:237] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.204187  3823 leader_election.cc:304] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b; no voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:18.204737  4053 tablet_bootstrap.cc:492] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d: No bootstrap required, opened a new log
I20260709 12:08:18.205076  4088 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.205163  4053 ts_tablet_manager.cc:1403] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:08:18.207755  4053 raft_consensus.cc:359] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.208405  4053 raft_consensus.cc:385] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.208662  4053 raft_consensus.cc:740] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.209362  4053 consensus_queue.cc:260] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.211563  4053 ts_tablet_manager.cc:1434] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:18.211573  4088 raft_consensus.cc:2749] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.220291  3757 catalog_manager.cc:5697] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.255499  4062 raft_consensus.cc:493] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.255983  4062 raft_consensus.cc:515] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.258013  4062 leader_election.cc:290] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179)
I20260709 12:08:18.258597  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
I20260709 12:08:18.259019  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c2cfa6d0224cfa8c47c23938228055" is_pre_election: true
I20260709 12:08:18.259768  3934 raft_consensus.cc:2393] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e23b234ed4a64eae9ad4ffba6e3e560d in current term 1: Already voted for candidate 3f77563bb56b48e8b5516f39f7de329b in this term.
I20260709 12:08:18.260614  3974 leader_election.cc:304] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:18.261224  4062 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.267347  4062 raft_consensus.cc:2749] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.297873  3934 raft_consensus.cc:3060] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.302992  4062 consensus_queue.cc:1048] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.318257  4083 consensus_queue.cc:1048] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:18.334702  4059 consensus_queue.cc:1048] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.344323  4059 consensus_queue.cc:1048] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.354295  4059 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.369925  4059 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.413915  4059 raft_consensus.cc:493] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.414371  4059 raft_consensus.cc:515] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.415963  4059 leader_election.cc:290] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.416666  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
I20260709 12:08:18.416970  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:18.417192  3859 raft_consensus.cc:2468] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 0.
I20260709 12:08:18.417603  4009 raft_consensus.cc:2468] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 0.
I20260709 12:08:18.418041  3900 leader_election.cc:304] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:18.418699  4059 raft_consensus.cc:2804] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.419008  4059 raft_consensus.cc:493] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.419256  4059 raft_consensus.cc:3060] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.423360  4059 raft_consensus.cc:515] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.424853  4059 leader_election.cc:290] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.425518  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:18.425683  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:18.426061  3859 raft_consensus.cc:3060] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.426118  4009 raft_consensus.cc:3060] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.431000  4009 raft_consensus.cc:2468] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 1.
I20260709 12:08:18.431892  3898 leader_election.cc:304] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:18.432442  4059 raft_consensus.cc:2804] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.432405  3859 raft_consensus.cc:2468] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 1.
I20260709 12:08:18.432981  4059 raft_consensus.cc:697] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:18.434150  4059 consensus_queue.cc:237] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.441462  3756 catalog_manager.cc:5697] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.460717  4057 consensus_queue.cc:1048] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.466971  4057 consensus_queue.cc:1048] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.473052  4102 consensus_queue.cc:1048] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.480116  4102 consensus_queue.cc:1048] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:08:18.511349  3805 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.568272  4059 raft_consensus.cc:493] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.568753  4059 raft_consensus.cc:515] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.570776  4059 leader_election.cc:290] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.571516  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b" is_pre_election: true
I20260709 12:08:18.571700  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" is_pre_election: true
I20260709 12:08:18.572158  3859 raft_consensus.cc:2468] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 0.
I20260709 12:08:18.572235  4009 raft_consensus.cc:2468] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 0.
I20260709 12:08:18.573348  3900 leader_election.cc:304] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:18.574136  4059 raft_consensus.cc:2804] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.574477  4059 raft_consensus.cc:493] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.574792  4059 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.579365  4059 raft_consensus.cc:515] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.581218  4059 leader_election.cc:290] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.581733  4009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:18.581892  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:18.582139  4009 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.582456  3859 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.586014  4009 raft_consensus.cc:2468] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 1.
I20260709 12:08:18.586874  3898 leader_election.cc:304] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:18.587438  4059 raft_consensus.cc:2804] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.587785  4059 raft_consensus.cc:697] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:18.588508  3859 raft_consensus.cc:2468] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 1.
I20260709 12:08:18.588510  4059 consensus_queue.cc:237] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.595288  3756 catalog_manager.cc:5697] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.601972  4119 consensus_queue.cc:1048] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.613562  4057 consensus_queue.cc:1048] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:08:18.622310  4057 consensus_queue.cc:1048] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.632972  4088 consensus_queue.cc:1048] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.807266  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79674a77f5594f268319177a6bd75697"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:49868
I20260709 12:08:18.807924  3934 raft_consensus.cc:606] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Received request to transfer leadership to TS 3f77563bb56b48e8b5516f39f7de329b
I20260709 12:08:18.813277  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:49868
I20260709 12:08:18.813798  3934 raft_consensus.cc:606] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Received request to transfer leadership to TS 3f77563bb56b48e8b5516f39f7de329b
I20260709 12:08:18.837389  3859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
mode: GRACEFUL
new_leader_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:34438
I20260709 12:08:18.837831  3859 raft_consensus.cc:606] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Received request to transfer leadership to TS 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:18.842238  4113 consensus_queue.cc:1048] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.857775  4068 consensus_queue.cc:1048] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:18.861665  4009 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57dd296690df43afb08242b672cf5416"
dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
mode: GRACEFUL
new_leader_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:56854
I20260709 12:08:18.862178  4009 raft_consensus.cc:606] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 LEADER]: Received request to transfer leadership to TS 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:18.870061  3859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
mode: GRACEFUL
new_leader_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:34438
I20260709 12:08:18.870599  3859 raft_consensus.cc:606] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Received request to transfer leadership to TS 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:18.875898  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:49868
I20260709 12:08:18.876312  3934 raft_consensus.cc:606] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Received request to transfer leadership to TS e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:18.958689  4059 raft_consensus.cc:993] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:18.959102  4068 raft_consensus.cc:1081] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Signalling peer 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:18.960532  3859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79674a77f5594f268319177a6bd75697"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:43270
I20260709 12:08:18.960990  3859 raft_consensus.cc:493] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:18.961264  3859 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.965508  3859 raft_consensus.cc:515] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.967037  3859 leader_election.cc:290] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 2 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:18.967747  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:18.968294  3934 raft_consensus.cc:3055] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:18.968386  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:18.968638  3934 raft_consensus.cc:740] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:18.968861  4008 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.969517  3934 consensus_queue.cc:260] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.970808  3934 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:18.973165  4008 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 2.
I20260709 12:08:18.974046  3823 leader_election.cc:304] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:18.974613  4088 raft_consensus.cc:2804] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:18.974972  4088 raft_consensus.cc:697] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:18.975651  4088 consensus_queue.cc:237] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:18.976941  3934 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 2.
I20260709 12:08:18.982007  3755 catalog_manager.cc:5697] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 1 to 2, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 2 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.019357  4057 raft_consensus.cc:993] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b: : Instructing follower 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:19.019780  4057 raft_consensus.cc:1081] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Signalling peer 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:19.021258  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:49858
I20260709 12:08:19.021780  3934 raft_consensus.cc:493] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.022116  3934 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.026542  3934 raft_consensus.cc:515] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.028079  3934 leader_election.cc:290] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:19.029071  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:19.029083  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:19.029768  4008 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.029733  3859 raft_consensus.cc:3055] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.030231  3859 raft_consensus.cc:740] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:19.030957  3859 consensus_queue.cc:260] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.032075  3859 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.035802  4008 raft_consensus.cc:2468] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:19.036747  3898 leader_election.cc:304] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:19.037459  4068 raft_consensus.cc:2804] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.037813  4068 raft_consensus.cc:697] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:19.037815  3859 raft_consensus.cc:2468] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:19.038589  4068 consensus_queue.cc:237] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.043864  3755 catalog_manager.cc:5697] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 1 to 2, leader changed from 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65) to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.063827  4088 raft_consensus.cc:993] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b: : Instructing follower 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:19.064178  4057 raft_consensus.cc:1081] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Signalling peer 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:19.065408  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:49858
I20260709 12:08:19.065909  3934 raft_consensus.cc:493] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.066259  3934 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.070156  3934 raft_consensus.cc:515] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.071497  3934 leader_election.cc:290] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:19.072139  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:19.072364  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:19.072680  3859 raft_consensus.cc:3055] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.072885  4008 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.073050  3859 raft_consensus.cc:740] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:19.073799  3859 consensus_queue.cc:260] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.074888  3859 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.078778  4008 raft_consensus.cc:2468] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:19.079748  3898 leader_election.cc:304] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:19.080459  4068 raft_consensus.cc:2804] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.080623  3859 raft_consensus.cc:2468] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:19.080968  4068 raft_consensus.cc:697] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:19.081704  4068 consensus_queue.cc:237] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.086673  3755 catalog_manager.cc:5697] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 1 to 2, leader changed from 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65) to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.088929  4068 consensus_queue.cc:1048] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.098201  4059 consensus_queue.cc:1048] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.144731  4113 raft_consensus.cc:993] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:19.145115  4059 raft_consensus.cc:1081] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Signalling peer 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:19.146265  3859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:43270
I20260709 12:08:19.146638  3859 raft_consensus.cc:493] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.146869  3859 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.150983  3859 raft_consensus.cc:515] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.153038  3859 leader_election.cc:290] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 2 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:19.153232  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:19.153813  3935 raft_consensus.cc:3055] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.154105  3935 raft_consensus.cc:740] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:19.154274  4083 raft_consensus.cc:993] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d: : Instructing follower 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:19.154296  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:19.154788  4108 raft_consensus.cc:1081] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 LEADER]: Signalling peer 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:19.154906  4008 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.154870  3935 consensus_queue.cc:260] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.155840  3935 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.156477  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57dd296690df43afb08242b672cf5416"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:49852
I20260709 12:08:19.157001  3934 raft_consensus.cc:493] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.157351  3934 raft_consensus.cc:3060] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.159597  4008 raft_consensus.cc:2468] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 2.
I20260709 12:08:19.160398  3823 leader_election.cc:304] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:19.160993  4088 raft_consensus.cc:2804] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.161366  4088 raft_consensus.cc:697] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:19.161937  3935 raft_consensus.cc:2468] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 2.
I20260709 12:08:19.162096  4088 consensus_queue.cc:237] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.163156  3934 raft_consensus.cc:515] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.165160  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dd296690df43afb08242b672cf5416" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:19.165334  3934 leader_election.cc:290] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:19.165668  3859 raft_consensus.cc:3060] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.165916  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dd296690df43afb08242b672cf5416" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:19.166440  4008 raft_consensus.cc:3055] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.166695  4008 raft_consensus.cc:740] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:19.167295  4008 consensus_queue.cc:260] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.168354  4008 raft_consensus.cc:3060] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.168919  3755 catalog_manager.cc:5697] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 1 to 2, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 2 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.170077  3859 raft_consensus.cc:2468] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:19.170858  3900 leader_election.cc:304] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:19.171422  4059 raft_consensus.cc:2804] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.171868  4059 raft_consensus.cc:697] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:19.172595  4059 consensus_queue.cc:237] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.174042  4008 raft_consensus.cc:2468] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:19.179078  3755 catalog_manager.cc:5697] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 1 to 2, leader changed from e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67) to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.432847  3859 raft_consensus.cc:1275] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.434019  4059 consensus_queue.cc:1048] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.440349  4008 raft_consensus.cc:1275] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.441915  4068 consensus_queue.cc:1048] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.453284  4068 raft_consensus.cc:993] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:19.453684  4059 raft_consensus.cc:1081] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Signalling peer e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:19.455154  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2"
dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:56290
I20260709 12:08:19.455659  4008 raft_consensus.cc:493] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.456010  4008 raft_consensus.cc:3060] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.460278  4008 raft_consensus.cc:515] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.461716  4008 leader_election.cc:290] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 2 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179)
I20260709 12:08:19.462276  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:19.462649  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aed8f2cb992e4998ae12c83c7e7ed7a2" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:19.462765  3859 raft_consensus.cc:3060] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.463106  3934 raft_consensus.cc:3055] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.463339  3934 raft_consensus.cc:740] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:19.463932  3934 consensus_queue.cc:260] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.464735  3934 raft_consensus.cc:3060] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.466848  3859 raft_consensus.cc:2468] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 2.
I20260709 12:08:19.467690  3974 leader_election.cc:304] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:19.468384  4108 raft_consensus.cc:2804] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.468734  4108 raft_consensus.cc:697] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 LEADER]: Becoming Leader. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:19.469069  3934 raft_consensus.cc:2468] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 2.
I20260709 12:08:19.469377  4108 consensus_queue.cc:237] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:19.474354  3756 catalog_manager.cc:5697] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d reported cstate change: term changed from 1 to 2, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67). New cstate: current_term: 2 leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.555387  3934 raft_consensus.cc:1275] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.556453  4088 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.564522  4008 raft_consensus.cc:1275] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.567013  4119 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.630882  3859 raft_consensus.cc:1275] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.631912  4059 consensus_queue.cc:1048] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.636237  3934 raft_consensus.cc:1275] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.637408  4119 consensus_queue.cc:1048] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.644381  4008 raft_consensus.cc:1275] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.645746  4139 consensus_queue.cc:1048] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.646698  4007 raft_consensus.cc:1275] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.648247  4088 consensus_queue.cc:1048] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.657286  4007 raft_consensus.cc:1275] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.658633  4139 consensus_queue.cc:1048] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:19.665772  3859 raft_consensus.cc:1275] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:19.668705  4113 consensus_queue.cc:1048] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.019096  3859 raft_consensus.cc:1275] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.020093  4108 consensus_queue.cc:1048] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.028542  3934 raft_consensus.cc:1275] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.030179  4108 consensus_queue.cc:1048] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:21.900453  3725 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:21.901168  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:21.918752  3859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79674a77f5594f268319177a6bd75697"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
mode: GRACEFUL
new_leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:34452
I20260709 12:08:21.919154  3859 raft_consensus.cc:606] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Received request to transfer leadership to TS e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:21.927839  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:49882
I20260709 12:08:21.928304  3934 raft_consensus.cc:606] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Received request to transfer leadership to TS e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:21.929361  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:21.929747  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.188930  4119 raft_consensus.cc:993] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b: : Instructing follower e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:22.189339  4153 raft_consensus.cc:1081] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Signalling peer e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:22.190659  4007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79674a77f5594f268319177a6bd75697"
dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:56846
I20260709 12:08:22.191156  4007 raft_consensus.cc:493] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.191476  4007 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.196071  4007 raft_consensus.cc:515] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:22.197492  4007 leader_election.cc:290] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 3 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977)
I20260709 12:08:22.198165  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:22.198354  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:22.198688  3934 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.198805  3859 raft_consensus.cc:3055] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.199121  3859 raft_consensus.cc:740] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:22.199781  3859 consensus_queue.cc:260] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:22.200785  3859 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.204205  3934 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 3.
I20260709 12:08:22.205161  3974 leader_election.cc:304] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:22.205845  4146 raft_consensus.cc:2804] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.206182  3859 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 3.
I20260709 12:08:22.206869  4146 raft_consensus.cc:697] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Becoming Leader. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:22.207619  4146 consensus_queue.cc:237] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:22.215306  3756 catalog_manager.cc:5697] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d reported cstate change: term changed from 2 to 3, leader changed from 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65) to e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67). New cstate: current_term: 3 leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:22.480120  4113 raft_consensus.cc:993] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:22.480486  4113 raft_consensus.cc:1081] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Signalling peer e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:22.481688  4007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1"
dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:56290
I20260709 12:08:22.482064  4007 raft_consensus.cc:493] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.482316  4007 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.486413  4007 raft_consensus.cc:515] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:22.487744  4007 leader_election.cc:290] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 2 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179)
I20260709 12:08:22.488327  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:22.488680  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:22.488801  3859 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.489128  3934 raft_consensus.cc:3055] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:22.489344  3934 raft_consensus.cc:740] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:22.489888  3934 consensus_queue.cc:260] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:22.490626  3934 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:22.492573  3859 raft_consensus.cc:2468] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 2.
I20260709 12:08:22.493378  3974 leader_election.cc:304] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:22.494043  4146 raft_consensus.cc:2804] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:22.494385  4146 raft_consensus.cc:697] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 LEADER]: Becoming Leader. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:22.494516  3934 raft_consensus.cc:2468] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 2.
I20260709 12:08:22.495074  4146 consensus_queue.cc:237] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:22.500461  3756 catalog_manager.cc:5697] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d reported cstate change: term changed from 1 to 2, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67). New cstate: current_term: 2 leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:22.750624  3934 raft_consensus.cc:1275] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:22.751644  4146 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:22.759335  3859 raft_consensus.cc:1275] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:22.760977  4146 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:22.930576  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.935266  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:22.935555  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:23.039836  3934 raft_consensus.cc:1275] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.040863  4146 consensus_queue.cc:1048] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.048446  3859 raft_consensus.cc:1275] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:23.049762  4170 consensus_queue.cc:1048] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:23.936295  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.940932  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.941273  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:24.942072  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.946828  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.947172  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.948264  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.953155  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.953451  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.954267  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.958815  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.959146  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.959929  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.964545  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.964893  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.965646  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.970144  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.970479  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.971222  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.975731  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.976069  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.976898  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.982417  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.982771  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.007278  3725 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:32.011096  4008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79674a77f5594f268319177a6bd75697"
dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
mode: GRACEFUL
new_leader_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:56854
I20260709 12:08:32.011646  4008 raft_consensus.cc:606] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Received request to transfer leadership to TS 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:32.015654  3860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
mode: GRACEFUL
new_leader_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:34438
I20260709 12:08:32.016038  3860 raft_consensus.cc:606] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Received request to transfer leadership to TS 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:32.019790  3860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
mode: GRACEFUL
new_leader_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:34438
I20260709 12:08:32.020159  3860 raft_consensus.cc:606] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Received request to transfer leadership to TS 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:32.023713  3860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
mode: GRACEFUL
new_leader_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:34438
I20260709 12:08:32.024078  3860 raft_consensus.cc:606] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Received request to transfer leadership to TS 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:32.030102  4008 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1"
dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
mode: GRACEFUL
new_leader_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:56854
I20260709 12:08:32.030567  4008 raft_consensus.cc:606] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 LEADER]: Received request to transfer leadership to TS 83c2cfa6d0224cfa8c47c23938228055
I20260709 12:08:32.034319  4177 raft_consensus.cc:993] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d: : Instructing follower 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.034945  4175 raft_consensus.cc:1081] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 LEADER]: Signalling peer 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.036285  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:49852
I20260709 12:08:32.036710  3934 raft_consensus.cc:493] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.037081  3934 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.041887  3934 raft_consensus.cc:515] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.044108  3934 leader_election.cc:290] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 3 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:32.045979  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:32.046500  4008 raft_consensus.cc:3055] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.046757  4008 raft_consensus.cc:740] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:32.047505  4178 raft_consensus.cc:993] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b: : Instructing follower 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.047400  4008 consensus_queue.cc:260] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.047983  4172 raft_consensus.cc:1081] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Signalling peer 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.048333  4008 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.049285  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:49858
I20260709 12:08:32.049630  3934 raft_consensus.cc:493] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.049850  3934 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.052205  4008 raft_consensus.cc:2468] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 3.
I20260709 12:08:32.053071  3860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1433bb8a4240b794266a989e3383e1" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:32.053205  3898 leader_election.cc:304] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:32.053485  3860 raft_consensus.cc:3060] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.053527  3934 raft_consensus.cc:515] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.054090  4113 raft_consensus.cc:2804] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.055199  3934 leader_election.cc:290] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:32.055975  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:32.056424  3859 raft_consensus.cc:3055] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:32.056635  3859 raft_consensus.cc:740] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:32.057201  3859 consensus_queue.cc:260] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.057955  3859 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.059934  3860 raft_consensus.cc:2468] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 3.
I20260709 12:08:32.061795  3859 raft_consensus.cc:2468] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:32.062772  3900 leader_election.cc:304] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:32.063145  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:32.063557  4008 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.065024  4180 raft_consensus.cc:2804] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:32.065496  4180 raft_consensus.cc:697] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:32.066392  4180 consensus_queue.cc:237] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.068862  4008 raft_consensus.cc:2468] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:32.068984  4113 raft_consensus.cc:697] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:32.069931  4113 consensus_queue.cc:237] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.071844  4172 raft_consensus.cc:993] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b: : Instructing follower 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.072321  4178 raft_consensus.cc:1081] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Signalling peer 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.074045  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:49858
I20260709 12:08:32.074602  3934 raft_consensus.cc:493] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.074928  3934 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.077698  3755 catalog_manager.cc:5697] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 2 to 3, leader changed from e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67) to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.079296  3934 raft_consensus.cc:515] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.081171  3934 leader_election.cc:290] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:32.081323  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:32.081684  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:32.081827  3859 raft_consensus.cc:3055] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:32.082147  3859 raft_consensus.cc:740] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:32.082160  4008 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.082991  3859 consensus_queue.cc:260] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.084030  3859 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.087664  4008 raft_consensus.cc:2468] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:32.088587  3898 leader_election.cc:304] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:32.089334  4180 raft_consensus.cc:2804] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:32.089833  4180 raft_consensus.cc:697] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:32.090410  3859 raft_consensus.cc:2468] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 2.
I20260709 12:08:32.090606  4180 consensus_queue.cc:237] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.099396  3755 catalog_manager.cc:5697] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 1 to 2, leader changed from 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65) to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.100343  3755 catalog_manager.cc:5697] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 1 to 2, leader changed from 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65) to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.338088  4172 raft_consensus.cc:993] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b: : Instructing follower 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.338446  4178 raft_consensus.cc:1081] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Signalling peer 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.339612  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:49858
I20260709 12:08:32.339986  3934 raft_consensus.cc:493] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.340240  3934 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.343891  3934 raft_consensus.cc:515] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.345191  3934 leader_election.cc:290] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 3 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:32.345842  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:32.346040  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dea1f3c4a274a9ea3e151fbe574e024" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:32.346335  3859 raft_consensus.cc:3055] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.346484  4008 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.346654  3859 raft_consensus.cc:740] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:32.347357  3859 consensus_queue.cc:260] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.348382  3859 raft_consensus.cc:3060] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.351984  4008 raft_consensus.cc:2468] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 3.
I20260709 12:08:32.352932  3898 leader_election.cc:304] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:32.353626  4180 raft_consensus.cc:2804] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.353775  3859 raft_consensus.cc:2468] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 3.
I20260709 12:08:32.353983  4180 raft_consensus.cc:697] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:32.354813  4180 consensus_queue.cc:237] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.360417  3755 catalog_manager.cc:5697] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 2 to 3, leader changed from 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65) to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.435544  4177 raft_consensus.cc:993] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d: : Instructing follower 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.435907  4175 raft_consensus.cc:1081] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Signalling peer 83c2cfa6d0224cfa8c47c23938228055 to start an election
I20260709 12:08:32.437074  3934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79674a77f5594f268319177a6bd75697"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
 from {username='slave'} at 127.0.0.1:49852
I20260709 12:08:32.437449  3934 raft_consensus.cc:493] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.437687  3934 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.441437  3934 raft_consensus.cc:515] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.442631  3934 leader_election.cc:290] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 4 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:32.443477  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:32.443485  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "83c2cfa6d0224cfa8c47c23938228055" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:32.443972  4008 raft_consensus.cc:3055] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.444018  3859 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.444336  4008 raft_consensus.cc:740] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:32.444969  4008 consensus_queue.cc:260] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.445688  4008 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.447930  3859 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 4.
I20260709 12:08:32.448740  3900 leader_election.cc:304] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, 83c2cfa6d0224cfa8c47c23938228055; no voters: 
I20260709 12:08:32.449386  4008 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83c2cfa6d0224cfa8c47c23938228055 in term 4.
I20260709 12:08:32.449465  4180 raft_consensus.cc:2804] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.449854  4180 raft_consensus.cc:697] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 4 LEADER]: Becoming Leader. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:32.450577  4180 consensus_queue.cc:237] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:32.457103  3755 catalog_manager.cc:5697] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 reported cstate change: term changed from 3 to 4, leader changed from e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67) to 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66). New cstate: current_term: 4 leader_uuid: "83c2cfa6d0224cfa8c47c23938228055" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.459029  3859 raft_consensus.cc:1275] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:32.460165  4180 consensus_queue.cc:1048] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:32.468717  4008 raft_consensus.cc:1275] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:32.469862  4180 consensus_queue.cc:1048] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:32.519821  3859 raft_consensus.cc:1275] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:32.520855  4179 consensus_queue.cc:1048] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:32.528095  4008 raft_consensus.cc:1275] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:32.529346  4197 consensus_queue.cc:1048] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:32.542691  3859 raft_consensus.cc:1275] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.543509  4197 consensus_queue.cc:1048] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:32.550395  4008 raft_consensus.cc:1275] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.551716  4180 consensus_queue.cc:1048] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:32.798457  4008 raft_consensus.cc:1275] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.799443  4180 consensus_queue.cc:1048] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:32.806588  3859 raft_consensus.cc:1275] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.808403  4179 consensus_queue.cc:1048] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:32.915889  4008 raft_consensus.cc:1275] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 4 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:32.916869  4179 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:32.924424  3859 raft_consensus.cc:1275] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 4 FOLLOWER]: Refusing update from remote peer 83c2cfa6d0224cfa8c47c23938228055: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:32.925599  4197 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:35.061057  3725 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:35.061697  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.067664  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:49882
I20260709 12:08:35.068076  3934 raft_consensus.cc:606] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Received request to transfer leadership to TS e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:35.070026  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:49882
I20260709 12:08:35.070394  3934 raft_consensus.cc:606] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Received request to transfer leadership to TS e23b234ed4a64eae9ad4ffba6e3e560d
I20260709 12:08:35.072093  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79674a77f5594f268319177a6bd75697"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:49882
I20260709 12:08:35.072429  3934 raft_consensus.cc:606] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 4 LEADER]: Received request to transfer leadership to TS 3f77563bb56b48e8b5516f39f7de329b
I20260709 12:08:35.074193  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:49882
I20260709 12:08:35.074530  3934 raft_consensus.cc:606] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Received request to transfer leadership to TS 3f77563bb56b48e8b5516f39f7de329b
I20260709 12:08:35.076187  3934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519"
dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
mode: GRACEFUL
new_leader_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:49882
I20260709 12:08:35.076525  3934 raft_consensus.cc:606] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Received request to transfer leadership to TS 3f77563bb56b48e8b5516f39f7de329b
I20260709 12:08:35.077345  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:35.077688  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:35.102636  4197 raft_consensus.cc:993] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:35.102977  4205 raft_consensus.cc:1081] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Signalling peer e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:35.104229  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da"
dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:56290
I20260709 12:08:35.104581  4008 raft_consensus.cc:493] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.104841  4008 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.108897  4197 raft_consensus.cc:993] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:35.109320  4197 raft_consensus.cc:1081] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Signalling peer 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:35.109695  4008 raft_consensus.cc:515] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.110954  3860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:43270
I20260709 12:08:35.111347  3860 raft_consensus.cc:493] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.111606  3860 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.111788  4008 leader_election.cc:290] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 3 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179)
I20260709 12:08:35.112679  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:35.113147  3859 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.113198  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445e336543f44338a49c46c2b8c3f0da" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:35.113687  3934 raft_consensus.cc:3055] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.113962  3934 raft_consensus.cc:740] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:35.114604  3934 consensus_queue.cc:260] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.115628  3934 raft_consensus.cc:3060] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.115877  3860 raft_consensus.cc:515] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.118347  3860 leader_election.cc:290] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 3 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:35.118506  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:35.118515  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f6ebe0d2c4438fb2764880b5e06519" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:35.119158  3935 raft_consensus.cc:3055] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.119225  4008 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.119449  3935 raft_consensus.cc:740] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:35.120240  3859 raft_consensus.cc:2468] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 3.
I20260709 12:08:35.120831  3934 raft_consensus.cc:2468] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 3.
I20260709 12:08:35.121941  3935 consensus_queue.cc:260] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.123086  3935 raft_consensus.cc:3060] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.125177  3974 leader_election.cc:304] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c2cfa6d0224cfa8c47c23938228055, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:35.125912  4175 raft_consensus.cc:2804] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.126191  4008 raft_consensus.cc:2468] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 3.
I20260709 12:08:35.126883  4175 raft_consensus.cc:697] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Becoming Leader. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:35.127290  3823 leader_election.cc:304] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:35.127763  4175 consensus_queue.cc:237] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.130159  3935 raft_consensus.cc:2468] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 3.
I20260709 12:08:35.131659  4208 raft_consensus.cc:2804] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.134581  4208 raft_consensus.cc:697] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 3 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:35.135401  4208 consensus_queue.cc:237] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.137554  3756 catalog_manager.cc:5697] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d reported cstate change: term changed from 2 to 3, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67). New cstate: current_term: 3 leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:35.144634  3755 catalog_manager.cc:5697] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 2 to 3, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 3 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.153707  4205 raft_consensus.cc:993] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:35.154045  4197 raft_consensus.cc:1081] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Signalling peer 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:35.155141  3859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:43270
I20260709 12:08:35.155483  3859 raft_consensus.cc:493] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.155717  3859 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.159166  3859 raft_consensus.cc:515] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.160338  3859 leader_election.cc:290] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 3 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:35.160935  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:35.161254  4008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b94cbd879b8446fca90f5d3d9e4539d8" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:35.161379  3935 raft_consensus.cc:3055] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.161657  3935 raft_consensus.cc:740] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:35.161664  4008 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.162340  3935 consensus_queue.cc:260] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.163141  3935 raft_consensus.cc:3060] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.165179  4008 raft_consensus.cc:2468] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 3.
I20260709 12:08:35.165894  3823 leader_election.cc:304] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:35.166450  4208 raft_consensus.cc:2804] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.166878  4208 raft_consensus.cc:697] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 3 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:35.167685  3935 raft_consensus.cc:2468] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 3.
I20260709 12:08:35.167589  4208 consensus_queue.cc:237] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.173184  3755 catalog_manager.cc:5697] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 2 to 3, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 3 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.538645  4205 raft_consensus.cc:993] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:35.539228  4197 raft_consensus.cc:1081] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 4 LEADER]: Signalling peer 3f77563bb56b48e8b5516f39f7de329b to start an election
I20260709 12:08:35.540884  3859 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79674a77f5594f268319177a6bd75697"
dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
 from {username='slave'} at 127.0.0.1:43270
I20260709 12:08:35.541391  3859 raft_consensus.cc:493] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.541672  3859 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.546097  4205 raft_consensus.cc:993] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055: : Instructing follower e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:35.546543  4197 raft_consensus.cc:1081] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Signalling peer e23b234ed4a64eae9ad4ffba6e3e560d to start an election
I20260709 12:08:35.547056  3859 raft_consensus.cc:515] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.548059  4008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07"
dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
 from {username='slave'} at 127.0.0.1:56290
I20260709 12:08:35.548527  4008 raft_consensus.cc:493] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.548857  4008 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.549283  3859 leader_election.cc:290] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 5 election: Requested vote from peers 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179), e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67:33591)
I20260709 12:08:35.550474  3935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:35.550774  4007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79674a77f5594f268319177a6bd75697" candidate_uuid: "3f77563bb56b48e8b5516f39f7de329b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d"
I20260709 12:08:35.551219  3935 raft_consensus.cc:3055] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:35.551285  4007 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.551579  3935 raft_consensus.cc:740] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:35.552408  3935 consensus_queue.cc:260] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.553678  3935 raft_consensus.cc:3060] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.553887  4008 raft_consensus.cc:515] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.555408  4008 leader_election.cc:290] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 3 election: Requested vote from peers 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977), 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179)
I20260709 12:08:35.556406  3859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f77563bb56b48e8b5516f39f7de329b"
I20260709 12:08:35.556954  3934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47cecb63c96c4d7b980eb14ea7b74e07" candidate_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83c2cfa6d0224cfa8c47c23938228055"
I20260709 12:08:35.557439  3934 raft_consensus.cc:3055] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.556959  3859 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.557734  3934 raft_consensus.cc:740] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83c2cfa6d0224cfa8c47c23938228055, State: Running, Role: LEADER
I20260709 12:08:35.558336  4007 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 5.
I20260709 12:08:35.558420  3934 consensus_queue.cc:260] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.559646  3934 raft_consensus.cc:3060] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.559621  3823 leader_election.cc:304] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:35.560400  3935 raft_consensus.cc:2468] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f77563bb56b48e8b5516f39f7de329b in term 5.
I20260709 12:08:35.560776  4208 raft_consensus.cc:2804] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:35.561231  4208 raft_consensus.cc:697] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 5 LEADER]: Becoming Leader. State: Replica: 3f77563bb56b48e8b5516f39f7de329b, State: Running, Role: LEADER
I20260709 12:08:35.561940  4208 consensus_queue.cc:237] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.562943  3859 raft_consensus.cc:2468] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 3.
I20260709 12:08:35.564138  3974 leader_election.cc:304] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f77563bb56b48e8b5516f39f7de329b, e23b234ed4a64eae9ad4ffba6e3e560d; no voters: 
I20260709 12:08:35.565088  4175 raft_consensus.cc:2804] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.565534  4175 raft_consensus.cc:697] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Becoming Leader. State: Replica: e23b234ed4a64eae9ad4ffba6e3e560d, State: Running, Role: LEADER
I20260709 12:08:35.566087  3934 raft_consensus.cc:2468] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23b234ed4a64eae9ad4ffba6e3e560d in term 3.
I20260709 12:08:35.566437  4175 consensus_queue.cc:237] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } }
I20260709 12:08:35.570955  3755 catalog_manager.cc:5697] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b reported cstate change: term changed from 4 to 5, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65). New cstate: current_term: 5 leader_uuid: "3f77563bb56b48e8b5516f39f7de329b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.575014  3756 catalog_manager.cc:5697] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d reported cstate change: term changed from 2 to 3, leader changed from 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66) to e23b234ed4a64eae9ad4ffba6e3e560d (127.3.163.67). New cstate: current_term: 3 leader_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:35.586563  3934 raft_consensus.cc:1275] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.587442  4175 consensus_queue.cc:1048] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.596451  3859 raft_consensus.cc:1275] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.598685  4175 consensus_queue.cc:1048] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.625324  3934 raft_consensus.cc:1275] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.626408  4208 consensus_queue.cc:1048] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.634002  4007 raft_consensus.cc:1275] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.635360  4227 consensus_queue.cc:1048] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:35.649369  4007 raft_consensus.cc:1275] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.650493  4210 consensus_queue.cc:1048] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.658420  3934 raft_consensus.cc:1275] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.659920  4227 consensus_queue.cc:1048] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:35.992779  3859 raft_consensus.cc:1275] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:35.994324  4222 consensus_queue.cc:1048] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f77563bb56b48e8b5516f39f7de329b" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 35977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.003825  3934 raft_consensus.cc:1275] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Refusing update from remote peer e23b234ed4a64eae9ad4ffba6e3e560d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.006124  4175 consensus_queue.cc:1048] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.078840  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.083873  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.084302  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:36.085711  4007 raft_consensus.cc:1275] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 5 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.086702  4227 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23b234ed4a64eae9ad4ffba6e3e560d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 33591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.094183  3934 raft_consensus.cc:1275] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 5 FOLLOWER]: Refusing update from remote peer 3f77563bb56b48e8b5516f39f7de329b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.095425  4208 consensus_queue.cc:1048] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c2cfa6d0224cfa8c47c23938228055" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:37.085417  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.090134  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.090474  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.091391  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.096087  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.096426  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.097251  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.101931  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.102267  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.103106  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.108266  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.108615  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.109474  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.114099  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.114472  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.115329  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.119935  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.120304  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.121316  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.126055  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.126401  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.127219  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.131860  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.132191  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.157220  3725 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:45.157684  3725 tablet_server.cc:179] TabletServer@127.3.163.65:0 shutting down...
I20260709 12:08:45.178099  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.178776  3725 tablet_replica.cc:333] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.179407  3725 raft_consensus.cc:2243] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.180070  3725 raft_consensus.cc:2272] T 79674a77f5594f268319177a6bd75697 P 3f77563bb56b48e8b5516f39f7de329b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.182210  3725 tablet_replica.cc:333] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.182739  3725 raft_consensus.cc:2243] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.183456  3725 raft_consensus.cc:2272] T e1f6ebe0d2c4438fb2764880b5e06519 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.185134  3725 tablet_replica.cc:333] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.185539  3725 raft_consensus.cc:2243] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.185866  3725 raft_consensus.cc:2272] T ae1433bb8a4240b794266a989e3383e1 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.187279  3725 tablet_replica.cc:333] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.187708  3725 raft_consensus.cc:2243] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.188040  3725 raft_consensus.cc:2272] T 5dea1f3c4a274a9ea3e151fbe574e024 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.189517  3725 tablet_replica.cc:333] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.189908  3725 raft_consensus.cc:2243] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.190346  3725 raft_consensus.cc:2272] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.191900  3725 tablet_replica.cc:333] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.192333  3725 raft_consensus.cc:2243] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.192655  3725 raft_consensus.cc:2272] T 57dd296690df43afb08242b672cf5416 P 3f77563bb56b48e8b5516f39f7de329b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.194089  3725 tablet_replica.cc:333] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.194514  3725 raft_consensus.cc:2243] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.194875  3725 raft_consensus.cc:2272] T 47cecb63c96c4d7b980eb14ea7b74e07 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.196156  3725 tablet_replica.cc:333] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.196555  3725 raft_consensus.cc:2243] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.197178  3725 raft_consensus.cc:2272] T b94cbd879b8446fca90f5d3d9e4539d8 P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.198493  3725 tablet_replica.cc:333] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b: stopping tablet replica
I20260709 12:08:45.198894  3725 raft_consensus.cc:2243] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.199254  3725 raft_consensus.cc:2272] T 445e336543f44338a49c46c2b8c3f0da P 3f77563bb56b48e8b5516f39f7de329b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:45.278689  3900 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.163.65:35977: connect: Connection refused (error 111)
W20260709 12:08:45.281919  3900 consensus_peers.cc:597] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 -> Peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Couldn't send request to peer 3f77563bb56b48e8b5516f39f7de329b. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:35977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:45.290743  3974 consensus_peers.cc:597] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d -> Peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Couldn't send request to peer 3f77563bb56b48e8b5516f39f7de329b. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:35977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.291016  3725 tablet_server.cc:196] TabletServer@127.3.163.65:0 shutdown complete.
W20260709 12:08:45.298761  3974 consensus_peers.cc:597] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d -> Peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Couldn't send request to peer 3f77563bb56b48e8b5516f39f7de329b. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:35977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.313843  3725 tablet_server.cc:179] TabletServer@127.3.163.66:0 shutting down...
W20260709 12:08:45.316764  3900 consensus_peers.cc:597] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 -> Peer 3f77563bb56b48e8b5516f39f7de329b (127.3.163.65:35977): Couldn't send request to peer 3f77563bb56b48e8b5516f39f7de329b. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:35977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:45.322010  3974 consensus_peers.cc:597] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d -> Peer 83c2cfa6d0224cfa8c47c23938228055 (127.3.163.66:39179): Couldn't send request to peer 83c2cfa6d0224cfa8c47c23938228055. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:45.340157  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.341161  3725 tablet_replica.cc:333] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.342180  3725 raft_consensus.cc:2243] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.343034  3725 raft_consensus.cc:2272] T 57dd296690df43afb08242b672cf5416 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.344769  3725 tablet_replica.cc:333] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.345461  3725 raft_consensus.cc:2243] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.345955  3725 raft_consensus.cc:2272] T e1f6ebe0d2c4438fb2764880b5e06519 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.347481  3725 tablet_replica.cc:333] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.348030  3725 raft_consensus.cc:2243] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.348492  3725 raft_consensus.cc:2272] T 79674a77f5594f268319177a6bd75697 P 83c2cfa6d0224cfa8c47c23938228055 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.350183  3725 tablet_replica.cc:333] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.350665  3725 raft_consensus.cc:2243] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.351135  3725 raft_consensus.cc:2272] T 445e336543f44338a49c46c2b8c3f0da P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.352721  3725 tablet_replica.cc:333] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.353210  3725 raft_consensus.cc:2243] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.353650  3725 raft_consensus.cc:2272] T 47cecb63c96c4d7b980eb14ea7b74e07 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.355136  3725 tablet_replica.cc:333] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.355581  3725 raft_consensus.cc:2243] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.356016  3725 raft_consensus.cc:2272] T b94cbd879b8446fca90f5d3d9e4539d8 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.357540  3725 tablet_replica.cc:333] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.357965  3725 raft_consensus.cc:2243] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.358841  3725 raft_consensus.cc:2272] T ae1433bb8a4240b794266a989e3383e1 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.360378  3725 tablet_replica.cc:333] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.360862  3725 raft_consensus.cc:2243] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.361295  3725 raft_consensus.cc:2272] T aed8f2cb992e4998ae12c83c7e7ed7a2 P 83c2cfa6d0224cfa8c47c23938228055 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.362764  3725 tablet_replica.cc:333] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055: stopping tablet replica
I20260709 12:08:45.363227  3725 raft_consensus.cc:2243] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.364135  3725 raft_consensus.cc:2272] T 5dea1f3c4a274a9ea3e151fbe574e024 P 83c2cfa6d0224cfa8c47c23938228055 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.390095  3725 tablet_server.cc:196] TabletServer@127.3.163.66:0 shutdown complete.
I20260709 12:08:45.406134  3725 tablet_server.cc:179] TabletServer@127.3.163.67:0 shutting down...
I20260709 12:08:45.428385  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.429087  3725 tablet_replica.cc:333] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.429703  3725 raft_consensus.cc:2243] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.430649  3725 raft_consensus.cc:2272] T 445e336543f44338a49c46c2b8c3f0da P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.432288  3725 tablet_replica.cc:333] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.432761  3725 raft_consensus.cc:2243] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.433255  3725 raft_consensus.cc:2272] T b94cbd879b8446fca90f5d3d9e4539d8 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.434760  3725 tablet_replica.cc:333] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.435180  3725 raft_consensus.cc:2243] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.435851  3725 raft_consensus.cc:2272] T 47cecb63c96c4d7b980eb14ea7b74e07 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.437341  3725 tablet_replica.cc:333] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.437770  3725 raft_consensus.cc:2243] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.438154  3725 raft_consensus.cc:2272] T 57dd296690df43afb08242b672cf5416 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.439571  3725 tablet_replica.cc:333] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.439982  3725 raft_consensus.cc:2243] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.440402  3725 raft_consensus.cc:2272] T e1f6ebe0d2c4438fb2764880b5e06519 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.441794  3725 tablet_replica.cc:333] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.442211  3725 raft_consensus.cc:2243] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.442617  3725 raft_consensus.cc:2272] T 79674a77f5594f268319177a6bd75697 P e23b234ed4a64eae9ad4ffba6e3e560d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.444039  3725 tablet_replica.cc:333] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.444437  3725 raft_consensus.cc:2243] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.445195  3725 raft_consensus.cc:2272] T aed8f2cb992e4998ae12c83c7e7ed7a2 P e23b234ed4a64eae9ad4ffba6e3e560d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.446635  3725 tablet_replica.cc:333] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.447032  3725 raft_consensus.cc:2243] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.447507  3725 raft_consensus.cc:2272] T ae1433bb8a4240b794266a989e3383e1 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.448905  3725 tablet_replica.cc:333] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d: stopping tablet replica
I20260709 12:08:45.449281  3725 raft_consensus.cc:2243] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.449652  3725 raft_consensus.cc:2272] T 5dea1f3c4a274a9ea3e151fbe574e024 P e23b234ed4a64eae9ad4ffba6e3e560d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.474109  3725 tablet_server.cc:196] TabletServer@127.3.163.67:0 shutdown complete.
I20260709 12:08:45.489427  3725 master.cc:562] Master@127.3.163.126:38921 shutting down...
I20260709 12:08:45.604646  3725 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.605237  3725 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.605528  3725 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9a82d7ef62f949afa3f5b177b4fbe168: stopping tablet replica
I20260709 12:08:45.623005  3725 master.cc:584] Master@127.3.163.126:38921 shutdown complete.
3f77563bb56b48e8b5516f39f7de329b  4
83c2cfa6d0224cfa8c47c23938228055  4
e23b234ed4a64eae9ad4ffba6e3e560d  1
3f77563bb56b48e8b5516f39f7de329b  3
83c2cfa6d0224cfa8c47c23938228055  3
e23b234ed4a64eae9ad4ffba6e3e560d  3
3f77563bb56b48e8b5516f39f7de329b  0
83c2cfa6d0224cfa8c47c23938228055  8
e23b234ed4a64eae9ad4ffba6e3e560d  1
3f77563bb56b48e8b5516f39f7de329b  3
83c2cfa6d0224cfa8c47c23938228055  3
e23b234ed4a64eae9ad4ffba6e3e560d  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30511 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:45.658859  3725 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.163.126:44733
I20260709 12:08:45.659838  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:45.664599  4247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.664826  4248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:45.667268  3725 server_base.cc:1061] running on GCE node
W20260709 12:08:45.667232  4250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:45.668313  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:45.668483  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:45.668602  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598925668587 us; error 0 us; skew 500 ppm
I20260709 12:08:45.669265  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:45.671314  3725 webserver.cc:533] Webserver started at http://127.3.163.126:44061/ using document root <none> and password file <none>
I20260709 12:08:45.671720  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:45.671861  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:45.672055  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:45.673101  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/master-0-root/instance:
uuid: "c88b9973b246481e95f83d69fc69d1fa"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-s43n"
I20260709 12:08:45.676976  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:08:45.679718  4255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:45.680331  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:45.680572  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/master-0-root
uuid: "c88b9973b246481e95f83d69fc69d1fa"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-s43n"
I20260709 12:08:45.680799  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:45.696012  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:45.697072  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:45.731712  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.126:44733
I20260709 12:08:45.731796  4306 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.126:44733 every 8 connection(s)
I20260709 12:08:45.735325  4307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:45.743999  4307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa: Bootstrap starting.
I20260709 12:08:45.748200  4307 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:45.751757  4307 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa: No bootstrap required, opened a new log
I20260709 12:08:45.753686  4307 raft_consensus.cc:359] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c88b9973b246481e95f83d69fc69d1fa" member_type: VOTER }
I20260709 12:08:45.754065  4307 raft_consensus.cc:385] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:45.754257  4307 raft_consensus.cc:740] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c88b9973b246481e95f83d69fc69d1fa, State: Initialized, Role: FOLLOWER
I20260709 12:08:45.754737  4307 consensus_queue.cc:260] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c88b9973b246481e95f83d69fc69d1fa" member_type: VOTER }
I20260709 12:08:45.755162  4307 raft_consensus.cc:399] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:45.755347  4307 raft_consensus.cc:493] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:45.755553  4307 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:45.759202  4307 raft_consensus.cc:515] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c88b9973b246481e95f83d69fc69d1fa" member_type: VOTER }
I20260709 12:08:45.759632  4307 leader_election.cc:304] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c88b9973b246481e95f83d69fc69d1fa; no voters: 
I20260709 12:08:45.760569  4307 leader_election.cc:290] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:45.760908  4310 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:45.762018  4310 raft_consensus.cc:697] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 1 LEADER]: Becoming Leader. State: Replica: c88b9973b246481e95f83d69fc69d1fa, State: Running, Role: LEADER
I20260709 12:08:45.762655  4310 consensus_queue.cc:237] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c88b9973b246481e95f83d69fc69d1fa" member_type: VOTER }
I20260709 12:08:45.763154  4307 sys_catalog.cc:565] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:45.768344  4312 sys_catalog.cc:455] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader c88b9973b246481e95f83d69fc69d1fa. Latest consensus state: current_term: 1 leader_uuid: "c88b9973b246481e95f83d69fc69d1fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c88b9973b246481e95f83d69fc69d1fa" member_type: VOTER } }
I20260709 12:08:45.768488  4311 sys_catalog.cc:455] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c88b9973b246481e95f83d69fc69d1fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c88b9973b246481e95f83d69fc69d1fa" member_type: VOTER } }
I20260709 12:08:45.768999  4312 sys_catalog.cc:458] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:45.769068  4311 sys_catalog.cc:458] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:45.770542  4318 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:45.775142  4318 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:45.777985  3725 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:45.783560  4318 catalog_manager.cc:1383] Generated new cluster ID: 8ce80555dc7b4a2ca0613d54cac03a60
I20260709 12:08:45.783758  4318 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:45.817309  4318 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:45.818325  4318 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:45.830260  4318 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa: Generated new TSK 0
I20260709 12:08:45.830694  4318 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:45.844132  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:45.849764  4328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.850785  4329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.851984  4331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:45.852098  3725 server_base.cc:1061] running on GCE node
I20260709 12:08:45.853027  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:45.853196  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:45.853310  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598925853300 us; error 0 us; skew 500 ppm
I20260709 12:08:45.853740  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:45.855674  3725 webserver.cc:533] Webserver started at http://127.3.163.65:35039/ using document root <none> and password file <none>
I20260709 12:08:45.856070  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:45.856225  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:45.856419  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:45.857374  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-0-root/instance:
uuid: "01399950b586439498c3b6ef11d06c21"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-s43n"
I20260709 12:08:45.861255  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:08:45.864079  4336 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:45.864722  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:08:45.865052  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "01399950b586439498c3b6ef11d06c21"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-s43n"
I20260709 12:08:45.865291  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:45.876929  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:45.877926  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:45.879163  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:45.881139  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:45.881299  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:45.881470  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:45.881601  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:45.917184  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:39823
I20260709 12:08:45.917250  4398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:39823 every 8 connection(s)
I20260709 12:08:45.921528  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:45.927999  4403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.928512  4404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:45.930473  4406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:45.931162  3725 server_base.cc:1061] running on GCE node
I20260709 12:08:45.932307  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:45.932476  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:45.932600  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598925932588 us; error 0 us; skew 500 ppm
I20260709 12:08:45.933075  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:45.936247  3725 webserver.cc:533] Webserver started at http://127.3.163.66:45193/ using document root <none> and password file <none>
I20260709 12:08:45.936833  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:45.937074  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:45.937366  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:45.938036  4399 heartbeater.cc:344] Connected to a master server at 127.3.163.126:44733
I20260709 12:08:45.938337  4399 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:45.938458  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-1-root/instance:
uuid: "cb0840c3db8445b2a51879b3ca7bd841"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-s43n"
I20260709 12:08:45.938961  4399 heartbeater.cc:507] Master 127.3.163.126:44733 requested a full tablet report, sending...
I20260709 12:08:45.940771  4272 ts_manager.cc:194] Registered new tserver with Master: 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823)
I20260709 12:08:45.942672  4272 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49706
I20260709 12:08:45.942910  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:08:45.946002  4411 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:45.946636  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:45.946877  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-1-root
uuid: "cb0840c3db8445b2a51879b3ca7bd841"
format_stamp: "Formatted at 2026-07-09 12:08:45 on dist-test-slave-s43n"
I20260709 12:08:45.947120  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:45.971508  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:45.972543  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:45.973857  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:45.975737  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:45.975917  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:45.976131  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:45.976277  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.011143  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.66:38217
I20260709 12:08:46.011231  4473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.66:38217 every 8 connection(s)
I20260709 12:08:46.015309  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.021669  4477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.022032  4478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.024885  4480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.025565  4474 heartbeater.cc:344] Connected to a master server at 127.3.163.126:44733
I20260709 12:08:46.025863  4474 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.026089  3725 server_base.cc:1061] running on GCE node
I20260709 12:08:46.026681  4474 heartbeater.cc:507] Master 127.3.163.126:44733 requested a full tablet report, sending...
I20260709 12:08:46.027375  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.027627  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.027818  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598926027800 us; error 0 us; skew 500 ppm
I20260709 12:08:46.028656  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.028999  4272 ts_manager.cc:194] Registered new tserver with Master: cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:46.030742  4272 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49712
I20260709 12:08:46.031996  3725 webserver.cc:533] Webserver started at http://127.3.163.67:40447/ using document root <none> and password file <none>
I20260709 12:08:46.032682  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.032881  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.033151  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.034534  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-2-root/instance:
uuid: "4f62a11721854fcf94badff1251b5257"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-s43n"
I20260709 12:08:46.039865  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:08:46.043505  4485 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.044363  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:46.044677  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-2-root
uuid: "4f62a11721854fcf94badff1251b5257"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-s43n"
I20260709 12:08:46.045011  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598894987430-3725-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.056043  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.057497  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.059319  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.062186  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.062434  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.062711  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.062917  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.100404  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.67:34139
I20260709 12:08:46.100485  4547 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.67:34139 every 8 connection(s)
I20260709 12:08:46.112442  4548 heartbeater.cc:344] Connected to a master server at 127.3.163.126:44733
I20260709 12:08:46.112767  4548 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.113390  4548 heartbeater.cc:507] Master 127.3.163.126:44733 requested a full tablet report, sending...
I20260709 12:08:46.115033  4272 ts_manager.cc:194] Registered new tserver with Master: 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.115152  3725 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.011997793s
I20260709 12:08:46.116678  4272 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49722
I20260709 12:08:46.137194  4272 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49728:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:46.139724  4272 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:46.209499  4512 tablet_service.cc:1511] Processing CreateTablet for tablet 74532df54d9649808f88be3da78b17e1 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.210188  4364 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba6a7d8b5224e7d9e2a1321bb58da01 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.211030  4512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74532df54d9649808f88be3da78b17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.211272  4511 tablet_service.cc:1511] Processing CreateTablet for tablet 417233ae3e1b4c2d971208c17ee59c6a (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.211651  4364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba6a7d8b5224e7d9e2a1321bb58da01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.212507  4511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417233ae3e1b4c2d971208c17ee59c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.210232  4510 tablet_service.cc:1511] Processing CreateTablet for tablet 2534f71756354d4c87e0c0f07664b614 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.215970  4510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2534f71756354d4c87e0c0f07664b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.218444  4513 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba6a7d8b5224e7d9e2a1321bb58da01 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.219631  4513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba6a7d8b5224e7d9e2a1321bb58da01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.222688  4509 tablet_service.cc:1511] Processing CreateTablet for tablet 09f0be5ae9f44ebf97a7b8c6c0673f65 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:46.223914  4509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f0be5ae9f44ebf97a7b8c6c0673f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.225853  4508 tablet_service.cc:1511] Processing CreateTablet for tablet 254b9aa0e24c4444a94d30405cb7981f (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.227061  4508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b9aa0e24c4444a94d30405cb7981f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.229477  4507 tablet_service.cc:1511] Processing CreateTablet for tablet fd53183db9744446b4147b4252b65c57 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.230640  4507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd53183db9744446b4147b4252b65c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.233098  4504 tablet_service.cc:1511] Processing CreateTablet for tablet 1266fed47429422b8f788e244d78e9c0 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:46.234239  4504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1266fed47429422b8f788e244d78e9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.237942  4506 tablet_service.cc:1511] Processing CreateTablet for tablet b3b5187cc5c54a3da0ebd0fd2f48d54d (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:46.239120  4506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b5187cc5c54a3da0ebd0fd2f48d54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.242817  4505 tablet_service.cc:1511] Processing CreateTablet for tablet 252fe355c2b54223b970ec17edad15e7 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:46.242947  4363 tablet_service.cc:1511] Processing CreateTablet for tablet 74532df54d9649808f88be3da78b17e1 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.244061  4505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252fe355c2b54223b970ec17edad15e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.244061  4363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74532df54d9649808f88be3da78b17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.247203  4360 tablet_service.cc:1511] Processing CreateTablet for tablet 09f0be5ae9f44ebf97a7b8c6c0673f65 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:46.247664  4359 tablet_service.cc:1511] Processing CreateTablet for tablet 254b9aa0e24c4444a94d30405cb7981f (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.249008  4359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b9aa0e24c4444a94d30405cb7981f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.248940  4362 tablet_service.cc:1511] Processing CreateTablet for tablet 417233ae3e1b4c2d971208c17ee59c6a (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.250324  4362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417233ae3e1b4c2d971208c17ee59c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.250036  4357 tablet_service.cc:1511] Processing CreateTablet for tablet b3b5187cc5c54a3da0ebd0fd2f48d54d (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:46.251207  4357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b5187cc5c54a3da0ebd0fd2f48d54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.254880  4361 tablet_service.cc:1511] Processing CreateTablet for tablet 2534f71756354d4c87e0c0f07664b614 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.257032  4355 tablet_service.cc:1511] Processing CreateTablet for tablet 1266fed47429422b8f788e244d78e9c0 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:46.259922  4356 tablet_service.cc:1511] Processing CreateTablet for tablet 252fe355c2b54223b970ec17edad15e7 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:46.248970  4358 tablet_service.cc:1511] Processing CreateTablet for tablet fd53183db9744446b4147b4252b65c57 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.269639  4360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f0be5ae9f44ebf97a7b8c6c0673f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.277030  4355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1266fed47429422b8f788e244d78e9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.277582  4358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd53183db9744446b4147b4252b65c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.279290  4356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252fe355c2b54223b970ec17edad15e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.286010  4434 tablet_service.cc:1511] Processing CreateTablet for tablet 254b9aa0e24c4444a94d30405cb7981f (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:46.287242  4434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b9aa0e24c4444a94d30405cb7981f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.287401  4439 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba6a7d8b5224e7d9e2a1321bb58da01 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:46.288584  4439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba6a7d8b5224e7d9e2a1321bb58da01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.290592  4438 tablet_service.cc:1511] Processing CreateTablet for tablet 74532df54d9649808f88be3da78b17e1 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:46.290719  4432 tablet_service.cc:1511] Processing CreateTablet for tablet b3b5187cc5c54a3da0ebd0fd2f48d54d (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:46.292454  4431 tablet_service.cc:1511] Processing CreateTablet for tablet 252fe355c2b54223b970ec17edad15e7 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:46.292668  4436 tablet_service.cc:1511] Processing CreateTablet for tablet 2534f71756354d4c87e0c0f07664b614 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:46.294361  4435 tablet_service.cc:1511] Processing CreateTablet for tablet 09f0be5ae9f44ebf97a7b8c6c0673f65 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:46.296341  4430 tablet_service.cc:1511] Processing CreateTablet for tablet 1266fed47429422b8f788e244d78e9c0 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:46.298358  4437 tablet_service.cc:1511] Processing CreateTablet for tablet 417233ae3e1b4c2d971208c17ee59c6a (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:46.300882  4564 tablet_bootstrap.cc:492] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.300882  4433 tablet_service.cc:1511] Processing CreateTablet for tablet fd53183db9744446b4147b4252b65c57 (DEFAULT_TABLE table=test-workload [id=a397a849313b424aa4ea5de8c57cf201]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:46.302416  4436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2534f71756354d4c87e0c0f07664b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.304225  4430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1266fed47429422b8f788e244d78e9c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.305148  4437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417233ae3e1b4c2d971208c17ee59c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.305456  4563 tablet_bootstrap.cc:492] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.306957  4438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74532df54d9649808f88be3da78b17e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.307557  4431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252fe355c2b54223b970ec17edad15e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.308581  4433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd53183db9744446b4147b4252b65c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.313124  4432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b5187cc5c54a3da0ebd0fd2f48d54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.314353  4361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2534f71756354d4c87e0c0f07664b614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.316699  4435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f0be5ae9f44ebf97a7b8c6c0673f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.344695  4563 tablet_bootstrap.cc:654] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.394372  4564 tablet_bootstrap.cc:654] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.405294  4563 tablet_bootstrap.cc:492] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.406016  4563 ts_tablet_manager.cc:1403] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.040s
I20260709 12:08:46.406190  4565 tablet_bootstrap.cc:492] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.407765  4564 tablet_bootstrap.cc:492] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.408190  4564 ts_tablet_manager.cc:1403] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.005s
I20260709 12:08:46.408456  4563 raft_consensus.cc:359] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.409003  4563 raft_consensus.cc:385] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.409258  4563 raft_consensus.cc:740] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.409837  4563 consensus_queue.cc:260] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.410871  4564 raft_consensus.cc:359] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.411541  4564 raft_consensus.cc:385] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.411826  4564 raft_consensus.cc:740] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.412509  4565 tablet_bootstrap.cc:654] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.412487  4564 consensus_queue.cc:260] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.413461  4548 heartbeater.cc:499] Master 127.3.163.126:44733 was elected leader, sending a full tablet report...
I20260709 12:08:46.413930  4563 ts_tablet_manager.cc:1434] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:46.414793  4563 tablet_bootstrap.cc:492] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.420877  4563 tablet_bootstrap.cc:654] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.429193  4568 raft_consensus.cc:493] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.429649  4568 raft_consensus.cc:515] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.445394  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
W20260709 12:08:46.447676  4489 leader_election.cc:343] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.463701  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841" is_pre_election: true
I20260709 12:08:46.464411  4568 leader_election.cc:290] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
W20260709 12:08:46.465277  4489 leader_election.cc:343] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.465698  4489 leader_election.cc:304] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f62a11721854fcf94badff1251b5257; no voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:08:46.467464  4568 raft_consensus.cc:2749] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:46.471189  4565 tablet_bootstrap.cc:492] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.471711  4565 ts_tablet_manager.cc:1403] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.017s
I20260709 12:08:46.474380  4565 raft_consensus.cc:359] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.475117  4565 raft_consensus.cc:385] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.475455  4565 raft_consensus.cc:740] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.476356  4565 consensus_queue.cc:260] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.481268  4399 heartbeater.cc:499] Master 127.3.163.126:44733 was elected leader, sending a full tablet report...
I20260709 12:08:46.481810  4564 ts_tablet_manager.cc:1434] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.073s	user 0.033s	sys 0.038s
I20260709 12:08:46.481869  4563 tablet_bootstrap.cc:492] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.482425  4563 ts_tablet_manager.cc:1403] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.040s
I20260709 12:08:46.482769  4564 tablet_bootstrap.cc:492] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.485131  4563 raft_consensus.cc:359] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.485646  4565 ts_tablet_manager.cc:1434] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:08:46.485782  4563 raft_consensus.cc:385] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.486117  4563 raft_consensus.cc:740] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.486416  4474 heartbeater.cc:499] Master 127.3.163.126:44733 was elected leader, sending a full tablet report...
I20260709 12:08:46.486863  4563 consensus_queue.cc:260] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.488716  4564 tablet_bootstrap.cc:654] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.488862  4563 ts_tablet_manager.cc:1434] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:08:46.489719  4563 tablet_bootstrap.cc:492] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.494953  4565 tablet_bootstrap.cc:492] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.495543  4563 tablet_bootstrap.cc:654] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.502288  4565 tablet_bootstrap.cc:654] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.504891  4573 raft_consensus.cc:493] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.505321  4573 raft_consensus.cc:515] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.507862  4573 leader_election.cc:290] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139), 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823)
I20260709 12:08:46.524183  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:46.524823  4374 raft_consensus.cc:2468] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 0.
I20260709 12:08:46.526189  4415 leader_election.cc:304] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.528641  4574 raft_consensus.cc:2804] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.529075  4574 raft_consensus.cc:493] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.529138  4564 tablet_bootstrap.cc:492] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.529454  4574 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.529770  4564 ts_tablet_manager.cc:1403] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.047s	user 0.028s	sys 0.015s
I20260709 12:08:46.532655  4564 raft_consensus.cc:359] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.533408  4564 raft_consensus.cc:385] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.533722  4564 raft_consensus.cc:740] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.539285  4564 consensus_queue.cc:260] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.542937  4564 ts_tablet_manager.cc:1434] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:08:46.543893  4564 tablet_bootstrap.cc:492] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.550133  4564 tablet_bootstrap.cc:654] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.558396  4574 raft_consensus.cc:515] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.559490  4563 tablet_bootstrap.cc:492] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.559964  4563 ts_tablet_manager.cc:1403] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.015s
I20260709 12:08:46.561439  4564 tablet_bootstrap.cc:492] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.561403  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:46.562064  4374 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.562116  4564 ts_tablet_manager.cc:1403] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.012s
I20260709 12:08:46.562609  4563 raft_consensus.cc:359] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.563313  4563 raft_consensus.cc:385] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.563598  4563 raft_consensus.cc:740] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.565248  4564 raft_consensus.cc:359] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.565979  4564 raft_consensus.cc:385] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.566334  4564 raft_consensus.cc:740] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.567045  4564 consensus_queue.cc:260] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.569135  4374 raft_consensus.cc:2468] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 1.
I20260709 12:08:46.568923  4563 consensus_queue.cc:260] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.570990  4564 ts_tablet_manager.cc:1434] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:08:46.570984  4415 leader_election.cc:304] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.572219  4564 tablet_bootstrap.cc:492] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.572515  4573 raft_consensus.cc:2804] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.578720  4564 tablet_bootstrap.cc:654] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.581856  4523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
I20260709 12:08:46.582520  4523 raft_consensus.cc:2468] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 0.
I20260709 12:08:46.583781  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:46.584416  4522 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.587986  4563 ts_tablet_manager.cc:1434] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:08:46.588925  4563 tablet_bootstrap.cc:492] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.591612  4522 raft_consensus.cc:2468] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 1.
I20260709 12:08:46.594960  4569 raft_consensus.cc:493] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.595443  4569 raft_consensus.cc:515] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.598052  4569 leader_election.cc:290] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.600798  4563 tablet_bootstrap.cc:654] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.602687  4564 tablet_bootstrap.cc:492] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.603214  4564 ts_tablet_manager.cc:1403] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.014s
I20260709 12:08:46.607365  4564 raft_consensus.cc:359] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.608345  4564 raft_consensus.cc:385] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.608685  4564 raft_consensus.cc:740] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.608717  4574 leader_election.cc:290] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Requested vote from peers 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139), 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823)
I20260709 12:08:46.609666  4564 consensus_queue.cc:260] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.612901  4573 raft_consensus.cc:697] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:46.613739  4573 consensus_queue.cc:237] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:46.614583  4564 ts_tablet_manager.cc:1434] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:08:46.615541  4564 tablet_bootstrap.cc:492] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.621685  4564 tablet_bootstrap.cc:654] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.623610  4563 tablet_bootstrap.cc:492] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.624049  4563 ts_tablet_manager.cc:1403] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 12:08:46.624320  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841" is_pre_election: true
W20260709 12:08:46.626214  4340 leader_election.cc:343] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.629953  4563 raft_consensus.cc:359] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.630323  4565 tablet_bootstrap.cc:492] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.631332  4565 ts_tablet_manager.cc:1403] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.137s	user 0.061s	sys 0.054s
I20260709 12:08:46.631013  4563 raft_consensus.cc:385] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.631762  4563 raft_consensus.cc:740] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.632696  4564 tablet_bootstrap.cc:492] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.632548  4563 consensus_queue.cc:260] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.633137  4564 ts_tablet_manager.cc:1403] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 12:08:46.633998  4565 raft_consensus.cc:359] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.634672  4565 raft_consensus.cc:385] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.635076  4565 raft_consensus.cc:740] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.634560  4270 catalog_manager.cc:5697] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:46.635658  4564 raft_consensus.cc:359] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.635833  4565 consensus_queue.cc:260] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.636343  4564 raft_consensus.cc:385] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.636646  4564 raft_consensus.cc:740] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.637933  4565 ts_tablet_manager.cc:1434] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:46.637585  4564 consensus_queue.cc:260] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.638777  4565 tablet_bootstrap.cc:492] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.641986  4564 ts_tablet_manager.cc:1434] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:08:46.642844  4564 tablet_bootstrap.cc:492] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.644781  4565 tablet_bootstrap.cc:654] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.648486  4564 tablet_bootstrap.cc:654] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.641422  4563 ts_tablet_manager.cc:1434] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:08:46.654028  4563 tablet_bootstrap.cc:492] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.659915  4563 tablet_bootstrap.cc:654] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.663827  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
I20260709 12:08:46.664438  4522 raft_consensus.cc:2468] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 0.
I20260709 12:08:46.665634  4338 leader_election.cc:304] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:08:46.666432  4564 tablet_bootstrap.cc:492] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.666472  4565 tablet_bootstrap.cc:492] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.666853  4564 ts_tablet_manager.cc:1403] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 12:08:46.666723  4569 raft_consensus.cc:2804] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.666993  4565 ts_tablet_manager.cc:1403] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.012s
I20260709 12:08:46.667232  4569 raft_consensus.cc:493] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.667577  4569 raft_consensus.cc:3060] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.669003  4564 raft_consensus.cc:359] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.669493  4564 raft_consensus.cc:385] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.669708  4564 raft_consensus.cc:740] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.669678  4565 raft_consensus.cc:359] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.670471  4565 raft_consensus.cc:385] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.670429  4564 consensus_queue.cc:260] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.670837  4565 raft_consensus.cc:740] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.671571  4565 consensus_queue.cc:260] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.674427  4565 ts_tablet_manager.cc:1434] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:08:46.674635  4569 raft_consensus.cc:515] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.675307  4565 tablet_bootstrap.cc:492] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.677088  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
W20260709 12:08:46.678341  4340 leader_election.cc:343] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.679824  4564 ts_tablet_manager.cc:1434] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.011s
I20260709 12:08:46.680182  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:46.680701  4522 raft_consensus.cc:3060] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.681293  4565 tablet_bootstrap.cc:654] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.683038  4564 tablet_bootstrap.cc:492] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.689118  4564 tablet_bootstrap.cc:654] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.691234  4522 raft_consensus.cc:2468] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 1.
I20260709 12:08:46.692303  4569 leader_election.cc:290] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.692253  4338 leader_election.cc:304] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:08:46.693274  4590 raft_consensus.cc:2804] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.693749  4590 raft_consensus.cc:697] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:46.694561  4590 consensus_queue.cc:237] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.699190  4564 tablet_bootstrap.cc:492] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.699394  4563 tablet_bootstrap.cc:492] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.699615  4564 ts_tablet_manager.cc:1403] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.006s
I20260709 12:08:46.699787  4563 ts_tablet_manager.cc:1403] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.007s
I20260709 12:08:46.702509  4563 raft_consensus.cc:359] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.703150  4563 raft_consensus.cc:385] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.703415  4563 raft_consensus.cc:740] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.704104  4563 consensus_queue.cc:260] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.705780  4272 catalog_manager.cc:5697] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.706602  4563 ts_tablet_manager.cc:1434] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:08:46.704708  4564 raft_consensus.cc:359] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.707547  4565 tablet_bootstrap.cc:492] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.707784  4563 tablet_bootstrap.cc:492] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.707969  4565 ts_tablet_manager.cc:1403] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.012s
I20260709 12:08:46.710446  4565 raft_consensus.cc:359] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.711095  4565 raft_consensus.cc:385] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.711350  4565 raft_consensus.cc:740] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.711959  4565 consensus_queue.cc:260] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.713644  4563 tablet_bootstrap.cc:654] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.713923  4565 ts_tablet_manager.cc:1434] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:08:46.714797  4565 tablet_bootstrap.cc:492] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.707569  4564 raft_consensus.cc:385] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.717118  4564 raft_consensus.cc:740] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.717669  4564 consensus_queue.cc:260] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.719686  4564 ts_tablet_manager.cc:1434] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 12:08:46.720516  4564 tablet_bootstrap.cc:492] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.726214  4564 tablet_bootstrap.cc:654] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.730460  4563 tablet_bootstrap.cc:492] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.730829  4563 ts_tablet_manager.cc:1403] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.013s
I20260709 12:08:46.732057  4565 tablet_bootstrap.cc:654] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.732753  4563 raft_consensus.cc:359] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.733436  4563 raft_consensus.cc:385] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.733722  4563 raft_consensus.cc:740] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.734771  4564 tablet_bootstrap.cc:492] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.734406  4563 consensus_queue.cc:260] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.735224  4564 ts_tablet_manager.cc:1403] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.005s
I20260709 12:08:46.736562  4563 ts_tablet_manager.cc:1434] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:08:46.737442  4563 tablet_bootstrap.cc:492] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.738140  4565 tablet_bootstrap.cc:492] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.737547  4564 raft_consensus.cc:359] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.738623  4564 raft_consensus.cc:385] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.738687  4565 ts_tablet_manager.cc:1403] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 12:08:46.738927  4564 raft_consensus.cc:740] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.739614  4564 consensus_queue.cc:260] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.741765  4565 raft_consensus.cc:359] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.742478  4565 raft_consensus.cc:385] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.742813  4565 raft_consensus.cc:740] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.743674  4564 ts_tablet_manager.cc:1434] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:08:46.744035  4563 tablet_bootstrap.cc:654] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.743676  4565 consensus_queue.cc:260] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.744568  4564 tablet_bootstrap.cc:492] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.750124  4564 tablet_bootstrap.cc:654] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.760006  4565 ts_tablet_manager.cc:1434] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:08:46.760658  4564 tablet_bootstrap.cc:492] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.760937  4565 tablet_bootstrap.cc:492] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.761107  4564 ts_tablet_manager.cc:1403] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.009s
I20260709 12:08:46.763567  4564 raft_consensus.cc:359] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.764205  4564 raft_consensus.cc:385] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.764458  4564 raft_consensus.cc:740] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.765075  4564 consensus_queue.cc:260] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.767190  4564 ts_tablet_manager.cc:1434] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:46.768136  4564 tablet_bootstrap.cc:492] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21: Bootstrap starting.
I20260709 12:08:46.768960  4565 tablet_bootstrap.cc:654] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.773082  4564 tablet_bootstrap.cc:654] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:46.774967  4320 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:46.774986  4565 tablet_bootstrap.cc:492] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.775566  4565 ts_tablet_manager.cc:1403] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 12:08:46.776788  4563 tablet_bootstrap.cc:492] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.777261  4563 ts_tablet_manager.cc:1403] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.015s
I20260709 12:08:46.778245  4565 raft_consensus.cc:359] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.778937  4565 raft_consensus.cc:385] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.779215  4565 raft_consensus.cc:740] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.779870  4565 consensus_queue.cc:260] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.780023  4563 raft_consensus.cc:359] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.780748  4563 raft_consensus.cc:385] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.781054  4563 raft_consensus.cc:740] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.782099  4565 ts_tablet_manager.cc:1434] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:08:46.781888  4563 consensus_queue.cc:260] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.782963  4565 tablet_bootstrap.cc:492] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.788976  4565 tablet_bootstrap.cc:654] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.791167  4563 ts_tablet_manager.cc:1434] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:08:46.791996  4563 tablet_bootstrap.cc:492] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.793407  4564 tablet_bootstrap.cc:492] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21: No bootstrap required, opened a new log
I20260709 12:08:46.793814  4564 ts_tablet_manager.cc:1403] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.012s
I20260709 12:08:46.795260  4571 raft_consensus.cc:493] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.795708  4571 raft_consensus.cc:515] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.796161  4564 raft_consensus.cc:359] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.796772  4564 raft_consensus.cc:385] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.797045  4564 raft_consensus.cc:740] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.797663  4571 leader_election.cc:290] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:46.797739  4564 consensus_queue.cc:260] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.798686  4563 tablet_bootstrap.cc:654] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.799777  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:46.800360  4374 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 0.
I20260709 12:08:46.801303  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841" is_pre_election: true
I20260709 12:08:46.801501  4489 leader_election.cc:304] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: 
I20260709 12:08:46.801889  4449 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 0.
I20260709 12:08:46.802268  4571 raft_consensus.cc:2804] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.802459  4564 ts_tablet_manager.cc:1434] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:08:46.802631  4571 raft_consensus.cc:493] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.802966  4571 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.803431  4565 tablet_bootstrap.cc:492] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.803835  4565 ts_tablet_manager.cc:1403] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.004s
I20260709 12:08:46.806245  4565 raft_consensus.cc:359] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.806905  4565 raft_consensus.cc:385] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.807183  4565 raft_consensus.cc:740] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.807834  4565 consensus_queue.cc:260] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.809743  4565 ts_tablet_manager.cc:1434] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:46.810626  4565 tablet_bootstrap.cc:492] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.812781  4571 raft_consensus.cc:515] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.815439  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:46.815975  4374 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.816545  4565 tablet_bootstrap.cc:654] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.822623  4565 tablet_bootstrap.cc:492] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.822641  4374 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 1.
I20260709 12:08:46.823000  4565 ts_tablet_manager.cc:1403] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.007s
I20260709 12:08:46.823881  4489 leader_election.cc:304] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: 
I20260709 12:08:46.824661  4568 raft_consensus.cc:2804] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.825261  4565 raft_consensus.cc:359] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.825892  4565 raft_consensus.cc:385] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.826149  4565 raft_consensus.cc:740] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.826792  4565 consensus_queue.cc:260] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.828624  4565 ts_tablet_manager.cc:1434] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:08:46.828965  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:46.829525  4565 tablet_bootstrap.cc:492] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.829525  4449 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.835232  4565 tablet_bootstrap.cc:654] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.836197  4449 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 1.
I20260709 12:08:46.837508  4571 leader_election.cc:290] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:46.838394  4573 raft_consensus.cc:493] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.838847  4573 raft_consensus.cc:515] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.840849  4573 leader_election.cc:290] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.842940  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252fe355c2b54223b970ec17edad15e7" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
W20260709 12:08:46.844857  4413 leader_election.cc:343] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.845933  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252fe355c2b54223b970ec17edad15e7" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:46.846535  4374 raft_consensus.cc:2468] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 0.
I20260709 12:08:46.847644  4415 leader_election.cc:304] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 4f62a11721854fcf94badff1251b5257
I20260709 12:08:46.848992  4573 raft_consensus.cc:2804] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.849357  4573 raft_consensus.cc:493] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.849675  4573 raft_consensus.cc:3060] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.852411  4568 raft_consensus.cc:697] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 1 LEADER]: Becoming Leader. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:08:46.853335  4568 consensus_queue.cc:237] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.858927  4573 raft_consensus.cc:515] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.861665  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252fe355c2b54223b970ec17edad15e7" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:46.862195  4374 raft_consensus.cc:3060] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.867512  4272 catalog_manager.cc:5697] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f62a11721854fcf94badff1251b5257 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "4f62a11721854fcf94badff1251b5257" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:46.868613  4374 raft_consensus.cc:2468] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 1.
I20260709 12:08:46.869714  4415 leader_election.cc:304] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.870601  4580 raft_consensus.cc:2804] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.871093  4580 raft_consensus.cc:697] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:46.871241  4573 leader_election.cc:290] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.871948  4580 consensus_queue.cc:237] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.873796  4563 tablet_bootstrap.cc:492] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.874281  4563 ts_tablet_manager.cc:1403] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.082s	user 0.034s	sys 0.041s
I20260709 12:08:46.874264  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252fe355c2b54223b970ec17edad15e7" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257"
W20260709 12:08:46.875617  4413 leader_election.cc:343] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.876621  4563 raft_consensus.cc:359] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.877043  4574 raft_consensus.cc:493] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.877174  4563 raft_consensus.cc:385] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.877470  4563 raft_consensus.cc:740] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.877478  4574 raft_consensus.cc:515] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.878170  4563 consensus_queue.cc:260] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.878872  4565 tablet_bootstrap.cc:492] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.879273  4565 ts_tablet_manager.cc:1403] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.024s
I20260709 12:08:46.879492  4574 leader_election.cc:290] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.879757  4563 ts_tablet_manager.cc:1434] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:08:46.880457  4563 tablet_bootstrap.cc:492] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.880862  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f0be5ae9f44ebf97a7b8c6c0673f65" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:46.881158  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f0be5ae9f44ebf97a7b8c6c0673f65" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
I20260709 12:08:46.881461  4374 raft_consensus.cc:2468] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 0.
I20260709 12:08:46.881752  4522 raft_consensus.cc:2468] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 0.
I20260709 12:08:46.882414  4571 raft_consensus.cc:493] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.882896  4413 leader_election.cc:304] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.882835  4571 raft_consensus.cc:515] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.883911  4565 raft_consensus.cc:359] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.884519  4565 raft_consensus.cc:385] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.884759  4565 raft_consensus.cc:740] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.885696  4571 leader_election.cc:290] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:46.885483  4565 consensus_queue.cc:260] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.886332  4563 tablet_bootstrap.cc:654] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.887535  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1266fed47429422b8f788e244d78e9c0" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841" is_pre_election: true
I20260709 12:08:46.888091  4449 raft_consensus.cc:2468] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 0.
I20260709 12:08:46.888693  4565 ts_tablet_manager.cc:1434] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:08:46.889540  4565 tablet_bootstrap.cc:492] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841: Bootstrap starting.
I20260709 12:08:46.889735  4373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1266fed47429422b8f788e244d78e9c0" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:46.890332  4373 raft_consensus.cc:2468] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 0.
I20260709 12:08:46.891013  4489 leader_election.cc:304] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.891525  4574 raft_consensus.cc:2804] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.892457  4574 raft_consensus.cc:493] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.892066  4573 raft_consensus.cc:493] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.892782  4574 raft_consensus.cc:3060] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.893972  4573 raft_consensus.cc:515] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.894889  4568 raft_consensus.cc:2804] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.897276  4568 raft_consensus.cc:493] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.897675  4568 raft_consensus.cc:3060] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.898017  4573 leader_election.cc:290] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.899391  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:46.899940  4374 raft_consensus.cc:2468] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 0.
I20260709 12:08:46.901046  4415 leader_election.cc:304] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.901762  4573 raft_consensus.cc:2804] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.902097  4573 raft_consensus.cc:493] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.902412  4573 raft_consensus.cc:3060] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.903115  4574 raft_consensus.cc:515] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.906190  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
I20260709 12:08:46.906544  4574 leader_election.cc:290] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.906899  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f0be5ae9f44ebf97a7b8c6c0673f65" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:46.907694  4574 raft_consensus.cc:493] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.908094  4374 raft_consensus.cc:3060] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.908273  4574 raft_consensus.cc:515] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.911198  4373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:46.911369  4573 raft_consensus.cc:515] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.911799  4373 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 0.
I20260709 12:08:46.913089  4415 leader_election.cc:304] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.913725  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f0be5ae9f44ebf97a7b8c6c0673f65" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:46.914225  4522 raft_consensus.cc:3060] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.914944  4373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21"
W20260709 12:08:46.913726  4413 leader_election.cc:343] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.915019  4374 raft_consensus.cc:2468] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 1.
I20260709 12:08:46.916180  4373 raft_consensus.cc:3060] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.917707  4415 leader_election.cc:304] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.916114  4574 leader_election.cc:290] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.918962  4574 raft_consensus.cc:2804] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.919353  4574 raft_consensus.cc:697] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:46.913244  4573 leader_election.cc:290] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.915974  4608 raft_consensus.cc:2804] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.920794  4608 raft_consensus.cc:493] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.921211  4608 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.921819  4522 raft_consensus.cc:2468] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 1.
I20260709 12:08:46.923782  4590 raft_consensus.cc:493] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:46.924226  4590 raft_consensus.cc:515] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.926143  4590 leader_election.cc:290] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.926697  4523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
I20260709 12:08:46.927254  4523 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 0.
I20260709 12:08:46.927989  4521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd53183db9744446b4147b4252b65c57" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
I20260709 12:08:46.928160  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd53183db9744446b4147b4252b65c57" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841" is_pre_election: true
I20260709 12:08:46.928714  4521 raft_consensus.cc:2468] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 0.
I20260709 12:08:46.928776  4449 raft_consensus.cc:2468] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 0.
I20260709 12:08:46.929132  4373 raft_consensus.cc:2468] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 1.
I20260709 12:08:46.929807  4340 leader_election.cc:304] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.928041  4568 raft_consensus.cc:515] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.929868  4270 catalog_manager.cc:5697] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.931015  4415 leader_election.cc:304] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.931759  4590 raft_consensus.cc:2804] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:46.932107  4590 raft_consensus.cc:493] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:46.930256  4574 consensus_queue.cc:237] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.933887  4565 tablet_bootstrap.cc:654] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.934381  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1266fed47429422b8f788e244d78e9c0" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:46.934892  4449 raft_consensus.cc:3060] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.932585  4590 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.940455  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:46.941586  4573 raft_consensus.cc:2804] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.942183  4573 raft_consensus.cc:697] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:46.942938  4573 consensus_queue.cc:237] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.945061  4449 raft_consensus.cc:2468] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 1.
I20260709 12:08:46.946556  4489 leader_election.cc:304] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.947633  4373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1266fed47429422b8f788e244d78e9c0" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:46.948139  4373 raft_consensus.cc:3060] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:46.948442  4413 leader_election.cc:343] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:46.950389  4571 raft_consensus.cc:2804] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.951753  4571 raft_consensus.cc:697] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 1 LEADER]: Becoming Leader. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:08:46.932080  4568 leader_election.cc:290] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:46.957393  4571 consensus_queue.cc:237] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.957937  4373 raft_consensus.cc:2468] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 1.
I20260709 12:08:46.955782  4608 raft_consensus.cc:515] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.961802  4590 raft_consensus.cc:515] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.963927  4608 leader_election.cc:290] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.965678  4373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:46.966646  4373 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.967185  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd53183db9744446b4147b4252b65c57" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:46.968040  4522 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.968981  4521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:46.969566  4521 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.967900  4590 leader_election.cc:290] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:46.973096  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd53183db9744446b4147b4252b65c57" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:46.973655  4449 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.975421  4563 tablet_bootstrap.cc:492] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:46.975840  4563 ts_tablet_manager.cc:1403] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.096s	user 0.004s	sys 0.012s
I20260709 12:08:46.979822  4522 raft_consensus.cc:2468] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 1.
I20260709 12:08:46.980473  4449 raft_consensus.cc:2468] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 1.
I20260709 12:08:46.980746  4338 leader_election.cc:304] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: 
I20260709 12:08:46.982812  4565 tablet_bootstrap.cc:492] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841: No bootstrap required, opened a new log
I20260709 12:08:46.983110  4373 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 1.
I20260709 12:08:46.983225  4565 ts_tablet_manager.cc:1403] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.009s
I20260709 12:08:46.983208  4270 catalog_manager.cc:5697] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.984403  4590 raft_consensus.cc:2804] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.984287  4415 leader_election.cc:304] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:46.985134  4608 raft_consensus.cc:2804] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.985566  4608 raft_consensus.cc:697] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:46.985013  4270 catalog_manager.cc:5697] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:46.985920  4565 raft_consensus.cc:359] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.986541  4565 raft_consensus.cc:385] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.986822  4565 raft_consensus.cc:740] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.986930  4590 raft_consensus.cc:697] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:46.986286  4608 consensus_queue.cc:237] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.987509  4565 consensus_queue.cc:260] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.988919  4563 raft_consensus.cc:359] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.989507  4563 raft_consensus.cc:385] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.989710  4565 ts_tablet_manager.cc:1434] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:08:46.989755  4563 raft_consensus.cc:740] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.990051  4590 consensus_queue.cc:237] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.990438  4563 consensus_queue.cc:260] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:46.992075  4563 ts_tablet_manager.cc:1434] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.000s
I20260709 12:08:46.992866  4563 tablet_bootstrap.cc:492] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257: Bootstrap starting.
I20260709 12:08:46.995527  4272 catalog_manager.cc:5697] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f62a11721854fcf94badff1251b5257 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "4f62a11721854fcf94badff1251b5257" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:46.998963  4521 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 1.
I20260709 12:08:47.000157  4563 tablet_bootstrap.cc:654] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.000963  4270 catalog_manager.cc:5697] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.012116  4563 tablet_bootstrap.cc:492] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257: No bootstrap required, opened a new log
I20260709 12:08:47.012470  4563 ts_tablet_manager.cc:1403] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:08:47.014413  4563 raft_consensus.cc:359] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.014830  4563 raft_consensus.cc:385] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.015013  4563 raft_consensus.cc:740] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.014987  4270 catalog_manager.cc:5697] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.015627  4563 consensus_queue.cc:260] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.017040  4563 ts_tablet_manager.cc:1434] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:08:47.032498  4590 raft_consensus.cc:493] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.032869  4590 raft_consensus.cc:515] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.034385  4590 leader_election.cc:290] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:47.034899  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841" is_pre_election: true
I20260709 12:08:47.035209  4521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
I20260709 12:08:47.035329  4449 raft_consensus.cc:2468] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 0.
I20260709 12:08:47.035665  4521 raft_consensus.cc:2468] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 0.
I20260709 12:08:47.036151  4340 leader_election.cc:304] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:47.036700  4590 raft_consensus.cc:2804] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.037038  4590 raft_consensus.cc:493] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.037261  4590 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.041538  4590 raft_consensus.cc:515] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.043025  4590 leader_election.cc:290] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:47.043534  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:47.043841  4521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:47.043915  4449 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.044279  4521 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.048120  4449 raft_consensus.cc:2468] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 1.
I20260709 12:08:47.048292  4521 raft_consensus.cc:2468] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 1.
I20260709 12:08:47.048974  4340 leader_election.cc:304] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:47.049520  4590 raft_consensus.cc:2804] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.049925  4590 raft_consensus.cc:697] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:47.050549  4590 consensus_queue.cc:237] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.056733  4269 catalog_manager.cc:5697] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.109843  4449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:55510
I20260709 12:08:47.110482  4449 raft_consensus.cc:606] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:08:47.120702  4521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74532df54d9649808f88be3da78b17e1"
dest_uuid: "4f62a11721854fcf94badff1251b5257"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:43908
I20260709 12:08:47.121119  4521 raft_consensus.cc:606] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 1 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:08:47.127315  4449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:55510
I20260709 12:08:47.127692  4449 raft_consensus.cc:606] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:08:47.132454  4449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09f0be5ae9f44ebf97a7b8c6c0673f65"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:55510
I20260709 12:08:47.132903  4449 raft_consensus.cc:606] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:08:47.146320  4373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd53183db9744446b4147b4252b65c57"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
mode: GRACEFUL
new_leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
 from {username='slave'} at 127.0.0.1:46746
I20260709 12:08:47.146716  4373 raft_consensus.cc:606] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Received request to transfer leadership to TS cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:08:47.150697  4373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
mode: GRACEFUL
new_leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
 from {username='slave'} at 127.0.0.1:46746
I20260709 12:08:47.151064  4373 raft_consensus.cc:606] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Received request to transfer leadership to TS cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:08:47.162122  4608 raft_consensus.cc:493] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.162475  4608 raft_consensus.cc:515] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.164041  4608 leader_election.cc:290] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:47.164709  4373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:47.165249  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f62a11721854fcf94badff1251b5257" is_pre_election: true
I20260709 12:08:47.166143  4522 raft_consensus.cc:2393] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cb0840c3db8445b2a51879b3ca7bd841 in current term 1: Already voted for candidate 01399950b586439498c3b6ef11d06c21 in this term.
I20260709 12:08:47.166106  4608 consensus_queue.cc:1048] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.167124  4413 leader_election.cc:304] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb0840c3db8445b2a51879b3ca7bd841; no voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257
I20260709 12:08:47.167764  4608 raft_consensus.cc:3060] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.173285  4608 raft_consensus.cc:2749] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.177938  4574 consensus_queue.cc:1048] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.185586  4573 raft_consensus.cc:993] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:08:47.185920  4608 raft_consensus.cc:1081] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:08:47.187173  4373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46744
I20260709 12:08:47.187584  4373 raft_consensus.cc:493] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.187834  4373 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.191967  4373 raft_consensus.cc:515] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:47.193496  4373 leader_election.cc:290] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Requested vote from peers 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:47.194056  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:47.194507  4522 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.194957  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:47.195364  4449 raft_consensus.cc:3055] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.195601  4449 raft_consensus.cc:740] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:47.196233  4449 consensus_queue.cc:260] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:47.197098  4449 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.199644  4522 raft_consensus.cc:2468] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:08:47.200445  4338 leader_election.cc:304] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: 
I20260709 12:08:47.201145  4590 raft_consensus.cc:2804] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.201498  4590 raft_consensus.cc:697] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:47.201601  4449 raft_consensus.cc:2468] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:08:47.202170  4590 consensus_queue.cc:237] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:08:47.207666  4270 catalog_manager.cc:5697] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 1 to 2, leader changed from cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.229584  4571 raft_consensus.cc:493] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.229935  4571 raft_consensus.cc:515] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.231318  4571 leader_election.cc:290] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:47.231977  4373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252fe355c2b54223b970ec17edad15e7" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:47.232203  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252fe355c2b54223b970ec17edad15e7" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841" is_pre_election: true
I20260709 12:08:47.232671  4373 raft_consensus.cc:2393] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f62a11721854fcf94badff1251b5257 in current term 1: Already voted for candidate cb0840c3db8445b2a51879b3ca7bd841 in this term.
I20260709 12:08:47.233494  4489 leader_election.cc:304] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f62a11721854fcf94badff1251b5257; no voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:08:47.234088  4571 raft_consensus.cc:3060] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.238153  4571 raft_consensus.cc:2749] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.263478  4571 raft_consensus.cc:493] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.263803  4571 raft_consensus.cc:515] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.265352  4571 leader_election.cc:290] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:47.266110  4373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "01399950b586439498c3b6ef11d06c21" is_pre_election: true
I20260709 12:08:47.266444  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841" is_pre_election: true
I20260709 12:08:47.266798  4373 raft_consensus.cc:2393] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f62a11721854fcf94badff1251b5257 in current term 1: Already voted for candidate cb0840c3db8445b2a51879b3ca7bd841 in this term.
I20260709 12:08:47.267886  4489 leader_election.cc:304] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f62a11721854fcf94badff1251b5257; no voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:08:47.267980  4590 consensus_queue.cc:1048] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.268504  4571 raft_consensus.cc:3060] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.274576  4571 raft_consensus.cc:2749] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.278167  4590 consensus_queue.cc:1048] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.328994  4608 consensus_queue.cc:1048] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.337622  4574 consensus_queue.cc:1048] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.345347  4574 raft_consensus.cc:993] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:08:47.345745  4574 raft_consensus.cc:1081] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:08:47.345793  4571 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.347404  4373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09f0be5ae9f44ebf97a7b8c6c0673f65"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46744
I20260709 12:08:47.347913  4373 raft_consensus.cc:493] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.348260  4373 raft_consensus.cc:3060] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.354554  4373 raft_consensus.cc:515] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.355515  4568 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.363350  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f0be5ae9f44ebf97a7b8c6c0673f65" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:47.363919  4373 leader_election.cc:290] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:47.364715  4449 raft_consensus.cc:3055] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.364883  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f0be5ae9f44ebf97a7b8c6c0673f65" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:47.365155  4449 raft_consensus.cc:740] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:47.365451  4522 raft_consensus.cc:3060] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.366143  4449 consensus_queue.cc:260] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.367417  4449 raft_consensus.cc:3060] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.368943  4571 raft_consensus.cc:993] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:08:47.369338  4571 raft_consensus.cc:1081] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 1 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:08:47.370884  4374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74532df54d9649808f88be3da78b17e1"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46732
I20260709 12:08:47.371372  4374 raft_consensus.cc:493] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.371716  4374 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.372588  4522 raft_consensus.cc:2468] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:08:47.373792  4338 leader_election.cc:304] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: 
I20260709 12:08:47.374977  4626 raft_consensus.cc:2804] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.375420  4626 raft_consensus.cc:697] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:47.376166  4626 consensus_queue.cc:237] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.376821  4449 raft_consensus.cc:2468] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:08:47.377918  4374 raft_consensus.cc:515] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.380932  4374 leader_election.cc:290] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:47.381412  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:47.381827  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:47.382020  4449 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.382326  4522 raft_consensus.cc:3055] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.382623  4522 raft_consensus.cc:740] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:08:47.383272  4522 consensus_queue.cc:260] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.384430  4522 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.386417  4449 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:08:47.387212  4340 leader_election.cc:304] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:47.387779  4626 raft_consensus.cc:2804] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.388299  4626 raft_consensus.cc:697] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:47.387764  4270 catalog_manager.cc:5697] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 1 to 2, leader changed from cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.388962  4626 consensus_queue.cc:237] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.390055  4522 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:08:47.398020  4270 catalog_manager.cc:5697] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 1 to 2, leader changed from 4f62a11721854fcf94badff1251b5257 (127.3.163.67) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.451043  4574 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.459637  4608 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.459784  4571 consensus_queue.cc:1048] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.474036  4608 raft_consensus.cc:993] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:08:47.474434  4608 raft_consensus.cc:1081] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:08:47.476694  4571 consensus_queue.cc:1048] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.478281  4626 consensus_queue.cc:1048] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.479120  4374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46744
I20260709 12:08:47.479669  4374 raft_consensus.cc:493] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.482584  4580 consensus_queue.cc:1048] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.480068  4374 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.490880  4637 consensus_queue.cc:1048] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.492726  4374 raft_consensus.cc:515] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.496479  4374 leader_election.cc:290] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:47.498446  4521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:47.498950  4521 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.504673  4448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:47.505226  4448 raft_consensus.cc:3055] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.505517  4448 raft_consensus.cc:740] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:47.505321  4521 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:08:47.506168  4574 consensus_queue.cc:1048] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.506235  4448 consensus_queue.cc:260] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.507184  4338 leader_election.cc:304] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: 
I20260709 12:08:47.507580  4448 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.507948  4637 raft_consensus.cc:2804] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.508525  4637 raft_consensus.cc:697] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:47.509279  4637 consensus_queue.cc:237] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.514323  4448 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:08:47.515020  4574 consensus_queue.cc:1048] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.518374  4269 catalog_manager.cc:5697] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 1 to 2, leader changed from cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.523897  4626 raft_consensus.cc:993] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21: : Instructing follower cb0840c3db8445b2a51879b3ca7bd841 to start an election
I20260709 12:08:47.524307  4626 raft_consensus.cc:1081] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Signalling peer cb0840c3db8445b2a51879b3ca7bd841 to start an election
I20260709 12:08:47.525892  4449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
 from {username='slave'} at 127.0.0.1:55506
I20260709 12:08:47.526403  4449 raft_consensus.cc:493] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.526767  4449 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.533125  4449 raft_consensus.cc:515] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.534977  4449 leader_election.cc:290] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 2 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:47.535709  4372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:47.536242  4372 raft_consensus.cc:3055] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.536532  4372 raft_consensus.cc:740] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:47.537269  4372 consensus_queue.cc:260] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.537755  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:47.538285  4522 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.538399  4372 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.540114  4608 consensus_queue.cc:1048] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.544420  4637 consensus_queue.cc:1048] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.545845  4372 raft_consensus.cc:2468] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 2.
I20260709 12:08:47.546931  4415 leader_election.cc:304] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:47.547672  4608 raft_consensus.cc:2804] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.548238  4608 raft_consensus.cc:697] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:47.549017  4608 consensus_queue.cc:237] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.550431  4522 raft_consensus.cc:2468] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 2.
I20260709 12:08:47.557050  4269 catalog_manager.cc:5697] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 1 to 2, leader changed from 01399950b586439498c3b6ef11d06c21 (127.3.163.65) to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.566805  4637 consensus_queue.cc:1048] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.574134  4590 raft_consensus.cc:993] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21: : Instructing follower cb0840c3db8445b2a51879b3ca7bd841 to start an election
I20260709 12:08:47.574546  4637 raft_consensus.cc:1081] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Signalling peer cb0840c3db8445b2a51879b3ca7bd841 to start an election
I20260709 12:08:47.576066  4449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd53183db9744446b4147b4252b65c57"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
 from {username='slave'} at 127.0.0.1:55506
I20260709 12:08:47.576560  4449 raft_consensus.cc:493] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.576938  4449 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.582276  4449 raft_consensus.cc:515] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.583753  4449 leader_election.cc:290] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 2 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:08:47.584544  4372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd53183db9744446b4147b4252b65c57" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:47.584990  4523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd53183db9744446b4147b4252b65c57" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:08:47.585083  4372 raft_consensus.cc:3055] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:47.585520  4523 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.585518  4372 raft_consensus.cc:740] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:47.586429  4372 consensus_queue.cc:260] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.587535  4372 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:47.590061  4523 raft_consensus.cc:2468] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 2.
I20260709 12:08:47.590969  4413 leader_election.cc:304] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:47.591545  4608 raft_consensus.cc:2804] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:47.591763  4372 raft_consensus.cc:2468] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 2.
I20260709 12:08:47.592006  4608 raft_consensus.cc:697] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:08:47.592726  4608 consensus_queue.cc:237] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:47.597461  4272 catalog_manager.cc:5697] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 1 to 2, leader changed from 01399950b586439498c3b6ef11d06c21 (127.3.163.65) to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.650743  4449 raft_consensus.cc:1275] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:47.651706  4637 consensus_queue.cc:1048] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:47.657948  4523 raft_consensus.cc:1275] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:47.659207  4637 consensus_queue.cc:1048] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:47.818639  4449 raft_consensus.cc:1275] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:47.819759  4637 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:47.826110  4521 raft_consensus.cc:1275] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:47.827714  4626 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:47.897286  4449 raft_consensus.cc:1275] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:47.898226  4626 consensus_queue.cc:1048] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:47.905476  4521 raft_consensus.cc:1275] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:47.906694  4637 consensus_queue.cc:1048] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:47.943591  4372 raft_consensus.cc:1275] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Refusing update from remote peer cb0840c3db8445b2a51879b3ca7bd841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:47.944621  4608 consensus_queue.cc:1048] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:47.950922  4521 raft_consensus.cc:1275] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Refusing update from remote peer cb0840c3db8445b2a51879b3ca7bd841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:47.953213  4574 consensus_queue.cc:1048] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.003806  4521 raft_consensus.cc:1275] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.004838  4637 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.010823  4449 raft_consensus.cc:1275] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.012660  4569 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.059932  4372 raft_consensus.cc:1275] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Refusing update from remote peer cb0840c3db8445b2a51879b3ca7bd841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.060917  4574 consensus_queue.cc:1048] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:48.067173  4521 raft_consensus.cc:1275] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Refusing update from remote peer cb0840c3db8445b2a51879b3ca7bd841: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:48.068733  4573 consensus_queue.cc:1048] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:50.181181  3725 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:50.181824  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:50.196103  4372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
mode: GRACEFUL
new_leader_uuid: "4f62a11721854fcf94badff1251b5257"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:08:50.196511  4372 raft_consensus.cc:606] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Received request to transfer leadership to TS 4f62a11721854fcf94badff1251b5257
I20260709 12:08:50.198704  4372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74532df54d9649808f88be3da78b17e1"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
mode: GRACEFUL
new_leader_uuid: "4f62a11721854fcf94badff1251b5257"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:08:50.199087  4372 raft_consensus.cc:606] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Received request to transfer leadership to TS 4f62a11721854fcf94badff1251b5257
I20260709 12:08:50.199920  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:50.200276  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:50.303323  4646 raft_consensus.cc:993] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21: : Instructing follower 4f62a11721854fcf94badff1251b5257 to start an election
I20260709 12:08:50.303753  4649 raft_consensus.cc:1081] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Signalling peer 4f62a11721854fcf94badff1251b5257 to start an election
I20260709 12:08:50.304988  4521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614"
dest_uuid: "4f62a11721854fcf94badff1251b5257"
 from {username='slave'} at 127.0.0.1:43896
I20260709 12:08:50.305389  4521 raft_consensus.cc:493] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:50.305630  4521 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.309952  4521 raft_consensus.cc:515] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:50.311918  4521 leader_election.cc:290] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 3 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:50.312966  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:50.313196  4372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:50.313408  4449 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.313701  4372 raft_consensus.cc:3055] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:50.313958  4372 raft_consensus.cc:740] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:50.314559  4372 consensus_queue.cc:260] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:50.315366  4372 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.317377  4449 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 3.
I20260709 12:08:50.318434  4489 leader_election.cc:304] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:50.319020  4571 raft_consensus.cc:2804] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:50.320062  4571 raft_consensus.cc:697] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Becoming Leader. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:08:50.320581  4372 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 3.
I20260709 12:08:50.320829  4571 consensus_queue.cc:237] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:50.326449  4269 catalog_manager.cc:5697] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 reported cstate change: term changed from 2 to 3, leader changed from 01399950b586439498c3b6ef11d06c21 (127.3.163.65) to 4f62a11721854fcf94badff1251b5257 (127.3.163.67). New cstate: current_term: 3 leader_uuid: "4f62a11721854fcf94badff1251b5257" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:50.561216  4646 raft_consensus.cc:993] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21: : Instructing follower 4f62a11721854fcf94badff1251b5257 to start an election
I20260709 12:08:50.561565  4649 raft_consensus.cc:1081] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Signalling peer 4f62a11721854fcf94badff1251b5257 to start an election
I20260709 12:08:50.562728  4521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74532df54d9649808f88be3da78b17e1"
dest_uuid: "4f62a11721854fcf94badff1251b5257"
 from {username='slave'} at 127.0.0.1:43896
I20260709 12:08:50.563119  4521 raft_consensus.cc:493] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:50.563349  4521 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.568837  4521 raft_consensus.cc:515] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:50.570256  4521 leader_election.cc:290] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 3 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:08:50.570935  4372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:08:50.571265  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:08:50.571410  4372 raft_consensus.cc:3055] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:50.571673  4449 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.571688  4372 raft_consensus.cc:740] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:08:50.572389  4372 consensus_queue.cc:260] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:50.573256  4372 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:50.575390  4449 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 3.
I20260709 12:08:50.576172  4489 leader_election.cc:304] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:08:50.576732  4571 raft_consensus.cc:2804] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:50.577157  4571 raft_consensus.cc:697] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Becoming Leader. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:08:50.577360  4372 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 3.
I20260709 12:08:50.577863  4571 consensus_queue.cc:237] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:08:50.583410  4269 catalog_manager.cc:5697] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 reported cstate change: term changed from 2 to 3, leader changed from 01399950b586439498c3b6ef11d06c21 (127.3.163.65) to 4f62a11721854fcf94badff1251b5257 (127.3.163.67). New cstate: current_term: 3 leader_uuid: "4f62a11721854fcf94badff1251b5257" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:50.757601  4449 raft_consensus.cc:1275] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Refusing update from remote peer 4f62a11721854fcf94badff1251b5257: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:50.758579  4571 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:50.767002  4372 raft_consensus.cc:1275] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Refusing update from remote peer 4f62a11721854fcf94badff1251b5257: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:50.768930  4571 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:51.201107  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:51.204978  4372 raft_consensus.cc:1275] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Refusing update from remote peer 4f62a11721854fcf94badff1251b5257: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:51.205924  4449 raft_consensus.cc:1275] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Refusing update from remote peer 4f62a11721854fcf94badff1251b5257: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:51.206537  4571 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:51.207396  4659 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:51.208460  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:51.209007  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:52.209903  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.215370  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:52.215723  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.216517  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.221935  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.222304  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.223062  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.228168  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.228530  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.229295  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.234439  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.234797  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.235769  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.241765  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.242137  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.243018  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.248026  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.248404  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.249296  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.254226  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.254580  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.255326  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.260681  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.261237  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.287324  3725 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:00.294270  4521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74532df54d9649808f88be3da78b17e1"
dest_uuid: "4f62a11721854fcf94badff1251b5257"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:43908
I20260709 12:09:00.295162  4521 raft_consensus.cc:606] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:09:00.302155  4521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614"
dest_uuid: "4f62a11721854fcf94badff1251b5257"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:43908
I20260709 12:09:00.302501  4521 raft_consensus.cc:606] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:09:00.308233  4449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:55510
I20260709 12:09:00.308591  4449 raft_consensus.cc:606] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:09:00.312459  4449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd53183db9744446b4147b4252b65c57"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:55510
I20260709 12:09:00.312790  4449 raft_consensus.cc:606] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:09:00.316454  4449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
mode: GRACEFUL
new_leader_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:55510
I20260709 12:09:00.316781  4449 raft_consensus.cc:606] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Received request to transfer leadership to TS 01399950b586439498c3b6ef11d06c21
I20260709 12:09:00.361411  4667 raft_consensus.cc:993] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:00.361815  4671 raft_consensus.cc:1081] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:00.363210  4374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd53183db9744446b4147b4252b65c57"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46744
I20260709 12:09:00.363610  4374 raft_consensus.cc:493] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:00.363906  4374 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.369153  4374 raft_consensus.cc:515] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.370787  4374 leader_election.cc:290] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 3 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:09:00.371330  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd53183db9744446b4147b4252b65c57" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:09:00.371785  4521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd53183db9744446b4147b4252b65c57" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:09:00.371975  4449 raft_consensus.cc:3055] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:00.372246  4521 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.372262  4449 raft_consensus.cc:740] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:09:00.373200  4449 consensus_queue.cc:260] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.374401  4449 raft_consensus.cc:3060] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.378561  4521 raft_consensus.cc:2468] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 3.
I20260709 12:09:00.379666  4338 leader_election.cc:304] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: 
I20260709 12:09:00.380484  4670 raft_consensus.cc:2804] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:00.380498  4449 raft_consensus.cc:2468] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 3.
I20260709 12:09:00.381495  4670 raft_consensus.cc:697] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 3 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:00.382310  4670 consensus_queue.cc:237] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.388639  4270 catalog_manager.cc:5697] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 2 to 3, leader changed from cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:00.428344  4667 raft_consensus.cc:993] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:00.428671  4671 raft_consensus.cc:1081] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:00.429868  4374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46744
I20260709 12:09:00.430287  4374 raft_consensus.cc:493] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:00.430639  4374 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.435119  4374 raft_consensus.cc:515] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.436407  4374 leader_election.cc:290] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 3 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:09:00.436929  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:09:00.437285  4521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5187cc5c54a3da0ebd0fd2f48d54d" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:09:00.437407  4449 raft_consensus.cc:3055] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:00.437665  4449 raft_consensus.cc:740] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:09:00.437690  4521 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.438273  4449 consensus_queue.cc:260] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.439074  4449 raft_consensus.cc:3060] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.441278  4521 raft_consensus.cc:2468] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 3.
I20260709 12:09:00.441996  4338 leader_election.cc:304] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, 4f62a11721854fcf94badff1251b5257; no voters: 
I20260709 12:09:00.442541  4670 raft_consensus.cc:2804] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:00.442871  4670 raft_consensus.cc:697] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 3 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:00.442898  4449 raft_consensus.cc:2468] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 3.
I20260709 12:09:00.443701  4670 consensus_queue.cc:237] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.449456  4270 catalog_manager.cc:5697] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 2 to 3, leader changed from cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:00.520087  4666 raft_consensus.cc:993] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:00.520511  4679 raft_consensus.cc:1081] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:00.521715  4374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46732
I20260709 12:09:00.522086  4374 raft_consensus.cc:493] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:00.522316  4374 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:00.526088  4374 raft_consensus.cc:515] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.527375  4374 leader_election.cc:290] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 4 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:09:00.527930  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:09:00.528220  4521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:09:00.528349  4449 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:00.528630  4521 raft_consensus.cc:3055] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:00.528879  4521 raft_consensus.cc:740] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:09:00.529419  4521 consensus_queue.cc:260] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.530223  4521 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:00.532068  4449 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 4.
I20260709 12:09:00.532873  4340 leader_election.cc:304] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:09:00.533394  4670 raft_consensus.cc:2804] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:00.533731  4670 raft_consensus.cc:697] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:00.534108  4521 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 4.
I20260709 12:09:00.534466  4670 consensus_queue.cc:237] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.540544  4270 catalog_manager.cc:5697] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 3 to 4, leader changed from 4f62a11721854fcf94badff1251b5257 (127.3.163.67) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 4 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:00.880625  4681 raft_consensus.cc:993] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:00.881230  4681 raft_consensus.cc:1081] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:00.882910  4372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46744
I20260709 12:09:00.883381  4372 raft_consensus.cc:493] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:00.883697  4372 raft_consensus.cc:3060] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:00.908663  4372 raft_consensus.cc:515] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:00.976634  4372 leader_election.cc:290] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:09:01.082182  4523 raft_consensus.cc:1275] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.082320  4520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:09:01.082883  4520 raft_consensus.cc:3060] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.083727  4522 raft_consensus.cc:1275] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.087721  4684 raft_consensus.cc:993] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257: : Instructing follower 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:01.088177  4684 raft_consensus.cc:1081] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Signalling peer 01399950b586439498c3b6ef11d06c21 to start an election
I20260709 12:09:01.090804  4520 raft_consensus.cc:2468] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:09:01.094384  4374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74532df54d9649808f88be3da78b17e1"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
 from {username='slave'} at 127.0.0.1:46732
I20260709 12:09:01.094347  4448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b9aa0e24c4444a94d30405cb7981f" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:09:01.094970  4448 raft_consensus.cc:3055] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:01.095342  4448 raft_consensus.cc:740] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:09:01.094941  4374 raft_consensus.cc:493] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.096143  4448 consensus_queue.cc:260] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:01.096230  4374 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.097165  4449 raft_consensus.cc:1275] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.097334  4448 raft_consensus.cc:3060] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.098644  4449 raft_consensus.cc:1275] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 4 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:01.099189  4447 raft_consensus.cc:1275] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.103015  4686 consensus_queue.cc:1048] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:01.103946  4448 raft_consensus.cc:2468] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 2.
I20260709 12:09:01.096093  4670 consensus_queue.cc:1048] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:09:01.104615  4374 raft_consensus.cc:515] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:01.104691  4672 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:01.105021  4340 leader_election.cc:304] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:09:01.105504  4683 consensus_queue.cc:1048] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:01.106005  4682 raft_consensus.cc:2804] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:01.107892  4682 raft_consensus.cc:697] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:01.108696  4682 consensus_queue.cc:237] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:01.110639  4449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:09:01.111883  4449 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.115340  4522 raft_consensus.cc:1240] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Rejecting Update request from peer cb0840c3db8445b2a51879b3ca7bd841 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:01.106796  4683 consensus_queue.cc:1048] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:01.107216  4374 leader_election.cc:290] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 4 election: Requested vote from peers cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:09:01.121444  4449 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 4.
I20260709 12:09:01.122357  4340 leader_election.cc:304] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01399950b586439498c3b6ef11d06c21, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:09:01.123142  4670 raft_consensus.cc:2804] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:01.123621  4670 raft_consensus.cc:697] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Becoming Leader. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:01.124722  4670 consensus_queue.cc:237] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:01.134636  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "01399950b586439498c3b6ef11d06c21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:09:01.135151  4522 raft_consensus.cc:3055] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:01.135432  4522 raft_consensus.cc:740] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:09:01.136261  4522 consensus_queue.cc:260] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:01.137590  4522 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.145852  4520 raft_consensus.cc:1275] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 4 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:01.156347  4522 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01399950b586439498c3b6ef11d06c21 in term 4.
I20260709 12:09:01.157739  4670 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:01.170658  4270 catalog_manager.cc:5697] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 1 to 2, leader changed from cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.195822  4270 catalog_manager.cc:5697] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 reported cstate change: term changed from 3 to 4, leader changed from 4f62a11721854fcf94badff1251b5257 (127.3.163.67) to 01399950b586439498c3b6ef11d06c21 (127.3.163.65). New cstate: current_term: 4 leader_uuid: "01399950b586439498c3b6ef11d06c21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.525384  4522 raft_consensus.cc:1275] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 4 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:01.526516  4687 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:01.534154  4448 raft_consensus.cc:1275] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 4 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:01.535403  4687 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:01.644212  4522 raft_consensus.cc:1275] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:01.645228  4687 consensus_queue.cc:1048] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:01.648679  4448 raft_consensus.cc:1275] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Refusing update from remote peer 01399950b586439498c3b6ef11d06c21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:01.649972  4687 consensus_queue.cc:1048] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:01.784974  4544 debug-util.cc:398] Leaking SignalData structure 0x7b08000ade40 after lost signal to thread 3728
W20260709 12:09:01.785748  4544 debug-util.cc:398] Leaking SignalData structure 0x7b080019bc60 after lost signal to thread 4306
W20260709 12:09:01.786528  4544 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8b20 after lost signal to thread 4398
W20260709 12:09:01.787273  4544 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6360 after lost signal to thread 4473
W20260709 12:09:01.788012  4544 debug-util.cc:398] Leaking SignalData structure 0x7b0800144e20 after lost signal to thread 4547
I20260709 12:09:03.707623  3725 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:03.708379  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:03.718142  4374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
mode: GRACEFUL
new_leader_uuid: "4f62a11721854fcf94badff1251b5257"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:09:03.718681  4374 raft_consensus.cc:606] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Received request to transfer leadership to TS 4f62a11721854fcf94badff1251b5257
I20260709 12:09:03.720920  4374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
mode: GRACEFUL
new_leader_uuid: "4f62a11721854fcf94badff1251b5257"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:09:03.721431  4374 raft_consensus.cc:606] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Received request to transfer leadership to TS 4f62a11721854fcf94badff1251b5257
I20260709 12:09:03.723541  4374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74532df54d9649808f88be3da78b17e1"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
mode: GRACEFUL
new_leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:09:03.724045  4374 raft_consensus.cc:606] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Received request to transfer leadership to TS cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:09:03.726003  4374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01"
dest_uuid: "01399950b586439498c3b6ef11d06c21"
mode: GRACEFUL
new_leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:09:03.726460  4374 raft_consensus.cc:606] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Received request to transfer leadership to TS cb0840c3db8445b2a51879b3ca7bd841
I20260709 12:09:03.727449  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:03.727970  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:03.817869  4711 raft_consensus.cc:993] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21: : Instructing follower cb0840c3db8445b2a51879b3ca7bd841 to start an election
I20260709 12:09:03.818274  4710 raft_consensus.cc:1081] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Signalling peer cb0840c3db8445b2a51879b3ca7bd841 to start an election
I20260709 12:09:03.819609  4447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
 from {username='slave'} at 127.0.0.1:55506
I20260709 12:09:03.820124  4447 raft_consensus.cc:493] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:03.820499  4447 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.822780  4710 raft_consensus.cc:993] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21: : Instructing follower 4f62a11721854fcf94badff1251b5257 to start an election
I20260709 12:09:03.823181  4710 raft_consensus.cc:1081] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Signalling peer 4f62a11721854fcf94badff1251b5257 to start an election
I20260709 12:09:03.824651  4520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614"
dest_uuid: "4f62a11721854fcf94badff1251b5257"
 from {username='slave'} at 127.0.0.1:43896
I20260709 12:09:03.825083  4520 raft_consensus.cc:493] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:03.825343  4520 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:03.827982  4447 raft_consensus.cc:515] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:09:03.829488  4520 raft_consensus.cc:515] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:03.830564  4447 leader_election.cc:290] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 3 election: Requested vote from peers 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139), 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823)
I20260709 12:09:03.831038  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:09:03.831547  4522 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.832119  4520 leader_election.cc:290] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 5 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:09:03.832324  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba6a7d8b5224e7d9e2a1321bb58da01" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:09:03.832896  4374 raft_consensus.cc:3055] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:03.833166  4374 raft_consensus.cc:740] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:03.833823  4374 consensus_queue.cc:260] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:09:03.834873  4374 raft_consensus.cc:3060] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:03.835410  4522 raft_consensus.cc:2468] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 3.
I20260709 12:09:03.836462  4413 leader_election.cc:304] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:09:03.837247  4667 raft_consensus.cc:2804] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:03.837740  4372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:09:03.837875  4447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2534f71756354d4c87e0c0f07664b614" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:09:03.838217  4372 raft_consensus.cc:3055] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:03.838428  4447 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:03.838601  4372 raft_consensus.cc:740] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:03.839327  4372 consensus_queue.cc:260] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:03.840337  4372 raft_consensus.cc:3060] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:03.845012  4447 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 5.
I20260709 12:09:03.846305  4489 leader_election.cc:304] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:09:03.847010  4679 raft_consensus.cc:2804] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:03.847584  4667 raft_consensus.cc:697] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:09:03.848407  4372 raft_consensus.cc:2468] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 5.
I20260709 12:09:03.848394  4667 consensus_queue.cc:237] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } }
I20260709 12:09:03.852097  4374 raft_consensus.cc:2468] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 3.
I20260709 12:09:03.853758  4679 raft_consensus.cc:697] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 5 LEADER]: Becoming Leader. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:09:03.854636  4679 consensus_queue.cc:237] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:03.862818  4270 catalog_manager.cc:5697] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 2 to 3, leader changed from 01399950b586439498c3b6ef11d06c21 (127.3.163.65) to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:03.866508  4269 catalog_manager.cc:5697] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 reported cstate change: term changed from 4 to 5, leader changed from 01399950b586439498c3b6ef11d06c21 (127.3.163.65) to 4f62a11721854fcf94badff1251b5257 (127.3.163.67). New cstate: current_term: 5 leader_uuid: "4f62a11721854fcf94badff1251b5257" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:04.052886  4710 raft_consensus.cc:993] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21: : Instructing follower cb0840c3db8445b2a51879b3ca7bd841 to start an election
I20260709 12:09:04.053247  4711 raft_consensus.cc:1081] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Signalling peer cb0840c3db8445b2a51879b3ca7bd841 to start an election
I20260709 12:09:04.054365  4447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74532df54d9649808f88be3da78b17e1"
dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
 from {username='slave'} at 127.0.0.1:55506
I20260709 12:09:04.054781  4447 raft_consensus.cc:493] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.055042  4447 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:04.059312  4447 raft_consensus.cc:515] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:04.060833  4447 leader_election.cc:290] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 5 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), 4f62a11721854fcf94badff1251b5257 (127.3.163.67:34139)
I20260709 12:09:04.061311  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:09:04.061784  4374 raft_consensus.cc:3055] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:04.061719  4522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74532df54d9649808f88be3da78b17e1" candidate_uuid: "cb0840c3db8445b2a51879b3ca7bd841" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4f62a11721854fcf94badff1251b5257"
I20260709 12:09:04.062136  4374 raft_consensus.cc:740] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:04.062278  4522 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:04.062817  4374 consensus_queue.cc:260] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:04.063846  4374 raft_consensus.cc:3060] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:04.067787  4522 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 5.
I20260709 12:09:04.068631  4413 leader_election.cc:304] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:09:04.069289  4667 raft_consensus.cc:2804] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:04.069402  4374 raft_consensus.cc:2468] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb0840c3db8445b2a51879b3ca7bd841 in term 5.
I20260709 12:09:04.069789  4667 raft_consensus.cc:697] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 LEADER]: Becoming Leader. State: Replica: cb0840c3db8445b2a51879b3ca7bd841, State: Running, Role: LEADER
I20260709 12:09:04.070467  4667 consensus_queue.cc:237] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:04.076718  4269 catalog_manager.cc:5697] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 reported cstate change: term changed from 4 to 5, leader changed from 01399950b586439498c3b6ef11d06c21 (127.3.163.65) to cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66). New cstate: current_term: 5 leader_uuid: "cb0840c3db8445b2a51879b3ca7bd841" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:04.105723  4710 raft_consensus.cc:993] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21: : Instructing follower 4f62a11721854fcf94badff1251b5257 to start an election
I20260709 12:09:04.106055  4711 raft_consensus.cc:1081] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Signalling peer 4f62a11721854fcf94badff1251b5257 to start an election
I20260709 12:09:04.107147  4522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a"
dest_uuid: "4f62a11721854fcf94badff1251b5257"
 from {username='slave'} at 127.0.0.1:43896
I20260709 12:09:04.107486  4522 raft_consensus.cc:493] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.107690  4522 raft_consensus.cc:3060] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:04.111228  4522 raft_consensus.cc:515] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:04.112490  4522 leader_election.cc:290] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 2 election: Requested vote from peers 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823), cb0840c3db8445b2a51879b3ca7bd841 (127.3.163.66:38217)
I20260709 12:09:04.112973  4374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "01399950b586439498c3b6ef11d06c21"
I20260709 12:09:04.113457  4374 raft_consensus.cc:3055] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:04.113457  4447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417233ae3e1b4c2d971208c17ee59c6a" candidate_uuid: "4f62a11721854fcf94badff1251b5257" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb0840c3db8445b2a51879b3ca7bd841"
I20260709 12:09:04.113838  4374 raft_consensus.cc:740] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 01399950b586439498c3b6ef11d06c21, State: Running, Role: LEADER
I20260709 12:09:04.114086  4447 raft_consensus.cc:3060] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:04.114524  4374 consensus_queue.cc:260] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
I20260709 12:09:04.115589  4374 raft_consensus.cc:3060] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:04.120034  4447 raft_consensus.cc:2468] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 2.
I20260709 12:09:04.120950  4489 leader_election.cc:304] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f62a11721854fcf94badff1251b5257, cb0840c3db8445b2a51879b3ca7bd841; no voters: 
I20260709 12:09:04.120996  4374 raft_consensus.cc:2468] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f62a11721854fcf94badff1251b5257 in term 2.
I20260709 12:09:04.121603  4679 raft_consensus.cc:2804] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:04.121974  4679 raft_consensus.cc:697] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 2 LEADER]: Becoming Leader. State: Replica: 4f62a11721854fcf94badff1251b5257, State: Running, Role: LEADER
I20260709 12:09:04.122675  4679 consensus_queue.cc:237] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } }
W20260709 12:09:04.128885  4395 debug-util.cc:398] Leaking SignalData structure 0x7b08001d63c0 after lost signal to thread 3728
I20260709 12:09:04.128755  4269 catalog_manager.cc:5697] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 reported cstate change: term changed from 1 to 2, leader changed from 01399950b586439498c3b6ef11d06c21 (127.3.163.65) to 4f62a11721854fcf94badff1251b5257 (127.3.163.67). New cstate: current_term: 2 leader_uuid: "4f62a11721854fcf94badff1251b5257" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:04.129592  4395 debug-util.cc:398] Leaking SignalData structure 0x7b08001c7960 after lost signal to thread 4306
W20260709 12:09:04.130321  4395 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc9c0 after lost signal to thread 4398
W20260709 12:09:04.131111  4395 debug-util.cc:398] Leaking SignalData structure 0x7b08001ef580 after lost signal to thread 4473
W20260709 12:09:04.131965  4395 debug-util.cc:398] Leaking SignalData structure 0x7b08000da320 after lost signal to thread 4547
I20260709 12:09:04.268229  4522 raft_consensus.cc:1275] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Refusing update from remote peer cb0840c3db8445b2a51879b3ca7bd841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:04.269470  4712 consensus_queue.cc:1048] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:04.281024  4374 raft_consensus.cc:1275] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Refusing update from remote peer cb0840c3db8445b2a51879b3ca7bd841: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:04.287240  4712 consensus_queue.cc:1048] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:04.295653  4447 raft_consensus.cc:1275] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 FOLLOWER]: Refusing update from remote peer 4f62a11721854fcf94badff1251b5257: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:04.296859  4679 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:04.306862  4374 raft_consensus.cc:1275] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 5 FOLLOWER]: Refusing update from remote peer 4f62a11721854fcf94badff1251b5257: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:04.307950  4679 consensus_queue.cc:1048] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:04.450825  4374 raft_consensus.cc:1275] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 5 FOLLOWER]: Refusing update from remote peer cb0840c3db8445b2a51879b3ca7bd841: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:04.451845  4712 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:04.462942  4522 raft_consensus.cc:1275] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 5 FOLLOWER]: Refusing update from remote peer cb0840c3db8445b2a51879b3ca7bd841: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:04.464072  4667 consensus_queue.cc:1048] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f62a11721854fcf94badff1251b5257" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:04.549209  4447 raft_consensus.cc:1275] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Refusing update from remote peer 4f62a11721854fcf94badff1251b5257: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:04.550197  4679 consensus_queue.cc:1048] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb0840c3db8445b2a51879b3ca7bd841" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:04.558310  4374 raft_consensus.cc:1275] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Refusing update from remote peer 4f62a11721854fcf94badff1251b5257: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:04.560086  4679 consensus_queue.cc:1048] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [LEADER]: Connected to new peer: Peer: permanent_uuid: "01399950b586439498c3b6ef11d06c21" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 39823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:04.728926  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.735144  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:04.735478  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:05.736449  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.742954  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.743311  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.744300  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.749296  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.749658  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.750587  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.755838  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.756160  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.756875  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.762790  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.763119  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.763852  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.770005  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.770341  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.771148  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.777375  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.777730  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:11.778537  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:11.784837  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:11.785346  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.786238  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.791483  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.791855  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:13.818766  3725 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:13.819222  3725 tablet_server.cc:179] TabletServer@127.3.163.65:0 shutting down...
I20260709 12:09:13.842335  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:13.843035  3725 tablet_replica.cc:333] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.843675  3725 raft_consensus.cc:2243] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:13.844794  3725 raft_consensus.cc:2272] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.846976  3725 tablet_replica.cc:333] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.847477  3725 raft_consensus.cc:2243] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.847869  3725 raft_consensus.cc:2272] T 74532df54d9649808f88be3da78b17e1 P 01399950b586439498c3b6ef11d06c21 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.849537  3725 tablet_replica.cc:333] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.850005  3725 raft_consensus.cc:2243] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:13.850682  3725 raft_consensus.cc:2272] T 254b9aa0e24c4444a94d30405cb7981f P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.852278  3725 tablet_replica.cc:333] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.852741  3725 raft_consensus.cc:2243] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:13.853459  3725 raft_consensus.cc:2272] T fd53183db9744446b4147b4252b65c57 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.855027  3725 tablet_replica.cc:333] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.855466  3725 raft_consensus.cc:2243] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:13.856137  3725 raft_consensus.cc:2272] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.857688  3725 tablet_replica.cc:333] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.858122  3725 raft_consensus.cc:2243] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.858469  3725 raft_consensus.cc:2272] T 1266fed47429422b8f788e244d78e9c0 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.859941  3725 tablet_replica.cc:333] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.860387  3725 raft_consensus.cc:2243] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.860737  3725 raft_consensus.cc:2272] T 2534f71756354d4c87e0c0f07664b614 P 01399950b586439498c3b6ef11d06c21 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.862207  3725 tablet_replica.cc:333] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.862632  3725 raft_consensus.cc:2243] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.862993  3725 raft_consensus.cc:2272] T 417233ae3e1b4c2d971208c17ee59c6a P 01399950b586439498c3b6ef11d06c21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.864615  3725 tablet_replica.cc:333] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.865052  3725 raft_consensus.cc:2243] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.865406  3725 raft_consensus.cc:2272] T 252fe355c2b54223b970ec17edad15e7 P 01399950b586439498c3b6ef11d06c21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.866871  3725 tablet_replica.cc:333] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21: stopping tablet replica
I20260709 12:09:13.867269  3725 raft_consensus.cc:2243] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.867637  3725 raft_consensus.cc:2272] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 01399950b586439498c3b6ef11d06c21 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:13.874337  4489 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:09:13.877279  4489 consensus_peers.cc:597] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 -> Peer 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823): Couldn't send request to peer 01399950b586439498c3b6ef11d06c21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:13.891573  4415 consensus_peers.cc:597] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 -> Peer 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823): Couldn't send request to peer 01399950b586439498c3b6ef11d06c21. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:39823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:13.913604  3725 tablet_server.cc:196] TabletServer@127.3.163.65:0 shutdown complete.
W20260709 12:09:13.917102  4415 consensus_peers.cc:597] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 -> Peer 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823): Couldn't send request to peer 01399950b586439498c3b6ef11d06c21. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:39823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:13.931684  3725 tablet_server.cc:179] TabletServer@127.3.163.66:0 shutting down...
I20260709 12:09:13.955698  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:13.956241  3725 tablet_replica.cc:333] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.956851  3725 raft_consensus.cc:2243] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.957348  3725 raft_consensus.cc:2272] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.959041  3725 tablet_replica.cc:333] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.959535  3725 raft_consensus.cc:2243] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.959959  3725 raft_consensus.cc:2272] T 1266fed47429422b8f788e244d78e9c0 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.961547  3725 tablet_replica.cc:333] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.962021  3725 raft_consensus.cc:2243] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.962422  3725 raft_consensus.cc:2272] T b3b5187cc5c54a3da0ebd0fd2f48d54d P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.963898  3725 tablet_replica.cc:333] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.964390  3725 raft_consensus.cc:2243] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.964779  3725 raft_consensus.cc:2272] T 417233ae3e1b4c2d971208c17ee59c6a P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.966303  3725 tablet_replica.cc:333] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.966749  3725 raft_consensus.cc:2243] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.967133  3725 raft_consensus.cc:2272] T 2534f71756354d4c87e0c0f07664b614 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.968650  3725 tablet_replica.cc:333] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.969094  3725 raft_consensus.cc:2243] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.969453  3725 raft_consensus.cc:2272] T 254b9aa0e24c4444a94d30405cb7981f P cb0840c3db8445b2a51879b3ca7bd841 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.970922  3725 tablet_replica.cc:333] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.971360  3725 raft_consensus.cc:2243] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:13.971726  3725 raft_consensus.cc:2272] T fd53183db9744446b4147b4252b65c57 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.973281  3725 tablet_replica.cc:333] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.973728  3725 raft_consensus.cc:2243] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:13.974382  3725 raft_consensus.cc:2272] T 74532df54d9649808f88be3da78b17e1 P cb0840c3db8445b2a51879b3ca7bd841 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.975798  3725 tablet_replica.cc:333] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.976194  3725 raft_consensus.cc:2243] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:13.976902  3725 raft_consensus.cc:2272] T 252fe355c2b54223b970ec17edad15e7 P cb0840c3db8445b2a51879b3ca7bd841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:13.978307  3725 tablet_replica.cc:333] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841: stopping tablet replica
I20260709 12:09:13.978713  3725 raft_consensus.cc:2243] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:13.979357  3725 raft_consensus.cc:2272] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P cb0840c3db8445b2a51879b3ca7bd841 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.005712  3725 tablet_server.cc:196] TabletServer@127.3.163.66:0 shutdown complete.
W20260709 12:09:14.013800  4489 consensus_peers.cc:597] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 -> Peer 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823): Couldn't send request to peer 01399950b586439498c3b6ef11d06c21. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:39823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.024174  3725 tablet_server.cc:179] TabletServer@127.3.163.67:0 shutting down...
I20260709 12:09:14.045125  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:14.045651  3725 tablet_replica.cc:333] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.046337  3725 raft_consensus.cc:2243] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.046903  3725 raft_consensus.cc:2272] T 254b9aa0e24c4444a94d30405cb7981f P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.048949  3725 tablet_replica.cc:333] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.049440  3725 raft_consensus.cc:2243] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.049817  3725 raft_consensus.cc:2272] T fd53183db9744446b4147b4252b65c57 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:14.050084  4489 consensus_peers.cc:597] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 -> Peer 01399950b586439498c3b6ef11d06c21 (127.3.163.65:39823): Couldn't send request to peer 01399950b586439498c3b6ef11d06c21. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:39823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.051595  3725 tablet_replica.cc:333] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.052068  3725 raft_consensus.cc:2243] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.052459  3725 raft_consensus.cc:2272] T 09f0be5ae9f44ebf97a7b8c6c0673f65 P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.054061  3725 tablet_replica.cc:333] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.054529  3725 raft_consensus.cc:2243] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.054919  3725 raft_consensus.cc:2272] T b3b5187cc5c54a3da0ebd0fd2f48d54d P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.056406  3725 tablet_replica.cc:333] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.056876  3725 raft_consensus.cc:2243] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.057512  3725 raft_consensus.cc:2272] T 1266fed47429422b8f788e244d78e9c0 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.058987  3725 tablet_replica.cc:333] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.059405  3725 raft_consensus.cc:2243] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.059784  3725 raft_consensus.cc:2272] T 74532df54d9649808f88be3da78b17e1 P 4f62a11721854fcf94badff1251b5257 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.061295  3725 tablet_replica.cc:333] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.061738  3725 raft_consensus.cc:2243] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.062381  3725 raft_consensus.cc:2272] T 2534f71756354d4c87e0c0f07664b614 P 4f62a11721854fcf94badff1251b5257 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.063938  3725 tablet_replica.cc:333] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.064366  3725 raft_consensus.cc:2243] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.065047  3725 raft_consensus.cc:2272] T 417233ae3e1b4c2d971208c17ee59c6a P 4f62a11721854fcf94badff1251b5257 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.066582  3725 tablet_replica.cc:333] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.067003  3725 raft_consensus.cc:2243] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.067350  3725 raft_consensus.cc:2272] T 252fe355c2b54223b970ec17edad15e7 P 4f62a11721854fcf94badff1251b5257 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.068792  3725 tablet_replica.cc:333] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257: stopping tablet replica
I20260709 12:09:14.069253  3725 raft_consensus.cc:2243] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:14.069617  3725 raft_consensus.cc:2272] T 8ba6a7d8b5224e7d9e2a1321bb58da01 P 4f62a11721854fcf94badff1251b5257 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.110824  3725 tablet_server.cc:196] TabletServer@127.3.163.67:0 shutdown complete.
I20260709 12:09:14.127964  3725 master.cc:562] Master@127.3.163.126:44733 shutting down...
I20260709 12:09:14.147249  3725 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:14.147766  3725 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:14.148046  3725 tablet_replica.cc:333] T 00000000000000000000000000000000 P c88b9973b246481e95f83d69fc69d1fa: stopping tablet replica
I20260709 12:09:14.166592  3725 master.cc:584] Master@127.3.163.126:44733 shutdown complete.
01399950b586439498c3b6ef11d06c21  5
4f62a11721854fcf94badff1251b5257  1
cb0840c3db8445b2a51879b3ca7bd841  4
01399950b586439498c3b6ef11d06c21  3
4f62a11721854fcf94badff1251b5257  3
cb0840c3db8445b2a51879b3ca7bd841  4
01399950b586439498c3b6ef11d06c21  8
4f62a11721854fcf94badff1251b5257  1
cb0840c3db8445b2a51879b3ca7bd841  1
01399950b586439498c3b6ef11d06c21  4
4f62a11721854fcf94badff1251b5257  3
cb0840c3db8445b2a51879b3ca7bd841  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28543 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:14.202725  3725 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.163.126:34023
I20260709 12:09:14.203713  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:14.208724  4750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.209306  4749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.209671  4752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:14.210047  3725 server_base.cc:1061] running on GCE node
I20260709 12:09:14.210908  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:14.211078  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:14.211232  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598954211216 us; error 0 us; skew 500 ppm
I20260709 12:09:14.211728  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:14.214005  3725 webserver.cc:533] Webserver started at http://127.3.163.126:38437/ using document root <none> and password file <none>
I20260709 12:09:14.214447  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:14.214613  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:14.214862  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:14.215888  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/master-0-root/instance:
uuid: "ed86163b2a3e48d0879181588237bafe"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-s43n"
I20260709 12:09:14.219849  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.004s
I20260709 12:09:14.222779  4757 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.223376  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:09:14.223623  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/master-0-root
uuid: "ed86163b2a3e48d0879181588237bafe"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-s43n"
I20260709 12:09:14.223865  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:14.243527  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:14.244575  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:14.279497  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.126:34023
I20260709 12:09:14.279579  4808 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.126:34023 every 8 connection(s)
I20260709 12:09:14.283015  4809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.292303  4809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Bootstrap starting.
I20260709 12:09:14.296546  4809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.300307  4809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: No bootstrap required, opened a new log
I20260709 12:09:14.302278  4809 raft_consensus.cc:359] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed86163b2a3e48d0879181588237bafe" member_type: VOTER }
I20260709 12:09:14.302661  4809 raft_consensus.cc:385] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.302850  4809 raft_consensus.cc:740] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed86163b2a3e48d0879181588237bafe, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.303295  4809 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed86163b2a3e48d0879181588237bafe" member_type: VOTER }
I20260709 12:09:14.303700  4809 raft_consensus.cc:399] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:14.303877  4809 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:14.304100  4809 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.307694  4809 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed86163b2a3e48d0879181588237bafe" member_type: VOTER }
I20260709 12:09:14.308120  4809 leader_election.cc:304] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed86163b2a3e48d0879181588237bafe; no voters: 
I20260709 12:09:14.309068  4809 leader_election.cc:290] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:14.309371  4812 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.310498  4812 raft_consensus.cc:697] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 1 LEADER]: Becoming Leader. State: Replica: ed86163b2a3e48d0879181588237bafe, State: Running, Role: LEADER
I20260709 12:09:14.311221  4812 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed86163b2a3e48d0879181588237bafe" member_type: VOTER }
I20260709 12:09:14.311777  4809 sys_catalog.cc:565] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:14.315189  4813 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed86163b2a3e48d0879181588237bafe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed86163b2a3e48d0879181588237bafe" member_type: VOTER } }
I20260709 12:09:14.315701  4813 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:14.315776  4814 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed86163b2a3e48d0879181588237bafe. Latest consensus state: current_term: 1 leader_uuid: "ed86163b2a3e48d0879181588237bafe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed86163b2a3e48d0879181588237bafe" member_type: VOTER } }
I20260709 12:09:14.316274  4814 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:14.318064  4818 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:14.324975  4818 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:14.329619  3725 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:14.334108  4818 catalog_manager.cc:1383] Generated new cluster ID: 3dd4938bde434646a0eb3c8a77cae245
I20260709 12:09:14.334352  4818 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:14.354817  4818 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:14.355895  4818 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:14.369680  4818 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Generated new TSK 0
I20260709 12:09:14.370189  4818 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:14.395313  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:14.400491  4830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.401304  4831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.403260  4833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:14.403559  3725 server_base.cc:1061] running on GCE node
I20260709 12:09:14.404359  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:14.404536  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:14.404654  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598954404643 us; error 0 us; skew 500 ppm
I20260709 12:09:14.405138  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:14.407189  3725 webserver.cc:533] Webserver started at http://127.3.163.65:35015/ using document root <none> and password file <none>
I20260709 12:09:14.407666  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:14.407822  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:14.408033  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:14.409122  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/instance:
uuid: "4f3bf546572147c3abe4522189e86ce6"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-s43n"
I20260709 12:09:14.413261  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:09:14.416150  4838 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.416759  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:09:14.417042  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "4f3bf546572147c3abe4522189e86ce6"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-s43n"
I20260709 12:09:14.417299  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:14.453269  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:14.454329  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:14.455626  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:14.457754  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:14.457933  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.458146  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:14.458304  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.494622  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:38799
I20260709 12:09:14.494724  4900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:38799 every 8 connection(s)
I20260709 12:09:14.499146  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:14.505705  4905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.506742  4906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.508977  4908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:14.509339  3725 server_base.cc:1061] running on GCE node
I20260709 12:09:14.510236  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:14.510416  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:14.510573  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598954510555 us; error 0 us; skew 500 ppm
I20260709 12:09:14.511041  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:14.513007  3725 webserver.cc:533] Webserver started at http://127.3.163.66:36511/ using document root <none> and password file <none>
I20260709 12:09:14.513428  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:14.513592  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:14.513813  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:14.514810  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/instance:
uuid: "8de40fe2bb814adcbe13958669063dc9"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-s43n"
I20260709 12:09:14.517591  4901 heartbeater.cc:344] Connected to a master server at 127.3.163.126:34023
I20260709 12:09:14.517899  4901 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:14.518527  4901 heartbeater.cc:507] Master 127.3.163.126:34023 requested a full tablet report, sending...
I20260709 12:09:14.519680  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:09:14.520578  4774 ts_manager.cc:194] Registered new tserver with Master: 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:09:14.522181  4774 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47380
I20260709 12:09:14.523028  4913 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.523804  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:09:14.524065  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root
uuid: "8de40fe2bb814adcbe13958669063dc9"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-s43n"
I20260709 12:09:14.524380  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:14.537810  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:14.538837  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:14.540112  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:14.542126  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:14.542305  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.542506  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:14.542649  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.578291  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.66:43473
I20260709 12:09:14.578382  4975 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.66:43473 every 8 connection(s)
I20260709 12:09:14.582476  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:14.589253  4979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.589550  4980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:14.591081  4982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:14.594022  4976 heartbeater.cc:344] Connected to a master server at 127.3.163.126:34023
I20260709 12:09:14.594336  4976 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:14.594982  4976 heartbeater.cc:507] Master 127.3.163.126:34023 requested a full tablet report, sending...
I20260709 12:09:14.596839  3725 server_base.cc:1061] running on GCE node
I20260709 12:09:14.596937  4774 ts_manager.cc:194] Registered new tserver with Master: 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:14.597581  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:14.597781  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:14.597947  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598954597929 us; error 0 us; skew 500 ppm
I20260709 12:09:14.598384  4774 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47384
I20260709 12:09:14.598464  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:14.600663  3725 webserver.cc:533] Webserver started at http://127.3.163.67:46595/ using document root <none> and password file <none>
I20260709 12:09:14.601117  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:14.601269  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:14.601456  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:14.602447  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/instance:
uuid: "baa50eb5ed704004b7f391934a59d010"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-s43n"
I20260709 12:09:14.606312  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:09:14.609241  4987 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.609885  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:09:14.610132  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root
uuid: "baa50eb5ed704004b7f391934a59d010"
format_stamp: "Formatted at 2026-07-09 12:09:14 on dist-test-slave-s43n"
I20260709 12:09:14.610373  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:14.628409  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:14.629451  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:14.630707  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:14.632642  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:14.632835  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.633045  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:14.633200  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:14.668838  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.67:40575
I20260709 12:09:14.668923  5049 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.67:40575 every 8 connection(s)
I20260709 12:09:14.680716  5050 heartbeater.cc:344] Connected to a master server at 127.3.163.126:34023
I20260709 12:09:14.681046  5050 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:14.681669  5050 heartbeater.cc:507] Master 127.3.163.126:34023 requested a full tablet report, sending...
I20260709 12:09:14.683320  4774 ts_manager.cc:194] Registered new tserver with Master: baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:14.683766  3725 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012043065s
I20260709 12:09:14.684932  4774 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47400
I20260709 12:09:14.706595  4774 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47412:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:14.712361  4774 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:14.891156  5015 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0691894555408ab3e2a8dedaa21303 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:14.892501  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0691894555408ab3e2a8dedaa21303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.893818  5014 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa1ee1e05941b1a81b5aa296c1867c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:14.895093  5014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa1ee1e05941b1a81b5aa296c1867c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.898312  5013 tablet_service.cc:1511] Processing CreateTablet for tablet 2004e797943d48d0ab1d7ed726902783 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:14.899542  5013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2004e797943d48d0ab1d7ed726902783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.900887  5012 tablet_service.cc:1511] Processing CreateTablet for tablet 008a4803b16b4c108fa5d52753a9f9a3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:14.901328  5011 tablet_service.cc:1511] Processing CreateTablet for tablet acd2c2ca421a4b8e9629cd5b12e89e72 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:14.902110  5012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008a4803b16b4c108fa5d52753a9f9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.902698  5011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd2c2ca421a4b8e9629cd5b12e89e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.904891  5010 tablet_service.cc:1511] Processing CreateTablet for tablet 968e3c47814549fe8cf64abe52c00d29 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:14.906077  5010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968e3c47814549fe8cf64abe52c00d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.909471  5009 tablet_service.cc:1511] Processing CreateTablet for tablet 694e27a66efd449e81ce6297d4201cc3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:14.910643  5009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694e27a66efd449e81ce6297d4201cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.913928  5008 tablet_service.cc:1511] Processing CreateTablet for tablet 2f74ad2f73ca4aeda444924811dca81b (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:14.915107  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f74ad2f73ca4aeda444924811dca81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.921885  4940 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa1ee1e05941b1a81b5aa296c1867c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:14.923075  4940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa1ee1e05941b1a81b5aa296c1867c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.922984  4936 tablet_service.cc:1511] Processing CreateTablet for tablet 968e3c47814549fe8cf64abe52c00d29 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:14.924175  4936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968e3c47814549fe8cf64abe52c00d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.925285  4939 tablet_service.cc:1511] Processing CreateTablet for tablet 2004e797943d48d0ab1d7ed726902783 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:14.926476  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2004e797943d48d0ab1d7ed726902783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.929785  4937 tablet_service.cc:1511] Processing CreateTablet for tablet acd2c2ca421a4b8e9629cd5b12e89e72 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:14.930949  4937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd2c2ca421a4b8e9629cd5b12e89e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.933753  4938 tablet_service.cc:1511] Processing CreateTablet for tablet 008a4803b16b4c108fa5d52753a9f9a3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:14.934324  4935 tablet_service.cc:1511] Processing CreateTablet for tablet 694e27a66efd449e81ce6297d4201cc3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:14.934957  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008a4803b16b4c108fa5d52753a9f9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.935506  4935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694e27a66efd449e81ce6297d4201cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.920521  4941 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0691894555408ab3e2a8dedaa21303 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:14.937660  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0691894555408ab3e2a8dedaa21303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.943079  4866 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0691894555408ab3e2a8dedaa21303 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:14.944279  4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0691894555408ab3e2a8dedaa21303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.944792  4859 tablet_service.cc:1511] Processing CreateTablet for tablet 2f74ad2f73ca4aeda444924811dca81b (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:14.945998  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f74ad2f73ca4aeda444924811dca81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.947779  4860 tablet_service.cc:1511] Processing CreateTablet for tablet 694e27a66efd449e81ce6297d4201cc3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:14.948232  5007 tablet_service.cc:1511] Processing CreateTablet for tablet 15263062183540bdbd45628b3342a3d5 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:14.948994  4860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694e27a66efd449e81ce6297d4201cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.977031  4863 tablet_service.cc:1511] Processing CreateTablet for tablet 008a4803b16b4c108fa5d52753a9f9a3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:14.979225  4857 tablet_service.cc:1511] Processing CreateTablet for tablet ee4c2e710f7a41958315091dfd907d8d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:14.981354  4865 tablet_service.cc:1511] Processing CreateTablet for tablet 34fa1ee1e05941b1a81b5aa296c1867c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:14.983577  4861 tablet_service.cc:1511] Processing CreateTablet for tablet 968e3c47814549fe8cf64abe52c00d29 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:14.977541  5007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15263062183540bdbd45628b3342a3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.985687  4864 tablet_service.cc:1511] Processing CreateTablet for tablet 2004e797943d48d0ab1d7ed726902783 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:14.985997  5006 tablet_service.cc:1511] Processing CreateTablet for tablet ee4c2e710f7a41958315091dfd907d8d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:14.998014  5006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4c2e710f7a41958315091dfd907d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.977039  4858 tablet_service.cc:1511] Processing CreateTablet for tablet 15263062183540bdbd45628b3342a3d5 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:14.988571  4857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4c2e710f7a41958315091dfd907d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:14.987731  4862 tablet_service.cc:1511] Processing CreateTablet for tablet acd2c2ca421a4b8e9629cd5b12e89e72 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:15.009099  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd2c2ca421a4b8e9629cd5b12e89e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.011898  4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34fa1ee1e05941b1a81b5aa296c1867c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.017138  4861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968e3c47814549fe8cf64abe52c00d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.017367  4934 tablet_service.cc:1511] Processing CreateTablet for tablet 2f74ad2f73ca4aeda444924811dca81b (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:15.018532  4934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f74ad2f73ca4aeda444924811dca81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.021471  4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008a4803b16b4c108fa5d52753a9f9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.021900  4933 tablet_service.cc:1511] Processing CreateTablet for tablet 15263062183540bdbd45628b3342a3d5 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:15.023123  4933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15263062183540bdbd45628b3342a3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.024083  4864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2004e797943d48d0ab1d7ed726902783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.025873  4932 tablet_service.cc:1511] Processing CreateTablet for tablet ee4c2e710f7a41958315091dfd907d8d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:15.027093  4932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4c2e710f7a41958315091dfd907d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.029564  4858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15263062183540bdbd45628b3342a3d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.055423  4936 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7b07518a00402aaa235a0d34263b1f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:15.058511  4939 tablet_service.cc:1511] Processing CreateTablet for tablet 950c0e5da47a49abb359c63b8483f487 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:15.056610  4936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7b07518a00402aaa235a0d34263b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.056519  5011 tablet_service.cc:1511] Processing CreateTablet for tablet 7d62e31abaf34e25ad480865e4285e64 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:15.061859  5011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d62e31abaf34e25ad480865e4285e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.063140  4933 tablet_service.cc:1511] Processing CreateTablet for tablet 811353fb6b174f3e96608844f05794de (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:15.070465  5067 tablet_bootstrap.cc:492] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:15.071156  5014 tablet_service.cc:1511] Processing CreateTablet for tablet fedd910b0097474d987abca8337e4e48 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:15.072296  5014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedd910b0097474d987abca8337e4e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.073747  5015 tablet_service.cc:1511] Processing CreateTablet for tablet b4428def03fb45c99d3538acc2628494 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:15.074136  5008 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7b07518a00402aaa235a0d34263b1f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:15.074856  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4428def03fb45c99d3538acc2628494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.078109  4866 tablet_service.cc:1511] Processing CreateTablet for tablet fedd910b0097474d987abca8337e4e48 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:15.079659  4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedd910b0097474d987abca8337e4e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.052733  4937 tablet_service.cc:1511] Processing CreateTablet for tablet b4428def03fb45c99d3538acc2628494 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:15.081853  4940 tablet_service.cc:1511] Processing CreateTablet for tablet 4be803cbf3854da89561de85968acd64 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:15.089632  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950c0e5da47a49abb359c63b8483f487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.092694  5066 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:15.086262  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7b07518a00402aaa235a0d34263b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.096112  4859 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7b07518a00402aaa235a0d34263b1f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:15.097333  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7b07518a00402aaa235a0d34263b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.099090  5007 tablet_service.cc:1511] Processing CreateTablet for tablet 7d89e729329948059879ed6f44a07690 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:15.080766  5006 tablet_service.cc:1511] Processing CreateTablet for tablet 950c0e5da47a49abb359c63b8483f487 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:15.105165  5006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950c0e5da47a49abb359c63b8483f487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.108024  5007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d89e729329948059879ed6f44a07690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.111650  5013 tablet_service.cc:1511] Processing CreateTablet for tablet 22be31682d204ff18c81f1e0ac60a00a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:15.116313  5067 tablet_bootstrap.cc:654] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.118517  4938 tablet_service.cc:1511] Processing CreateTablet for tablet 22be31682d204ff18c81f1e0ac60a00a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:15.112385  5010 tablet_service.cc:1511] Processing CreateTablet for tablet 4be803cbf3854da89561de85968acd64 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:15.117627  5009 tablet_service.cc:1511] Processing CreateTablet for tablet 811353fb6b174f3e96608844f05794de (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:15.120708  5065 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:15.123884  5066 tablet_bootstrap.cc:654] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.148350  4864 tablet_service.cc:1511] Processing CreateTablet for tablet 22be31682d204ff18c81f1e0ac60a00a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:15.119417  5013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22be31682d204ff18c81f1e0ac60a00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.157990  5010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be803cbf3854da89561de85968acd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.161083  5009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811353fb6b174f3e96608844f05794de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.161129  5008 tablet_service.cc:1511] Processing CreateTablet for tablet e66df43bc3234fd5b769c5dc5afc1096 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:15.162407  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66df43bc3234fd5b769c5dc5afc1096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.110028  4940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be803cbf3854da89561de85968acd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.131843  4932 tablet_service.cc:1511] Processing CreateTablet for tablet 7d62e31abaf34e25ad480865e4285e64 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:15.165997  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22be31682d204ff18c81f1e0ac60a00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.166563  4932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d62e31abaf34e25ad480865e4285e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.167387  5011 tablet_service.cc:1511] Processing CreateTablet for tablet af1ac4f5e2f747228d3574209d49e46f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:15.168530  5011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1ac4f5e2f747228d3574209d49e46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.172225  4937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4428def03fb45c99d3538acc2628494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.156374  4860 tablet_service.cc:1511] Processing CreateTablet for tablet b4428def03fb45c99d3538acc2628494 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:15.173945  4860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4428def03fb45c99d3538acc2628494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.178239  4933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811353fb6b174f3e96608844f05794de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.181190  5015 tablet_service.cc:1511] Processing CreateTablet for tablet 1f8b0320f7e94e2688e2a1d2005746ef (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:15.182351  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f8b0320f7e94e2688e2a1d2005746ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.188189  4864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22be31682d204ff18c81f1e0ac60a00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.190193  5065 tablet_bootstrap.cc:654] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.143121  4857 tablet_service.cc:1511] Processing CreateTablet for tablet 4be803cbf3854da89561de85968acd64 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:15.214239  4857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be803cbf3854da89561de85968acd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.082352  4941 tablet_service.cc:1511] Processing CreateTablet for tablet fedd910b0097474d987abca8337e4e48 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:15.145583  4861 tablet_service.cc:1511] Processing CreateTablet for tablet 7d89e729329948059879ed6f44a07690 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:15.216208  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedd910b0097474d987abca8337e4e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.216342  4861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d89e729329948059879ed6f44a07690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.125460  5012 tablet_service.cc:1511] Processing CreateTablet for tablet b33c26da92464c7896c3c4d2243075e8 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:15.150702  4863 tablet_service.cc:1511] Processing CreateTablet for tablet 7d62e31abaf34e25ad480865e4285e64 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:15.218540  4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d62e31abaf34e25ad480865e4285e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.153036  4936 tablet_service.cc:1511] Processing CreateTablet for tablet b33c26da92464c7896c3c4d2243075e8 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:15.220547  4936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33c26da92464c7896c3c4d2243075e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.128108  4862 tablet_service.cc:1511] Processing CreateTablet for tablet 950c0e5da47a49abb359c63b8483f487 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:15.111465  4935 tablet_service.cc:1511] Processing CreateTablet for tablet 7d89e729329948059879ed6f44a07690 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:15.221642  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950c0e5da47a49abb359c63b8483f487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.180683  5006 tablet_service.cc:1511] Processing CreateTablet for tablet 97f05b369a3a4067afed9c87ba39f448 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:15.222700  5006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f05b369a3a4067afed9c87ba39f448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.197824  4934 tablet_service.cc:1511] Processing CreateTablet for tablet e66df43bc3234fd5b769c5dc5afc1096 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:15.132010  4859 tablet_service.cc:1511] Processing CreateTablet for tablet 811353fb6b174f3e96608844f05794de (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:15.194499  4858 tablet_service.cc:1511] Processing CreateTablet for tablet b33c26da92464c7896c3c4d2243075e8 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:15.201009  4865 tablet_service.cc:1511] Processing CreateTablet for tablet e66df43bc3234fd5b769c5dc5afc1096 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:15.202087  4866 tablet_service.cc:1511] Processing CreateTablet for tablet af1ac4f5e2f747228d3574209d49e46f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:15.221679  4935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d89e729329948059879ed6f44a07690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.194547  5067 tablet_bootstrap.cc:492] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:15.225335  5067 ts_tablet_manager.cc:1403] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.155s	user 0.003s	sys 0.008s
I20260709 12:09:15.225308  4858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33c26da92464c7896c3c4d2243075e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.226455  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811353fb6b174f3e96608844f05794de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.227149  4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1ac4f5e2f747228d3574209d49e46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.227653  4934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66df43bc3234fd5b769c5dc5afc1096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.228070  5012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33c26da92464c7896c3c4d2243075e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.232512  4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66df43bc3234fd5b769c5dc5afc1096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.283509  5007 tablet_service.cc:1511] Processing CreateTablet for tablet da27e3db08424ba7a8f3d771f12de9a7 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:15.284796  5007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da27e3db08424ba7a8f3d771f12de9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.286466  5066 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:15.286888  5066 ts_tablet_manager.cc:1403] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.195s	user 0.016s	sys 0.000s
I20260709 12:09:15.297765  5067 raft_consensus.cc:359] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:15.298503  5067 raft_consensus.cc:385] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.298797  5067 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.299602  5067 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:15.301849  4860 tablet_service.cc:1511] Processing CreateTablet for tablet 97f05b369a3a4067afed9c87ba39f448 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:15.303035  4860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f05b369a3a4067afed9c87ba39f448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.320014  4901 heartbeater.cc:499] Master 127.3.163.126:34023 was elected leader, sending a full tablet report...
W20260709 12:09:15.325781  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:15.339710  4934 tablet_service.cc:1511] Processing CreateTablet for tablet 97f05b369a3a4067afed9c87ba39f448 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:15.340978  4934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f05b369a3a4067afed9c87ba39f448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.345278  4932 tablet_service.cc:1511] Processing CreateTablet for tablet af1ac4f5e2f747228d3574209d49e46f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:15.346110  5066 raft_consensus.cc:359] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.346803  5066 raft_consensus.cc:385] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.346469  4935 tablet_service.cc:1511] Processing CreateTablet for tablet 1f8b0320f7e94e2688e2a1d2005746ef (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:15.347107  5066 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.347618  5008 tablet_service.cc:1511] Processing CreateTablet for tablet ecf61812afc64320acafb43ddc29f4a2 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:15.348747  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf61812afc64320acafb43ddc29f4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.348608  4865 tablet_service.cc:1511] Processing CreateTablet for tablet 1f8b0320f7e94e2688e2a1d2005746ef (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:15.349598  5065 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:15.349828  4865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f8b0320f7e94e2688e2a1d2005746ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.350041  5065 ts_tablet_manager.cc:1403] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.230s	user 0.010s	sys 0.006s
I20260709 12:09:15.346441  4932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1ac4f5e2f747228d3574209d49e46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.352782  5065 raft_consensus.cc:359] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.365136  5065 raft_consensus.cc:385] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.365422  5065 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.366672  4859 tablet_service.cc:1511] Processing CreateTablet for tablet ecf61812afc64320acafb43ddc29f4a2 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:15.368150  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf61812afc64320acafb43ddc29f4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.368649  5066 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.359701  5067 ts_tablet_manager.cc:1434] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.133s	user 0.008s	sys 0.004s
I20260709 12:09:15.366142  4866 tablet_service.cc:1511] Processing CreateTablet for tablet da27e3db08424ba7a8f3d771f12de9a7 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:15.373706  5065 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.374105  5067 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:15.374873  4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da27e3db08424ba7a8f3d771f12de9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.356088  4934 tablet_service.cc:1511] Processing CreateTablet for tablet ecf61812afc64320acafb43ddc29f4a2 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:15.353834  4936 tablet_service.cc:1511] Processing CreateTablet for tablet da27e3db08424ba7a8f3d771f12de9a7 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:15.378527  4935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f8b0320f7e94e2688e2a1d2005746ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.379096  4934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf61812afc64320acafb43ddc29f4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.385039  4936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da27e3db08424ba7a8f3d771f12de9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.384176  5067 tablet_bootstrap.cc:654] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.392557  5066 ts_tablet_manager.cc:1434] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.105s	user 0.017s	sys 0.000s
I20260709 12:09:15.393227  5050 heartbeater.cc:499] Master 127.3.163.126:34023 was elected leader, sending a full tablet report...
I20260709 12:09:15.399192  5066 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:15.405887  5065 ts_tablet_manager.cc:1434] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.056s	user 0.011s	sys 0.006s
I20260709 12:09:15.514585  5066 tablet_bootstrap.cc:700] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Time spent opening tablet: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:09:15.515513  5065 tablet_bootstrap.cc:492] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:15.486783  4976 heartbeater.cc:499] Master 127.3.163.126:34023 was elected leader, sending a full tablet report...
W20260709 12:09:15.499532  4902 tablet.cc:2406] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:15.521621  5066 tablet_bootstrap.cc:654] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.528151  5065 tablet_bootstrap.cc:654] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.537007  5070 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.537793  5070 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:15.543072  5074 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.543534  5074 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:15.550344  4758 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 128546us
I20260709 12:09:15.555702  5070 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:15.556610  5074 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:15.568306  5067 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:15.568948  5067 ts_tablet_manager.cc:1403] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.195s	user 0.019s	sys 0.001s
I20260709 12:09:15.572533  5067 raft_consensus.cc:359] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.573272  5067 raft_consensus.cc:385] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.573597  5067 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.574303  5067 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.576495  5067 ts_tablet_manager.cc:1434] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 12:09:15.604112  4759 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 155903us
I20260709 12:09:15.610967  5067 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:15.630302  5066 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:15.630909  5066 ts_tablet_manager.cc:1403] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.232s	user 0.015s	sys 0.014s
I20260709 12:09:15.633530  5067 tablet_bootstrap.cc:654] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.636683  5009 tablet_service.cc:1511] Processing CreateTablet for tablet 42e9d7673d8444ae8097208f1095114d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:15.639148  4935 tablet_service.cc:1511] Processing CreateTablet for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:15.639750  5009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e9d7673d8444ae8097208f1095114d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.640615  4935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.633793  5066 raft_consensus.cc:359] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.644923  5065 tablet_bootstrap.cc:492] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:15.645385  5065 ts_tablet_manager.cc:1403] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.130s	user 0.021s	sys 0.024s
I20260709 12:09:15.645335  5008 tablet_service.cc:1511] Processing CreateTablet for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:15.646720  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.648339  5065 raft_consensus.cc:359] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:15.649026  5065 raft_consensus.cc:385] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.649318  5065 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.644106  5066 raft_consensus.cc:385] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.650188  5066 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.650940  5066 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.651306  5007 tablet_service.cc:1511] Processing CreateTablet for tablet b3b5f40fd4fa49619588c424099a9a3b (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:15.652568  5007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b5f40fd4fa49619588c424099a9a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.653119  5065 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:15.655143  5065 ts_tablet_manager.cc:1434] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:09:15.656028  5065 tablet_bootstrap.cc:492] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:15.659395  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:15.661351  4938 tablet_service.cc:1511] Processing CreateTablet for tablet 42e9d7673d8444ae8097208f1095114d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:15.662495  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e9d7673d8444ae8097208f1095114d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.664574  5015 tablet_service.cc:1511] Processing CreateTablet for tablet c4bd638d42a041ffa8deaf7135228fd6 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:15.665778  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4bd638d42a041ffa8deaf7135228fd6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:15.667069  4915 leader_election.cc:343] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.667670  4939 tablet_service.cc:1511] Processing CreateTablet for tablet b3b5f40fd4fa49619588c424099a9a3b (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:15.668790  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b5f40fd4fa49619588c424099a9a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.670485  5066 ts_tablet_manager.cc:1434] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:09:15.671074  4936 tablet_service.cc:1511] Processing CreateTablet for tablet c4bd638d42a041ffa8deaf7135228fd6 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:15.672245  4936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4bd638d42a041ffa8deaf7135228fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.674443  4862 tablet_service.cc:1511] Processing CreateTablet for tablet b3b5f40fd4fa49619588c424099a9a3b (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:15.675009  4859 tablet_service.cc:1511] Processing CreateTablet for tablet cd5508a3d98b403c8be99338c7e12502 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:15.675642  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b5f40fd4fa49619588c424099a9a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.676218  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5508a3d98b403c8be99338c7e12502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.677574  4857 tablet_service.cc:1511] Processing CreateTablet for tablet c4bd638d42a041ffa8deaf7135228fd6 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:15.678694  4857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4bd638d42a041ffa8deaf7135228fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.686806  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:15.687229  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:15.687455  4866 tablet_service.cc:1511] Processing CreateTablet for tablet 42e9d7673d8444ae8097208f1095114d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:15.689826  4863 tablet_service.cc:1511] Processing CreateTablet for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:15.690769  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:15.691038  5066 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:15.691460  4951 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:15.693022  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:15.693874  5070 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.694200  5070 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.694507  5070 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.688702  4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e9d7673d8444ae8097208f1095114d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.700913  5070 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:15.703871  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:15.704380  4951 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.705089  4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.710623  5070 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:15.711688  5065 tablet_bootstrap.cc:654] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.711943  4951 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
W20260709 12:09:15.712723  4917 leader_election.cc:343] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.713079  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:15.713186  4917 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:15.713987  5074 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.714767  5070 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.716200  4932 tablet_service.cc:1511] Processing CreateTablet for tablet cd5508a3d98b403c8be99338c7e12502 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:15.717447  4932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5508a3d98b403c8be99338c7e12502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.718926  5070 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:15.719908  5070 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:15.721115  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:15.723009  4840 leader_election.cc:343] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:15.723897  4840 leader_election.cc:343] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.726174  5067 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:15.726691  5067 ts_tablet_manager.cc:1403] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.149s	user 0.002s	sys 0.011s
I20260709 12:09:15.729542  5067 raft_consensus.cc:359] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.730181  5067 raft_consensus.cc:385] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.730446  5067 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.730650  5066 tablet_bootstrap.cc:654] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.738031  4941 tablet_service.cc:1511] Processing CreateTablet for tablet 88f88700ce294dc2bbfa0b1c51666ce7 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:15.738932  5067 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.741426  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f88700ce294dc2bbfa0b1c51666ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.745780  5009 tablet_service.cc:1511] Processing CreateTablet for tablet cd5508a3d98b403c8be99338c7e12502 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:15.746934  5009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5508a3d98b403c8be99338c7e12502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.750293  5067 ts_tablet_manager.cc:1434] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.002s
I20260709 12:09:15.751287  5067 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:15.753747  4859 tablet_service.cc:1511] Processing CreateTablet for tablet 88f88700ce294dc2bbfa0b1c51666ce7 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:15.754135  5013 tablet_service.cc:1511] Processing CreateTablet for tablet 88f88700ce294dc2bbfa0b1c51666ce7 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:15.754899  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f88700ce294dc2bbfa0b1c51666ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.755272  5013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f88700ce294dc2bbfa0b1c51666ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.759167  4772 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:15.760385  5066 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:15.760854  5066 ts_tablet_manager.cc:1403] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.000s
I20260709 12:09:15.762683  4857 tablet_service.cc:1511] Processing CreateTablet for tablet 9023c271389540b8a7b43d63718a4c7a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:15.767228  5015 tablet_service.cc:1511] Processing CreateTablet for tablet 9023c271389540b8a7b43d63718a4c7a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:15.768416  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9023c271389540b8a7b43d63718a4c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.768229  4862 tablet_service.cc:1511] Processing CreateTablet for tablet 737cb737da3146798e07c2c2026eebcc (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:15.768255  4857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9023c271389540b8a7b43d63718a4c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.770262  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737cb737da3146798e07c2c2026eebcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.770727  4939 tablet_service.cc:1511] Processing CreateTablet for tablet 9023c271389540b8a7b43d63718a4c7a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:15.773926  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9023c271389540b8a7b43d63718a4c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.785322  5065 tablet_bootstrap.cc:492] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:15.785786  5065 ts_tablet_manager.cc:1403] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.000s
I20260709 12:09:15.763752  5066 raft_consensus.cc:359] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.791108  5066 raft_consensus.cc:385] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.791414  5066 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.788655  5065 raft_consensus.cc:359] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.792637  5065 raft_consensus.cc:385] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.792941  5065 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.793862  5066 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.794953  5065 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.795930  5067 tablet_bootstrap.cc:654] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.798342  5066 ts_tablet_manager.cc:1434] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 12:09:15.798900  5013 tablet_service.cc:1511] Processing CreateTablet for tablet 737cb737da3146798e07c2c2026eebcc (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:15.800081  5013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737cb737da3146798e07c2c2026eebcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.802277  4938 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4699787549416cb829da40d250e0cf (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:15.803439  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4699787549416cb829da40d250e0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.805735  4857 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4699787549416cb829da40d250e0cf (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:15.806888  4857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4699787549416cb829da40d250e0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.807789  4941 tablet_service.cc:1511] Processing CreateTablet for tablet 737cb737da3146798e07c2c2026eebcc (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:15.813184  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737cb737da3146798e07c2c2026eebcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.813897  5065 ts_tablet_manager.cc:1434] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:09:15.799396  5066 tablet_bootstrap.cc:492] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:15.815687  5073 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.820392  5073 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.821700  5008 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4699787549416cb829da40d250e0cf (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:15.822845  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4699787549416cb829da40d250e0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.823838  4863 tablet_service.cc:1511] Processing CreateTablet for tablet c480da15ff054400bdd09744d494717c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:15.825322  4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c480da15ff054400bdd09744d494717c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.828934  5073 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:15.839051  5074 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.839529  5074 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.841591  5074 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:15.842557  4939 tablet_service.cc:1511] Processing CreateTablet for tablet c480da15ff054400bdd09744d494717c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:15.843477  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:15.844030  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c480da15ff054400bdd09744d494717c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:15.844908  4917 leader_election.cc:343] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.845145  5065 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:15.846799  4866 tablet_service.cc:1511] Processing CreateTablet for tablet 66c02d3930da4dfba1f61356e4562709 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:15.847325  4932 tablet_service.cc:1511] Processing CreateTablet for tablet 66c02d3930da4dfba1f61356e4562709 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:15.848028  4866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c02d3930da4dfba1f61356e4562709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.848534  4932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c02d3930da4dfba1f61356e4562709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.878938  5067 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:15.879628  5067 ts_tablet_manager.cc:1403] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.002s
I20260709 12:09:15.882381  5067 raft_consensus.cc:359] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.883036  5067 raft_consensus.cc:385] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.883360  5067 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.883181  4936 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4e29d1896a40e18a1e129dfc2a01c4 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:15.884377  4936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4e29d1896a40e18a1e129dfc2a01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.884157  5067 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.886234  5067 ts_tablet_manager.cc:1434] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:15.889086  4862 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4e29d1896a40e18a1e129dfc2a01c4 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:15.890219  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4e29d1896a40e18a1e129dfc2a01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.896005  5067 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:15.896692  4859 tablet_service.cc:1511] Processing CreateTablet for tablet c9425cbf78b044ef8b0190a6eb0be1b3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:15.900100  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9425cbf78b044ef8b0190a6eb0be1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.900636  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:15.902236  4988 leader_election.cc:343] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.904343  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:15.898005  4938 tablet_service.cc:1511] Processing CreateTablet for tablet c9425cbf78b044ef8b0190a6eb0be1b3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:15.904785  5067 tablet_bootstrap.cc:654] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.906282  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9425cbf78b044ef8b0190a6eb0be1b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:15.908453  4915 leader_election.cc:343] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.908910  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:15.909895  5074 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.911697  5008 tablet_service.cc:1511] Processing CreateTablet for tablet c480da15ff054400bdd09744d494717c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:15.912931  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c480da15ff054400bdd09744d494717c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.913252  5013 tablet_service.cc:1511] Processing CreateTablet for tablet 66c02d3930da4dfba1f61356e4562709 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:15.914347  5013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c02d3930da4dfba1f61356e4562709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.918437  5065 tablet_bootstrap.cc:654] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.922591  5009 tablet_service.cc:1511] Processing CreateTablet for tablet 6f4e29d1896a40e18a1e129dfc2a01c4 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:15.923714  5009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4e29d1896a40e18a1e129dfc2a01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.927975  4863 tablet_service.cc:1511] Processing CreateTablet for tablet 83dd0599104f4ef0a0f49401f0f0687c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:15.929142  4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dd0599104f4ef0a0f49401f0f0687c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.928892  4935 tablet_service.cc:1511] Processing CreateTablet for tablet 83dd0599104f4ef0a0f49401f0f0687c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:15.931216  5015 tablet_service.cc:1511] Processing CreateTablet for tablet c9425cbf78b044ef8b0190a6eb0be1b3 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:15.932399  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9425cbf78b044ef8b0190a6eb0be1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.933389  4935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dd0599104f4ef0a0f49401f0f0687c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.936825  5070 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.937289  5070 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.939337  5070 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:15.939800  5073 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.940223  5073 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.940707  5007 tablet_service.cc:1511] Processing CreateTablet for tablet 83dd0599104f4ef0a0f49401f0f0687c (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:15.941931  5007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dd0599104f4ef0a0f49401f0f0687c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.942140  5073 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:15.943563  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:15.946574  4988 leader_election.cc:343] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.947187  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:15.947969  5066 tablet_bootstrap.cc:654] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.948572  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:15.949236  4875 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:15.950193  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:15.952908  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:15.953539  4951 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:15.954775  4839 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:15.954999  4934 tablet_service.cc:1511] Processing CreateTablet for tablet 3da8832a07224abb9a1f8815f3dcd745 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:15.955734  5087 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.956089  5087 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.956236  4934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da8832a07224abb9a1f8815f3dcd745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.956409  5087 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:15.958520  4840 leader_election.cc:343] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.960458  4857 tablet_service.cc:1511] Processing CreateTablet for tablet 3da8832a07224abb9a1f8815f3dcd745 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:15.961583  4857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da8832a07224abb9a1f8815f3dcd745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.964206  5070 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.964619  5070 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.967051  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:15.968245  4839 leader_election.cc:343] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.969148  5070 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:15.970547  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:15.971109  5025 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:15.972213  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:15.975489  4861 tablet_service.cc:1511] Processing CreateTablet for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:15.976617  4861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.979949  5087 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:15.983585  4860 tablet_service.cc:1511] Processing CreateTablet for tablet 49d7b189f495402dbbaadba00a5cebb8 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:15.984737  4860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d7b189f495402dbbaadba00a5cebb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.990293  4936 tablet_service.cc:1511] Processing CreateTablet for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:15.991422  4936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.993541  4939 tablet_service.cc:1511] Processing CreateTablet for tablet 49d7b189f495402dbbaadba00a5cebb8 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:15.994709  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d7b189f495402dbbaadba00a5cebb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:15.989120  5070 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.995816  5070 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.996115  5070 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.996383  4858 tablet_service.cc:1511] Processing CreateTablet for tablet c3ea9d9171fa428195bc085a20e92e3a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:15.997529  4858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ea9d9171fa428195bc085a20e92e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.002699  5010 tablet_service.cc:1511] Processing CreateTablet for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:16.003868  5010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.005781  5013 tablet_service.cc:1511] Processing CreateTablet for tablet 3da8832a07224abb9a1f8815f3dcd745 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
W20260709 12:09:16.006199  4991 leader_election.cc:343] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.006670  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:16.007418  5073 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.007784  4991 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:16.007120  5013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da8832a07224abb9a1f8815f3dcd745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.016213  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:16.016754  4951 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.017367  4938 tablet_service.cc:1511] Processing CreateTablet for tablet c3ea9d9171fa428195bc085a20e92e3a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:16.018499  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ea9d9171fa428195bc085a20e92e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.021350  5087 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.022339  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:16.023615  4840 leader_election.cc:343] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.023890  4951 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:16.024967  4839 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:16.031284  5073 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.031633  5073 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.031955  5073 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.032158  4857 tablet_service.cc:1511] Processing CreateTablet for tablet 3994e4d9351c414cb95b2a6e7bd76142 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:16.033085  5009 tablet_service.cc:1511] Processing CreateTablet for tablet c3ea9d9171fa428195bc085a20e92e3a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:16.035668  4857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3994e4d9351c414cb95b2a6e7bd76142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.035995  5009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ea9d9171fa428195bc085a20e92e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.041868  4935 tablet_service.cc:1511] Processing CreateTablet for tablet 3994e4d9351c414cb95b2a6e7bd76142 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:16.043135  5006 tablet_service.cc:1511] Processing CreateTablet for tablet 3994e4d9351c414cb95b2a6e7bd76142 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:16.043444  5070 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.043848  4941 tablet_service.cc:1511] Processing CreateTablet for tablet 3805e1c03edc45ed8a91427825b04e2e (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:16.045126  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3805e1c03edc45ed8a91427825b04e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.045462  4859 tablet_service.cc:1511] Processing CreateTablet for tablet 3805e1c03edc45ed8a91427825b04e2e (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:16.044348  5006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3994e4d9351c414cb95b2a6e7bd76142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.047521  5012 tablet_service.cc:1511] Processing CreateTablet for tablet 3805e1c03edc45ed8a91427825b04e2e (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:16.048666  5012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3805e1c03edc45ed8a91427825b04e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.049314  4862 tablet_service.cc:1511] Processing CreateTablet for tablet 93239e0814394381aa73ef05e3ce06f0 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:16.054388  5067 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.054854  5067 ts_tablet_manager.cc:1403] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.159s	user 0.029s	sys 0.031s
I20260709 12:09:16.055202  4935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3994e4d9351c414cb95b2a6e7bd76142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.030311  5087 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.059674  4932 tablet_service.cc:1511] Processing CreateTablet for tablet 93239e0814394381aa73ef05e3ce06f0 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:16.059876  5067 raft_consensus.cc:359] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.060535  5067 raft_consensus.cc:385] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.060849  5067 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.065894  4932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93239e0814394381aa73ef05e3ce06f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.066535  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:16.067076  4934 tablet_service.cc:1511] Processing CreateTablet for tablet 3271fdf9e70240dc96def0f272e84933 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:09:16.067818  4839 leader_election.cc:343] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.068202  4934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3271fdf9e70240dc96def0f272e84933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.064626  5067 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.069947  5073 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.071645  5011 tablet_service.cc:1511] Processing CreateTablet for tablet 3271fdf9e70240dc96def0f272e84933 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:16.072909  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:16.073427  5065 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.073866  5065 ts_tablet_manager.cc:1403] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.229s	user 0.012s	sys 0.005s
I20260709 12:09:16.073959  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:16.074162  4988 leader_election.cc:343] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.074486  4875 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.071921  5073 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:16.072819  5011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3271fdf9e70240dc96def0f272e84933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.078536  5015 tablet_service.cc:1511] Processing CreateTablet for tablet 49d7b189f495402dbbaadba00a5cebb8 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:16.079674  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d7b189f495402dbbaadba00a5cebb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.083387  4875 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:16.084510  4991 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:16.074154  4858 tablet_service.cc:1511] Processing CreateTablet for tablet 3271fdf9e70240dc96def0f272e84933 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:16.093174  5070 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.094592  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:16.095113  5025 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.095715  5065 raft_consensus.cc:359] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.096386  5065 raft_consensus.cc:385] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.075649  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93239e0814394381aa73ef05e3ce06f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.097604  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3805e1c03edc45ed8a91427825b04e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.099768  5066 tablet_bootstrap.cc:492] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.100211  5066 ts_tablet_manager.cc:1403] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.301s	user 0.008s	sys 0.010s
I20260709 12:09:16.101753  4858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3271fdf9e70240dc96def0f272e84933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.102938  5066 raft_consensus.cc:359] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:16.103606  5066 raft_consensus.cc:385] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.103886  5066 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.104979  5073 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.104702  5066 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:16.067097  5008 tablet_service.cc:1511] Processing CreateTablet for tablet 93239e0814394381aa73ef05e3ce06f0 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:16.108275  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93239e0814394381aa73ef05e3ce06f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.096671  5065 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.112278  5065 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.117419  5065 ts_tablet_manager.cc:1434] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:09:16.118366  5065 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:16.116045  5070 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:16.122185  5025 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:16.125747  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:16.126499  5070 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.126963  5070 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:16.127764  5070 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.124758  5087 raft_consensus.cc:697] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:16.137073  5073 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:16.155186  4861 tablet_service.cc:1511] Processing CreateTablet for tablet b626d6ae78534a64a64c129ed023c901 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:16.156490  4861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b626d6ae78534a64a64c129ed023c901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.156597  4938 tablet_service.cc:1511] Processing CreateTablet for tablet b626d6ae78534a64a64c129ed023c901 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:16.157856  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b626d6ae78534a64a64c129ed023c901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.161070  5009 tablet_service.cc:1511] Processing CreateTablet for tablet b626d6ae78534a64a64c129ed023c901 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:16.162216  5009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b626d6ae78534a64a64c129ed023c901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.191200  4859 tablet_service.cc:1511] Processing CreateTablet for tablet c88d711fba9d480a97828652c6908d3f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:16.192279  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88d711fba9d480a97828652c6908d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.189154  4939 tablet_service.cc:1511] Processing CreateTablet for tablet c88d711fba9d480a97828652c6908d3f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:16.195029  5067 ts_tablet_manager.cc:1434] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.140s	user 0.032s	sys 0.002s
I20260709 12:09:16.194784  5015 tablet_service.cc:1511] Processing CreateTablet for tablet c88d711fba9d480a97828652c6908d3f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:16.195931  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88d711fba9d480a97828652c6908d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.196049  5067 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.197587  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c88d711fba9d480a97828652c6908d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.175143  5087 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.184522  5073 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.203891  5025 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.216060  5070 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.217789  5067 tablet_bootstrap.cc:654] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.239431  5065 tablet_bootstrap.cc:654] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.247208  4939 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb0f431b68a4f78a03a58597b9cc66a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:16.252463  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb0f431b68a4f78a03a58597b9cc66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.258446  4858 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb0f431b68a4f78a03a58597b9cc66a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:16.259702  4858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb0f431b68a4f78a03a58597b9cc66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.266713  5011 tablet_service.cc:1511] Processing CreateTablet for tablet 1fb0f431b68a4f78a03a58597b9cc66a (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:16.268004  5011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb0f431b68a4f78a03a58597b9cc66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.281750  5067 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.282231  5067 ts_tablet_manager.cc:1403] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.013s
I20260709 12:09:16.288647  5100 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.289072  5100 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.291942  5100 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.312242  4938 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:16.300084  5067 raft_consensus.cc:359] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.316985  5067 raft_consensus.cc:385] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.317299  5067 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.313606  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.318014  5067 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.321439  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:16.321514  5015 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:16.321749  4859 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:16.322286  5066 ts_tablet_manager.cc:1434] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.222s	user 0.016s	sys 0.016s
I20260709 12:09:16.324048  4863 tablet_service.cc:1511] Processing CreateTablet for tablet 951f0af961a844849af172b241003482 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:16.324081  4774 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.325711  4773 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:16.313463  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:16.340085  4839 leader_election.cc:343] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.340287  5066 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
W20260709 12:09:16.330816  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:16.332664  4941 tablet_service.cc:1511] Processing CreateTablet for tablet 951f0af961a844849af172b241003482 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:16.333585  5008 tablet_service.cc:1511] Processing CreateTablet for tablet 951f0af961a844849af172b241003482 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:16.338373  4859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.345543  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951f0af961a844849af172b241003482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.345649  4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951f0af961a844849af172b241003482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.346961  5011 tablet_service.cc:1511] Processing CreateTablet for tablet 231547812bf34f17b386898e6451cc49 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:09:16.348390  4840 leader_election.cc:343] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.348824  4840 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:16.349723  5066 tablet_bootstrap.cc:654] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.350725  5070 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.354996  5067 ts_tablet_manager.cc:1434] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 12:09:16.356003  5067 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.356827  5006 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec4626ffb3e4c87ab8ad80ac34ac61d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:16.360638  4861 tablet_service.cc:1511] Processing CreateTablet for tablet 184edf8541a448c78939e0c2fd55ae1f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:16.361816  4861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184edf8541a448c78939e0c2fd55ae1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.360446  4932 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec4626ffb3e4c87ab8ad80ac34ac61d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:16.363899  4932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec4626ffb3e4c87ab8ad80ac34ac61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.357167  4858 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec4626ffb3e4c87ab8ad80ac34ac61d (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:16.365453  4858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec4626ffb3e4c87ab8ad80ac34ac61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.358736  4862 tablet_service.cc:1511] Processing CreateTablet for tablet 231547812bf34f17b386898e6451cc49 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:16.366405  4862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 231547812bf34f17b386898e6451cc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.377041  4939 tablet_service.cc:1511] Processing CreateTablet for tablet 231547812bf34f17b386898e6451cc49 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:16.370921  5067 tablet_bootstrap.cc:654] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.379119  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951f0af961a844849af172b241003482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.381407  4938 tablet_service.cc:1511] Processing CreateTablet for tablet 184edf8541a448c78939e0c2fd55ae1f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:16.385663  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.386332  5065 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.386668  5087 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.387105  5065 ts_tablet_manager.cc:1403] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.269s	user 0.018s	sys 0.005s
I20260709 12:09:16.387101  5087 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.391276  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:16.392374  4839 leader_election.cc:343] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.394526  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:16.394428  5065 raft_consensus.cc:359] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.395347  5065 raft_consensus.cc:385] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.395685  5065 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
W20260709 12:09:16.395766  4840 leader_election.cc:343] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.396315  4840 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:16.397226  5100 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.398231  5011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 231547812bf34f17b386898e6451cc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.398989  5006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec4626ffb3e4c87ab8ad80ac34ac61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.378122  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 231547812bf34f17b386898e6451cc49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.402542  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184edf8541a448c78939e0c2fd55ae1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.407776  5009 tablet_service.cc:1511] Processing CreateTablet for tablet 184edf8541a448c78939e0c2fd55ae1f (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:16.408556  4863 tablet_service.cc:1511] Processing CreateTablet for tablet 36177f71106c42f98afc1b375e5f6838 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:16.408985  5009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184edf8541a448c78939e0c2fd55ae1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.394315  5087 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.423205  4935 tablet_service.cc:1511] Processing CreateTablet for tablet 36177f71106c42f98afc1b375e5f6838 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:16.424362  4935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36177f71106c42f98afc1b375e5f6838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.429396  4863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36177f71106c42f98afc1b375e5f6838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.437628  5008 tablet_service.cc:1511] Processing CreateTablet for tablet 36177f71106c42f98afc1b375e5f6838 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:16.438632  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36177f71106c42f98afc1b375e5f6838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.440348  4857 tablet_service.cc:1511] Processing CreateTablet for tablet b0ae020fc77f442c9f248fa0f3e45fe4 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:16.441475  4857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ae020fc77f442c9f248fa0f3e45fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.396605  5065 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.450626  5065 ts_tablet_manager.cc:1434] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.002s
I20260709 12:09:16.451588  5065 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:16.455838  5066 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.456467  5066 ts_tablet_manager.cc:1403] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.116s	user 0.025s	sys 0.037s
I20260709 12:09:16.459782  5066 raft_consensus.cc:359] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.460465  5066 raft_consensus.cc:385] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.460752  5066 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.461580  5066 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.463687  5066 ts_tablet_manager.cc:1434] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:16.464017  5065 tablet_bootstrap.cc:654] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.463563  5008 tablet_service.cc:1511] Processing CreateTablet for tablet b0ae020fc77f442c9f248fa0f3e45fe4 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:16.465241  5008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ae020fc77f442c9f248fa0f3e45fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.473023  4861 tablet_service.cc:1511] Processing CreateTablet for tablet 9752c5a68f0f415b848ef1da168f8d82 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:16.474236  4861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752c5a68f0f415b848ef1da168f8d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.464643  4941 tablet_service.cc:1511] Processing CreateTablet for tablet b0ae020fc77f442c9f248fa0f3e45fe4 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:16.477118  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ae020fc77f442c9f248fa0f3e45fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.481887  4939 tablet_service.cc:1511] Processing CreateTablet for tablet 9752c5a68f0f415b848ef1da168f8d82 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:16.482945  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752c5a68f0f415b848ef1da168f8d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.464712  5066 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:16.492509  5006 tablet_service.cc:1511] Processing CreateTablet for tablet 9752c5a68f0f415b848ef1da168f8d82 (DEFAULT_TABLE table=test-workload [id=b1caf261a40c41b684ccf934ed4befc6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:16.493736  5006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752c5a68f0f415b848ef1da168f8d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.502858  5065 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.503297  5065 ts_tablet_manager.cc:1403] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.015s
I20260709 12:09:16.516400  5066 tablet_bootstrap.cc:654] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.520659  5067 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.521298  5067 ts_tablet_manager.cc:1403] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.165s	user 0.023s	sys 0.011s
I20260709 12:09:16.527925  5065 raft_consensus.cc:359] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.528671  5065 raft_consensus.cc:385] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.529029  5065 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.529728  5065 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.531790  5065 ts_tablet_manager.cc:1434] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:09:16.524065  5067 raft_consensus.cc:359] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.532533  5067 raft_consensus.cc:385] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.532747  5065 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:16.532841  5067 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.533576  5067 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.535617  5067 ts_tablet_manager.cc:1434] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:09:16.536669  5067 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.541069  5066 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.541020  5065 tablet_bootstrap.cc:654] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.542439  5066 ts_tablet_manager.cc:1403] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.007s
I20260709 12:09:16.545328  5066 raft_consensus.cc:359] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.546511  5066 raft_consensus.cc:385] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.546851  5066 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.547204  5067 tablet_bootstrap.cc:654] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.547770  5066 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.550100  5066 ts_tablet_manager.cc:1434] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:16.551163  5066 tablet_bootstrap.cc:492] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:16.557389  5066 tablet_bootstrap.cc:654] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.568625  5066 tablet_bootstrap.cc:492] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.569198  5066 ts_tablet_manager.cc:1403] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.009s
I20260709 12:09:16.571906  5066 raft_consensus.cc:359] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.572691  5066 raft_consensus.cc:385] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.573060  5066 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.573884  5066 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.575245  5065 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.575692  5065 ts_tablet_manager.cc:1403] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.007s
I20260709 12:09:16.576346  5066 ts_tablet_manager.cc:1434] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:09:16.577755  5066 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:16.578240  5065 raft_consensus.cc:359] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.578893  5065 raft_consensus.cc:385] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.579171  5065 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.579875  5065 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.583050  5065 ts_tablet_manager.cc:1434] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:16.583983  5065 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:16.585443  5067 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.585916  5067 ts_tablet_manager.cc:1403] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.050s	user 0.030s	sys 0.010s
I20260709 12:09:16.587563  5066 tablet_bootstrap.cc:654] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.588366  5067 raft_consensus.cc:359] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.588997  5067 raft_consensus.cc:385] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.589250  5067 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.589924  5065 tablet_bootstrap.cc:654] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.589941  5067 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.591970  5067 ts_tablet_manager.cc:1434] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:16.592829  5067 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.598063  5074 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.598500  5074 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.599200  4773 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.600521  5074 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.602712  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:16.603411  4875 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:16.604319  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:16.604708  5067 tablet_bootstrap.cc:654] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.605798  4915 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:16.606513  5074 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.612378  5073 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.613056  5074 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.612895  5073 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.614959  5073 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:16.617300  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:16.617920  4875 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:16.618888  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:16.619494  4951 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:16.620782  4988 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:16.622356  5067 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.622637  5073 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.622772  5067 ts_tablet_manager.cc:1403] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.003s
I20260709 12:09:16.623142  5073 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.623565  5073 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.625497  5067 raft_consensus.cc:359] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.626272  5067 raft_consensus.cc:385] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.626535  5067 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.627224  5067 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.628309  5065 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.628772  5065 ts_tablet_manager.cc:1403] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.020s
I20260709 12:09:16.628780  5067 ts_tablet_manager.cc:1434] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:16.630100  5067 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.631450  5065 raft_consensus.cc:359] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.632123  5065 raft_consensus.cc:385] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.632426  5065 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.630195  5073 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.633208  5065 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.634842  5067 tablet_bootstrap.cc:654] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.635308  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:16.635813  4875 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.639072  5065 ts_tablet_manager.cc:1434] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260709 12:09:16.639981  5065 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:16.643530  4875 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
W20260709 12:09:16.644102  4839 consensus_peers.cc:597] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:16.645291  5073 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:16.645391  5065 tablet_bootstrap.cc:654] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.645717  5104 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.646668  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:16.647171  4951 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.645429  4991 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:16.652177  5104 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.652624  5104 raft_consensus.cc:697] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:16.653462  5104 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.654485  5066 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.654944  5066 ts_tablet_manager.cc:1403] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.019s
I20260709 12:09:16.652628  4951 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:16.660265  5067 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.660741  5067 ts_tablet_manager.cc:1403] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.001s
I20260709 12:09:16.663687  5067 raft_consensus.cc:359] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.664347  5067 raft_consensus.cc:385] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.665186  5067 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.665768  5067 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.667624  5067 ts_tablet_manager.cc:1434] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:16.668613  5067 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.670625  4773 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:16.672978  5073 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.674487  5067 tablet_bootstrap.cc:654] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.679028  5066 raft_consensus.cc:359] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.679694  5066 raft_consensus.cc:385] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.679953  5066 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.682405  5066 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.687462  5066 ts_tablet_manager.cc:1434] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:09:16.688390  5066 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:16.692834  5024 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.695032  5065 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.695428  5065 ts_tablet_manager.cc:1403] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.031s
I20260709 12:09:16.696614  5074 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.697079  5074 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.697774  5066 tablet_bootstrap.cc:654] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.697999  5065 raft_consensus.cc:359] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.698580  5065 raft_consensus.cc:385] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.698818  5065 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.699039  5074 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.699414  5065 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.701257  5065 ts_tablet_manager.cc:1434] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:16.701274  5067 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.701812  5067 ts_tablet_manager.cc:1403] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.015s
I20260709 12:09:16.702638  5065 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:16.704108  5067 raft_consensus.cc:359] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.704694  5067 raft_consensus.cc:385] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.705031  5067 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.705639  5067 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.707423  5067 ts_tablet_manager.cc:1434] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:09:16.708240  5067 tablet_bootstrap.cc:492] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.708266  5065 tablet_bootstrap.cc:654] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.709600  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:16.710191  4875 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:16.710479  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:16.711870  4915 leader_election.cc:343] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.714385  5067 tablet_bootstrap.cc:654] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.714392  4917 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:16.716429  5074 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.716782  5074 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.719218  5074 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.732347  5087 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.749590  5066 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.750068  5066 ts_tablet_manager.cc:1403] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.004s
I20260709 12:09:16.752351  5066 raft_consensus.cc:359] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.752961  5067 tablet_bootstrap.cc:492] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.753031  5066 raft_consensus.cc:385] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.753368  5066 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.753448  5067 ts_tablet_manager.cc:1403] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.033s
I20260709 12:09:16.752404  5087 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:16.754009  5066 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.756227  5066 ts_tablet_manager.cc:1434] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:16.757141  5066 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:16.758244  5074 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.759805  5087 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.762146  5067 raft_consensus.cc:359] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.762959  5066 tablet_bootstrap.cc:654] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.780431  5067 raft_consensus.cc:385] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.780742  5067 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.781363  5067 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.781832  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:16.782359  4875 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.783674  5067 ts_tablet_manager.cc:1434] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:09:16.784442  5073 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.784926  5073 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.786065  5067 tablet_bootstrap.cc:492] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.787533  5136 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.788004  5136 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.789604  4875 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:16.797387  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:16.798169  5074 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.799443  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:16.800100  5023 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.802047  5065 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.802474  5065 ts_tablet_manager.cc:1403] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.100s	user 0.028s	sys 0.036s
I20260709 12:09:16.803272  4917 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:16.790086  5136 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.803999  5074 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.804461  5074 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:16.805274  5074 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.791613  5073 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:16.791815  5067 tablet_bootstrap.cc:654] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.792631  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:16.793803  5137 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.809756  5137 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.797971  4950 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:16.812088  5137 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.808302  5065 raft_consensus.cc:359] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.795217  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:16.817329  5065 raft_consensus.cc:385] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.817545  4876 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:16.796633  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:16.819001  4874 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:16.816215  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:16.820573  5024 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
W20260709 12:09:16.816869  4915 leader_election.cc:343] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.817632  5065 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.815464  4988 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:16.821756  5065 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.823858  5065 ts_tablet_manager.cc:1434] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:09:16.824601  4915 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:16.824708  5065 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:16.826288  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:16.827030  5136 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.827363  5136 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.827687  5136 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.830869  5065 tablet_bootstrap.cc:654] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.831760  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:16.832352  4874 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:16.837018  5073 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.836776  5136 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.837378  5073 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.838913  5073 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.839603  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:16.840149  5024 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.844960  5137 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.845309  5137 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.845641  5137 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.846837  5104 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.847285  5104 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.849185  5104 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:16.852768  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:16.853377  4950 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:16.855068  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:16.855572  4876 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.856174  5023 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:16.857091  5066 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.857539  5066 ts_tablet_manager.cc:1403] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.020s
I20260709 12:09:16.859988  5066 raft_consensus.cc:359] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.860579  5066 raft_consensus.cc:385] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.861040  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:16.861603  4874 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:16.862699  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:16.863469  5104 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.863801  5104 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.864156  5104 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.864065  5137 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.869488  5073 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.871419  5073 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:16.872895  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:16.873462  4950 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.875834  5066 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.876523  5066 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.877141  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:16.877640  4874 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.878381  5066 ts_tablet_manager.cc:1434] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:09:16.879230  5066 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:16.882555  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:16.883119  4875 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.885146  5137 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.885859  5024 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:16.889277  4950 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:16.890668  4876 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:16.891398  5136 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.893467  5104 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.893915  4917 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:16.895294  5104 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:16.899087  4874 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:16.901966  4991 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:16.902643  5065 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.903074  5065 ts_tablet_manager.cc:1403] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.005s
I20260709 12:09:16.904224  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:16.904767  5025 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.905195  5067 tablet_bootstrap.cc:492] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.905597  5067 ts_tablet_manager.cc:1403] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.007s
I20260709 12:09:16.905495  5073 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.906185  5074 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.906813  5074 raft_consensus.cc:697] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:16.907630  5074 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.909106  4875 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:16.910185  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:16.910449  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:16.910966  4950 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.911981  5066 tablet_bootstrap.cc:654] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.912147  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:16.912686  4874 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.908910  5067 raft_consensus.cc:359] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.913347  5067 raft_consensus.cc:385] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.913631  5067 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.914048  5136 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.914505  5136 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:16.915604  5025 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:16.917135  5065 raft_consensus.cc:359] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.917776  5065 raft_consensus.cc:385] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.918033  5065 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.915272  5136 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.925366  4950 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:16.922748  4773 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.928977  4988 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:16.924345  4874 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:16.927482  5066 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.929826  5146 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.930830  5066 ts_tablet_manager.cc:1403] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.005s
I20260709 12:09:16.931324  5146 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:16.927564  5073 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:16.932281  5146 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.933194  5066 raft_consensus.cc:359] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.920009  5067 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.940213  5066 raft_consensus.cc:385] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.940539  5066 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.941175  5066 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.941665  5067 ts_tablet_manager.cc:1434] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:09:16.942615  5067 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.943050  5066 ts_tablet_manager.cc:1434] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.004s
I20260709 12:09:16.944043  5066 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:16.919180  5065 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.946676  5065 ts_tablet_manager.cc:1434] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:09:16.947492  5065 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:16.932310  5073 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.949828  5066 tablet_bootstrap.cc:654] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.957698  5067 tablet_bootstrap.cc:654] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.960426  4771 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.962999  5066 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:16.963399  5066 ts_tablet_manager.cc:1403] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:09:16.962663  4771 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.966396  5065 tablet_bootstrap.cc:654] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.969740  5066 raft_consensus.cc:359] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.970217  5100 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.970665  5100 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.970250  5066 raft_consensus.cc:385] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.971817  5066 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.972545  5100 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.972604  5066 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.972551  5067 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:16.973943  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:16.974560  5067 ts_tablet_manager.cc:1403] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.011s
I20260709 12:09:16.974654  5066 ts_tablet_manager.cc:1434] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:16.974092  4773 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:16.975503  5066 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
W20260709 12:09:16.975446  4840 leader_election.cc:343] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.973973  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:16.977098  4839 leader_election.cc:343] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.977516  4839 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:16.977320  5067 raft_consensus.cc:359] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.978091  5067 raft_consensus.cc:385] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.978395  5067 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.978819  5074 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.979188  5067 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.979249  5074 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.981298  5074 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:16.981595  5066 tablet_bootstrap.cc:654] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.982035  5070 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.982266  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:16.982812  5025 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:16.984045  5067 ts_tablet_manager.cc:1434] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:16.985000  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:16.985842  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:16.986408  4874 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:16.987979  5074 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.988348  5067 tablet_bootstrap.cc:492] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:16.988319  5074 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.988741  5074 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.991564  5065 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:16.991995  5065 ts_tablet_manager.cc:1403] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.002s
I20260709 12:09:16.994508  5067 tablet_bootstrap.cc:654] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.995714  5065 raft_consensus.cc:359] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:16.996315  5065 raft_consensus.cc:385] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.996558  5065 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.997368  5074 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.000043  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:17.000622  4874 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.997983  5065 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.002831  5065 ts_tablet_manager.cc:1434] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:17.003635  5065 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:17.009205  5065 tablet_bootstrap.cc:654] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.013471  5066 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.013921  5066 ts_tablet_manager.cc:1403] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.004s
I20260709 12:09:17.014328  4773 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.016393  5066 raft_consensus.cc:359] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.017094  5066 raft_consensus.cc:385] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.017398  5066 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.018179  5066 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.020725  4874 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:17.021158  5066 ts_tablet_manager.cc:1434] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:17.022140  5066 tablet_bootstrap.cc:492] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.024632  5065 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:17.025059  5065 ts_tablet_manager.cc:1403] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.009s
I20260709 12:09:17.027673  5066 tablet_bootstrap.cc:654] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.027529  5065 raft_consensus.cc:359] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.028129  5065 raft_consensus.cc:385] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.028383  5065 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.028976  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:17.029052  5065 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.030015  5137 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.030455  5074 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.030469  5137 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:17.031569  5137 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.036101  5065 ts_tablet_manager.cc:1434] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 12:09:17.037011  5065 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:17.038668  5136 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.039094  5136 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.041006  5136 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.042636  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:17.044513  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.045090  4874 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:17.040900  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:17.046198  5025 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.049026  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:09:17.050736  4915 leader_election.cc:343] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.052135  5137 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.053123  5065 tablet_bootstrap.cc:654] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.054885  4950 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.056900  4773 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.059126  5067 tablet_bootstrap.cc:492] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.057536  5025 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:17.060031  5067 ts_tablet_manager.cc:1403] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.072s	user 0.028s	sys 0.029s
I20260709 12:09:17.061229  5137 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.061599  5137 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.062551  5067 raft_consensus.cc:359] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.063174  5067 raft_consensus.cc:385] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.063422  5067 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.064024  5067 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.065932  5067 ts_tablet_manager.cc:1434] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:09:17.066969  5067 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.067657  5137 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.072216  5067 tablet_bootstrap.cc:654] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.073401  5066 tablet_bootstrap.cc:492] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.073791  5066 ts_tablet_manager.cc:1403] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.010s
I20260709 12:09:17.074951  5136 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.075371  5136 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.076177  5066 raft_consensus.cc:359] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.076766  5066 raft_consensus.cc:385] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.077035  5066 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.077297  5136 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.078260  5137 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.078858  5066 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.079854  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:17.080368  4875 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.080523  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:17.080950  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.081178  5025 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:17.082006  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:17.082253  4915 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:17.083350  4915 leader_election.cc:343] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.083904  4917 leader_election.cc:343] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.083889  5137 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.087559  5073 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.084918  5137 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.088311  5137 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.088698  5066 ts_tablet_manager.cc:1434] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:17.091974  5066 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.093571  4875 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:17.094702  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:17.094974  5146 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.095897  5136 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.096331  5136 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:17.097114  5136 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.097474  5137 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.100069  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:17.101470  4917 leader_election.cc:343] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.103753  5067 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.104218  5067 ts_tablet_manager.cc:1403] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 12:09:17.106808  5067 raft_consensus.cc:359] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.107436  5067 raft_consensus.cc:385] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.107703  5067 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.109841  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:17.110415  5024 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.113597  5146 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.114049  5146 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.116550  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.117162  4875 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:17.117225  5024 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:17.118368  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:17.118412  4915 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:17.119144  5073 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.119494  5073 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.119604  5146 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.119367  5074 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.120342  5074 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:17.121066  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:17.121208  5074 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:17.122498  4988 leader_election.cc:343] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.119886  5073 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.124671  5100 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.125140  5100 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.125867  5137 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.127130  5100 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.129318  5066 tablet_bootstrap.cc:654] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.133720  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:17.135299  4839 leader_election.cc:343] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.137859  5073 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.128329  5067 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.140515  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:17.142838  5067 ts_tablet_manager.cc:1434] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 12:09:17.141043  4875 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.142067  5073 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.145408  5067 tablet_bootstrap.cc:492] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.140923  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:17.154788  5067 tablet_bootstrap.cc:654] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.142342  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:17.156126  4988 leader_election.cc:343] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.156344  4875 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:17.158149  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:17.159176  5073 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.160182  5073 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:17.160985  5073 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:17.165602  4840 leader_election.cc:343] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.166070  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:17.166770  5100 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.174566  5066 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.175102  5066 ts_tablet_manager.cc:1403] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.005s
I20260709 12:09:17.174600  5065 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:17.174336  4771 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.178591  5065 ts_tablet_manager.cc:1403] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.142s	user 0.033s	sys 0.057s
I20260709 12:09:17.177809  5066 raft_consensus.cc:359] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.179478  5066 raft_consensus.cc:385] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.179808  5066 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.192975  5066 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.194216  5065 raft_consensus.cc:359] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.194857  5065 raft_consensus.cc:385] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.195122  5065 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.195815  5065 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.197926  5065 ts_tablet_manager.cc:1434] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:09:17.198753  5065 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:17.196192  5066 ts_tablet_manager.cc:1434] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:09:17.200079  5066 tablet_bootstrap.cc:492] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.203375  5067 tablet_bootstrap.cc:492] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.203819  5067 ts_tablet_manager.cc:1403] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.005s
I20260709 12:09:17.208778  5065 tablet_bootstrap.cc:654] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.214104  5067 raft_consensus.cc:359] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.217408  5067 raft_consensus.cc:385] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.217644  5067 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.218511  5067 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.220525  5067 ts_tablet_manager.cc:1434] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 12:09:17.223737  5067 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.217103  4773 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.228787  5066 tablet_bootstrap.cc:654] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.233098  5067 tablet_bootstrap.cc:654] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.234210  5065 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:17.234642  5065 ts_tablet_manager.cc:1403] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.007s
I20260709 12:09:17.237785  5065 raft_consensus.cc:359] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.238360  5065 raft_consensus.cc:385] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.238616  5065 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.239317  5065 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.239817  5164 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.241688  5065 ts_tablet_manager.cc:1434] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:17.242331  5065 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:17.248072  5066 tablet_bootstrap.cc:492] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.248471  5066 ts_tablet_manager.cc:1403] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.001s
I20260709 12:09:17.250365  5066 raft_consensus.cc:359] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.250758  5066 raft_consensus.cc:385] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.250905  5066 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.251361  5066 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.253259  5066 ts_tablet_manager.cc:1434] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:09:17.254096  5066 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.255541  5065 tablet_bootstrap.cc:654] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.259326  5066 tablet_bootstrap.cc:654] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.262367  5137 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.272459  4773 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.292098  5067 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.292537  5067 ts_tablet_manager.cc:1403] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 12:09:17.294636  5146 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.295058  5146 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.295168  5067 raft_consensus.cc:359] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.295761  5067 raft_consensus.cc:385] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.296003  5067 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.296602  5067 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.297950  5067 ts_tablet_manager.cc:1434] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:09:17.298676  5067 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.300376  5164 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.300913  5164 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.303839  5164 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.304447  5067 tablet_bootstrap.cc:654] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.305121  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.305518  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:17.306967  4917 leader_election.cc:343] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.307148  5146 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.308694  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:17.310122  4988 leader_election.cc:343] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.311105  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:17.311971  4875 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
W20260709 12:09:17.315807  4915 leader_election.cc:343] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.315863  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:17.316332  4915 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:17.317195  5146 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.317322  5164 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.317601  5146 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.318150  5146 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.329643  5100 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.330090  5100 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.331988  5100 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.333384  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:17.335347  5146 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.335624  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:17.335409  4839 leader_election.cc:343] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.338300  4840 leader_election.cc:343] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.338733  4840 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:17.339737  5100 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.340068  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:17.341491  4988 leader_election.cc:343] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.342424  5146 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.344739  5164 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.347213  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:17.347805  4876 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.354344  4876 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:17.357158  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:17.358515  5067 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.358497  5104 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.359054  5104 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:17.359848  5104 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.362998  5067 ts_tablet_manager.cc:1403] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.064s	user 0.031s	sys 0.018s
I20260709 12:09:17.365357  5067 raft_consensus.cc:359] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.365947  5067 raft_consensus.cc:385] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.366185  5067 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.366775  5067 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.368964  5100 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.369439  5100 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.371402  5100 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.373565  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:17.368708  5067 ts_tablet_manager.cc:1434] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:09:17.374861  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:17.376439  4839 leader_election.cc:343] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.377502  4840 leader_election.cc:343] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.377926  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:17.378649  5070 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.379106  5070 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.379727  5074 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.381224  5070 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.381760  5070 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.382938  5067 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.383585  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:17.384220  4951 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:17.385511  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:17.385506  4839 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:17.388737  5067 tablet_bootstrap.cc:654] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.392959  5070 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.393340  5070 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.393644  5070 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.399097  5067 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.399480  5067 ts_tablet_manager.cc:1403] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
W20260709 12:09:17.400141  4840 leader_election.cc:343] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.402280  5074 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.408273  5067 raft_consensus.cc:359] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.408906  5067 raft_consensus.cc:385] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.409160  5067 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.409780  5067 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.414351  5067 ts_tablet_manager.cc:1434] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 12:09:17.415149  5067 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.420344  5067 tablet_bootstrap.cc:654] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.420030  5074 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.437291  5067 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.437690  5067 ts_tablet_manager.cc:1403] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 12:09:17.439997  5067 raft_consensus.cc:359] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.440572  5067 raft_consensus.cc:385] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.440841  5067 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
W20260709 12:09:17.440963  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.424345  5070 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.446314  5067 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.446537  5065 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:17.447324  5065 ts_tablet_manager.cc:1403] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.205s	user 0.039s	sys 0.068s
I20260709 12:09:17.447577  5066 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.448335  5066 ts_tablet_manager.cc:1403] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.194s	user 0.030s	sys 0.145s
I20260709 12:09:17.448880  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:17.449348  5067 ts_tablet_manager.cc:1434] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:17.449409  4951 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.450228  5067 tablet_bootstrap.cc:492] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.451386  5066 raft_consensus.cc:359] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.452031  5066 raft_consensus.cc:385] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.452293  5066 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.452961  5066 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.450762  5065 raft_consensus.cc:359] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.455843  5066 ts_tablet_manager.cc:1434] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:17.456820  5073 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.457419  5146 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.457808  5073 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.458244  5066 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.459796  5073 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.456910  4951 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:17.461431  4839 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:17.462010  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:17.462285  5100 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.462759  5100 raft_consensus.cc:697] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:09:17.463482  4988 leader_election.cc:343] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.464244  5066 tablet_bootstrap.cc:654] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.462037  5067 tablet_bootstrap.cc:654] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.463793  5065 raft_consensus.cc:385] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.463510  5100 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.468016  5073 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.468389  5065 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.472476  5065 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.478434  5065 ts_tablet_manager.cc:1434] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:09:17.481407  5065 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:17.481521  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:17.482856  4991 leader_election.cc:343] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.483305  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:17.484961  5146 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.499442  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:17.500890  5066 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.501354  5066 ts_tablet_manager.cc:1403] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.032s
I20260709 12:09:17.501334  5074 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:17.504340  4840 leader_election.cc:343] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.504520  5066 raft_consensus.cc:359] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.505187  5066 raft_consensus.cc:385] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.505272  5070 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.505470  5066 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.506304  5066 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.508145  5066 ts_tablet_manager.cc:1434] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:17.508919  5066 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.509562  5101 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.510025  5101 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.511955  5101 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.512928  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:17.514222  5065 tablet_bootstrap.cc:654] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.514613  5066 tablet_bootstrap.cc:654] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.514424  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:17.516336  4839 leader_election.cc:343] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.518087  4840 leader_election.cc:343] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.518558  4840 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:17.519502  5101 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.525776  5066 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.526211  5066 ts_tablet_manager.cc:1403] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:09:17.525475  4773 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.528549  5066 raft_consensus.cc:359] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.529232  5066 raft_consensus.cc:385] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.529485  5066 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.530221  5066 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.535662  5104 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.537909  5066 ts_tablet_manager.cc:1434] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:09:17.541940  5066 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.543870  5074 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.544327  5074 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.547250  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.547533  5066 tablet_bootstrap.cc:654] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.547863  4874 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:17.549580  5104 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.549789  5146 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.550154  5104 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.551268  4917 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:17.552044  5164 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.551981  5104 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.552433  5164 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.552837  5164 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.549551  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:17.561427  4915 leader_election.cc:343] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.563531  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:17.567135  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.567785  4874 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:17.568897  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:17.569856  5191 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.570225  5191 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.570546  5191 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.571487  4988 leader_election.cc:343] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.546867  5074 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:17.573562  4988 consensus_peers.cc:597] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:17.577417  5164 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.581377  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:17.581645  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:17.582979  4915 leader_election.cc:343] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.585302  4872 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.592447  4872 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:17.593597  5074 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.577319  5191 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.593698  4917 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:17.597424  5136 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.597894  5136 raft_consensus.cc:697] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:17.598531  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:17.599102  4873 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.598747  5136 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.599493  5137 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.599987  5137 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.601987  5137 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.603660  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:17.606827  4988 leader_election.cc:343] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.606683  4771 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.608897  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:17.609449  5025 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:17.610616  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.611199  4872 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:17.614173  4915 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:17.614943  5137 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.615276  5137 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.615576  5137 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.622305  5074 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.622411  5137 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.624653  5137 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.625527  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:17.626099  4875 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.632879  4875 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:17.636391  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:17.636996  5025 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.638463  4917 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:17.639302  5074 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.641045  5164 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.643146  5025 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
W20260709 12:09:17.644301  4917 consensus_peers.cc:597] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:17.646425  5067 tablet_bootstrap.cc:492] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.647320  5067 ts_tablet_manager.cc:1403] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.197s	user 0.017s	sys 0.011s
I20260709 12:09:17.649207  5065 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:17.653575  5065 ts_tablet_manager.cc:1403] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.172s	user 0.019s	sys 0.004s
I20260709 12:09:17.652535  5203 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:17.649905  5191 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.658150  5065 raft_consensus.cc:359] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.658814  5065 raft_consensus.cc:385] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.659247  5065 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.649786  5067 raft_consensus.cc:359] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.652962  5074 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:17.660562  5067 raft_consensus.cc:385] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.660907  5067 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.659907  5065 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.661860  5067 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.661131  5074 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.663657  5065 ts_tablet_manager.cc:1434] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:17.664263  5067 ts_tablet_manager.cc:1434] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:09:17.665273  5067 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.668689  5066 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.669143  5066 ts_tablet_manager.cc:1403] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.127s	user 0.043s	sys 0.073s
I20260709 12:09:17.671077  5067 tablet_bootstrap.cc:654] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.671476  5066 raft_consensus.cc:359] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.672096  5066 raft_consensus.cc:385] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.672354  5066 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.672989  5066 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.675542  5066 ts_tablet_manager.cc:1434] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:17.676321  5066 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.680686  5190 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.681623  5066 tablet_bootstrap.cc:654] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.681511  5190 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.683247  5100 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.683689  5100 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.684378  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.685731  5100 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:17.686676  5066 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.687129  5066 ts_tablet_manager.cc:1403] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:17.687569  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:17.688373  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:17.688966  4839 leader_election.cc:343] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.689410  5066 raft_consensus.cc:359] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.690035  5066 raft_consensus.cc:385] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:17.689700  4840 leader_election.cc:343] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.690434  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:17.690690  5066 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.691785  5100 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.692276  5066 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.693838  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:17.692683  5190 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.695286  4988 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:17.696779  5066 ts_tablet_manager.cc:1434] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:17.697655  5066 tablet_bootstrap.cc:492] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.703224  5065 tablet_bootstrap.cc:492] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:17.706073  5190 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.706594  5024 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.707901  4873 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:17.709251  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:17.710410  5190 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.710980  5190 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:17.712188  5190 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.714190  4773 catalog_manager.cc:5697] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.720600  4772 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.730609  5065 tablet_bootstrap.cc:654] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.733805  5067 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.734200  5067 ts_tablet_manager.cc:1403] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.025s
I20260709 12:09:17.736733  5066 tablet_bootstrap.cc:654] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.737114  5067 raft_consensus.cc:359] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.737758  5067 raft_consensus.cc:385] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.738001  5067 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.738601  5067 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.739931  5190 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.740361  5190 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.740793  5067 ts_tablet_manager.cc:1434] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:17.741998  5067 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.742590  5190 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.743952  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:17.744587  4873 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:17.746380  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:17.747409  5067 tablet_bootstrap.cc:654] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:17.748795  4988 leader_election.cc:343] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.750110  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:17.750391  5204 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.751204  5190 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.751570  5190 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.751896  5190 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.752988  5065 tablet_bootstrap.cc:492] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:17.753432  5065 ts_tablet_manager.cc:1403] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.003s
I20260709 12:09:17.754036  5066 tablet_bootstrap.cc:492] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:17.754935  5066 ts_tablet_manager.cc:1403] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.003s
I20260709 12:09:17.755734  5065 raft_consensus.cc:359] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.756353  5065 raft_consensus.cc:385] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.756609  5065 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.757517  5066 raft_consensus.cc:359] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.758153  5066 raft_consensus.cc:385] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.758450  5066 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.758248  5065 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.759290  5066 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.761832  5065 ts_tablet_manager.cc:1434] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:17.761443  4772 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.762689  5065 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:17.763268  5190 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.765257  5066 ts_tablet_manager.cc:1434] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:09:17.767167  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:17.767516  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:17.767701  4873 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.768738  4988 leader_election.cc:343] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.769251  5190 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:17.770556  5065 tablet_bootstrap.cc:654] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.773815  5191 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.776225  4873 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:17.778753  5067 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:17.779268  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:17.779608  5067 ts_tablet_manager.cc:1403] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.004s
I20260709 12:09:17.766144  5066 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:17.782047  5191 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.782095  5067 raft_consensus.cc:359] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.782734  5191 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:17.783618  5191 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.782760  5067 raft_consensus.cc:385] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.798290  5067 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.799703  5067 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:17.803227  5067 ts_tablet_manager.cc:1434] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:09:17.804574  5067 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:17.972443  5067 tablet_bootstrap.cc:654] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.126264  5065 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:18.126523  5066 tablet_bootstrap.cc:654] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.126765  5065 ts_tablet_manager.cc:1403] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.364s	user 0.015s	sys 0.003s
I20260709 12:09:18.129508  5065 raft_consensus.cc:359] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.130158  5065 raft_consensus.cc:385] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.130405  5065 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.131040  5065 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.132735  5065 ts_tablet_manager.cc:1434] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:18.133646  5065 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:18.147784  5065 tablet_bootstrap.cc:654] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.152853  5190 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.153290  5190 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.157675  5190 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:18.164569  5191 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.165022  5191 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.165927  5146 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.166378  5146 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.166918  5191 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:18.168385  5067 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:18.168934  5067 ts_tablet_manager.cc:1403] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.365s	user 0.011s	sys 0.013s
I20260709 12:09:18.170142  5146 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:18.171190  5066 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:18.172698  5067 raft_consensus.cc:359] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.173489  5067 raft_consensus.cc:385] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.173626  5066 ts_tablet_manager.cc:1403] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.408s	user 0.018s	sys 0.023s
I20260709 12:09:18.173789  5067 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.174443  5067 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.175034  5065 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:18.175699  5065 ts_tablet_manager.cc:1403] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.042s	user 0.003s	sys 0.009s
I20260709 12:09:18.176339  5067 ts_tablet_manager.cc:1434] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:09:18.177517  5067 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:18.178145  5065 raft_consensus.cc:359] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.178776  5065 raft_consensus.cc:385] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.179021  5065 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.179755  5065 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.182245  5065 ts_tablet_manager.cc:1434] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:18.183372  5065 tablet_bootstrap.cc:492] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:18.183959  5067 tablet_bootstrap.cc:654] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.186480  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.188794  5065 tablet_bootstrap.cc:654] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.191260  4944 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:18.180051  5066 raft_consensus.cc:359] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.192571  5066 raft_consensus.cc:385] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.192930  5066 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.193611  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:18.194805  5146 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.195187  5146 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.195498  5146 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.201476  5067 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:18.201885  5067 ts_tablet_manager.cc:1403] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.017s
I20260709 12:09:18.201598  5146 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.203269  5065 tablet_bootstrap.cc:492] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:18.203660  5065 ts_tablet_manager.cc:1403] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 12:09:18.204030  5146 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:18.204246  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:18.204353  5067 raft_consensus.cc:359] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.205060  4944 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.205098  5067 raft_consensus.cc:385] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.205644  5067 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.206279  5067 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.206656  5065 raft_consensus.cc:359] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.207261  5065 raft_consensus.cc:385] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.207532  5065 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.208105  5065 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.208488  5067 ts_tablet_manager.cc:1434] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:18.209522  5067 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:18.210312  5065 ts_tablet_manager.cc:1434] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:09:18.208472  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.211117  4943 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:18.211201  5065 tablet_bootstrap.cc:492] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:18.193614  5066 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.214917  5067 tablet_bootstrap.cc:654] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.215267  5066 ts_tablet_manager.cc:1434] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.003s
I20260709 12:09:18.216774  5066 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:18.217003  5065 tablet_bootstrap.cc:654] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.219451  4988 consensus_peers.cc:597] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.222342  4948 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.222805  4944 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:18.226137  5100 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.227380  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:18.227480  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:18.228010  4875 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:18.228338  5146 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.226631  5100 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.228842  5146 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:18.230918  5146 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.233001  5100 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.235270  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:18.236196  4875 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:18.240165  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:18.240252  5222 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.237214  5221 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:18.248046  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.250247  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:18.251374  4988 leader_election.cc:343] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.255215  4991 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:18.256471  5222 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.256824  5222 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.257169  5222 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.261658  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:18.262490  5190 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.263409  5221 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.272092  5190 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:18.276188  4840 leader_election.cc:343] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.279879  5222 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.301699  5100 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.303057  5100 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.303503  5100 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.310947  5065 tablet_bootstrap.cc:492] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:18.311440  5065 ts_tablet_manager.cc:1403] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.005s
I20260709 12:09:18.322039  5067 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:18.322357  5067 ts_tablet_manager.cc:1403] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.028s
I20260709 12:09:18.324229  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.324903  4947 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:18.337471  5065 raft_consensus.cc:359] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.337929  5065 raft_consensus.cc:385] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.338137  5065 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.338713  5065 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.338881  5067 raft_consensus.cc:359] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.339516  5067 raft_consensus.cc:385] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.339779  5067 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.340234  5065 ts_tablet_manager.cc:1434] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.000s
I20260709 12:09:18.340960  5065 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:18.326678  5100 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.340317  5067 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.343519  5067 ts_tablet_manager.cc:1434] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 12:09:18.346907  5066 tablet_bootstrap.cc:654] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.408021  5067 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:18.453171  5222 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:18.462599  4944 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.475005  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:18.476347  5231 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.476708  5231 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.477030  5231 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.478472  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.480572  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:18.483405  5231 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.480446  4772 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.499950  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.506920  5065 tablet_bootstrap.cc:654] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.520354  5067 tablet_bootstrap.cc:654] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.525797  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.523214  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:18.533350  5228 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.533810  5228 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.535077  4870 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.546120  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:18.485525  5231 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:18.549532  4988 leader_election.cc:343] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.550796  5233 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.584439  4870 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:18.560251  4946 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.593536  5100 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:18.598989  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:18.590782  5233 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.607347  5231 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.609328  5228 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.602921  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:18.616730  5066 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:18.617214  5066 ts_tablet_manager.cc:1403] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.401s	user 0.010s	sys 0.013s
I20260709 12:09:18.618444  4870 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.637112  5066 raft_consensus.cc:359] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.637563  5066 raft_consensus.cc:385] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.637753  5066 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.627743  5146 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.616736  5231 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.653563  5233 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.659363  4840 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:18.661687  5245 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.662145  5245 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.665956  5231 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.666333  5231 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.654790  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.656847  4945 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.669458  4946 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:18.669791  5245 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.675099  4872 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.681206  5238 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.681378  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:18.682804  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.683526  5238 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.701429  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.702068  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:18.705035  5236 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:18.709514  5236 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.708592  4870 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
W20260709 12:09:18.711246  4839 leader_election.cc:343] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.711748  5231 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:18.711891  4839 leader_election.cc:343] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.712244  5231 raft_consensus.cc:697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:09:18.712821  4839 leader_election.cc:343] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.713047  5231 consensus_queue.cc:237] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.730816  5067 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:18.731273  5067 ts_tablet_manager.cc:1403] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.380s	user 0.016s	sys 0.011s
W20260709 12:09:18.733776  5242 log.cc:927] Time spent T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.098s	user 0.003s	sys 0.000s
I20260709 12:09:18.742094  5067 raft_consensus.cc:359] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.742770  5067 raft_consensus.cc:385] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.743012  5067 raft_consensus.cc:740] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.743597  5067 consensus_queue.cc:260] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.745337  5067 ts_tablet_manager.cc:1434] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:18.746403  5067 tablet_bootstrap.cc:492] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:18.752767  5067 tablet_bootstrap.cc:654] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.757428  5067 tablet_bootstrap.cc:492] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:18.757823  5067 ts_tablet_manager.cc:1403] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:09:18.757975  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.762773  4951 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.760362  5067 raft_consensus.cc:359] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.767501  5067 raft_consensus.cc:385] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.767769  5067 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.768345  5067 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.770764  5067 ts_tablet_manager.cc:1434] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:09:18.771597  5067 tablet_bootstrap.cc:492] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:18.778903  5221 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.783010  5263 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.787665  5236 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:18.789819  4840 leader_election.cc:343] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.791344  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:18.792655  4991 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:18.793932  5067 tablet_bootstrap.cc:654] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.796569  5266 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.797086  5266 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:18.797824  5266 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.805109  5067 tablet_bootstrap.cc:492] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:18.805451  5067 ts_tablet_manager.cc:1403] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.008s
I20260709 12:09:18.808135  5067 raft_consensus.cc:359] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.808879  5067 raft_consensus.cc:385] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.809141  5067 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.809705  5067 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.812053  5067 ts_tablet_manager.cc:1434] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:18.812974  5067 tablet_bootstrap.cc:492] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:18.813683  5065 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:18.814112  5065 ts_tablet_manager.cc:1403] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.473s	user 0.025s	sys 0.012s
I20260709 12:09:18.816677  5065 raft_consensus.cc:359] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.817289  5065 raft_consensus.cc:385] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.817577  5065 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.818192  5065 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.819337  5067 tablet_bootstrap.cc:654] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.819870  5065 ts_tablet_manager.cc:1434] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:18.820716  5065 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:18.823930  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.824571  5025 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:18.825965  4840 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:18.825917  5065 tablet_bootstrap.cc:654] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.828284  5100 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.828661  5100 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.828977  5074 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.828997  5100 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.829643  5074 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.831715  5074 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.832363  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:18.832965  4872 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:18.833937  4917 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:18.834764  5074 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.835126  5074 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.835445  5074 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.835809  5100 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.838317  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:18.841095  4839 leader_election.cc:343] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.843377  5265 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.844398  4771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 33) took 1052 ms. Trace:
I20260709 12:09:18.853715  4771 rpcz_store.cc:276] 0709 12:09:17.791741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:17.792640 (+   899us) service_pool.cc:224] Handling call
0709 12:09:18.844304 (+1051664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95848,"reported_tablets":2}
I20260709 12:09:18.853173  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.851410  5067 tablet_bootstrap.cc:492] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:18.861418  5067 ts_tablet_manager.cc:1403] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.009s
I20260709 12:09:18.863859  5067 raft_consensus.cc:359] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.864473  5067 raft_consensus.cc:385] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.864732  5067 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.865343  5067 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.865614  5066 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.866582  5269 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.867026  5269 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.867719  5066 ts_tablet_manager.cc:1434] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.250s	user 0.008s	sys 0.002s
I20260709 12:09:18.867965  5231 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.868446  5231 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.870388  5231 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.870584  5269 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:18.871475  5022 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:18.872617  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:18.873832  4839 leader_election.cc:343] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.647089  5146 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.876627  5067 ts_tablet_manager.cc:1434] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:09:18.876602  5146 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:18.877691  5067 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:18.879055  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.879938  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:18.882503  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.885356  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.885937  5019 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
W20260709 12:09:18.884675  4988 leader_election.cc:343] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.886766  5067 tablet_bootstrap.cc:654] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.868650  5066 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:18.888021  5233 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.843649  5100 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.897801  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.921264  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:18.921825  5019 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.918442  4840 leader_election.cc:343] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.896528  4915 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:18.934988  5233 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:18.935441  4915 consensus_peers.cc:597] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.927340  5074 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.938423  5066 tablet_bootstrap.cc:654] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.933480  4840 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:18.940276  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:18.940796  4840 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:18.941036  5233 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.941448  5101 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.941566  5231 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.941927  5231 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.942234  5231 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.945542  4948 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 1: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:18.947292  4773 catalog_manager.cc:5697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.946100  5074 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:18.955561  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:18.958658  5231 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.961055  5019 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:18.965193  5065 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:18.965440  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:18.966140  5100 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.966943  5065 ts_tablet_manager.cc:1403] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.146s	user 0.033s	sys 0.041s
I20260709 12:09:18.966567  5100 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:18.969539  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:18.967588  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:18.971081  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:18.971462  5020 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.972280  4948 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 1: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:18.981390  4771 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.984977  5262 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:18.990134  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:18.992275  4872 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:18.987815  4771 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.967895  4873 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.027472  5100 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.027971  5231 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.030544  5065 raft_consensus.cc:359] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.031174  5065 raft_consensus.cc:385] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.031430  5065 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.032186  5020 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:19.032027  5065 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.036063  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:19.036788  5074 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.037240  5074 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:19.038013  5074 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.042096  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.047606  5065 ts_tablet_manager.cc:1434] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.003s
I20260709 12:09:19.048458  5065 tablet_bootstrap.cc:492] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:19.052335  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.053381  5262 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.053730  5262 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.054054  5262 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.043648  5263 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.058760  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:19.061280  4839 leader_election.cc:343] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.073119  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:19.072719  4840 leader_election.cc:343] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.073836  5024 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 1: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:19.074361  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.073901  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.077231  5066 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.077657  5066 ts_tablet_manager.cc:1403] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.209s	user 0.032s	sys 0.010s
I20260709 12:09:19.080492  5066 raft_consensus.cc:359] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.081506  5066 raft_consensus.cc:385] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.081779  5066 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.082415  5066 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.084249  5262 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.085230  5067 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.085619  5067 ts_tablet_manager.cc:1403] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.208s	user 0.021s	sys 0.007s
I20260709 12:09:19.085702  5066 ts_tablet_manager.cc:1434] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:09:19.086860  5066 tablet_bootstrap.cc:492] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:19.090858  5067 raft_consensus.cc:359] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.091312  5067 raft_consensus.cc:385] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.091503  5067 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.091998  5067 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.089521  5231 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.097893  5067 ts_tablet_manager.cc:1434] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:19.098716  5067 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.101739  4840 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.102466  5231 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.102833  4840 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.103549  5100 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.103879  4840 leader_election.cc:343] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.103116  5231 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:19.106786  5262 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.107787  5231 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.107111  4840 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.113490  5100 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.113507  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:19.115345  4988 leader_election.cc:343] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.119539  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:19.120075  4873 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.119747  4773 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.126904  4873 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:19.128960  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.129981  5266 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.130424  5266 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:19.131183  5266 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.132688  5067 tablet_bootstrap.cc:654] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.135819  5065 tablet_bootstrap.cc:654] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.138684  5100 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.139134  5100 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.141475  5100 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.144402  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:19.147291  4839 leader_election.cc:343] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.149376  5066 tablet_bootstrap.cc:654] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.156327  5067 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.156952  5067 ts_tablet_manager.cc:1403] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.004s
I20260709 12:09:19.161600  5262 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.162086  5262 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.163084  5067 raft_consensus.cc:359] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.163741  5067 raft_consensus.cc:385] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.164134  5262 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.164021  5067 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.165197  5067 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.167521  5067 ts_tablet_manager.cc:1434] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:19.168399  5067 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.169440  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.170979  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.174778  4773 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:19.185804  4840 leader_election.cc:343] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.186230  4840 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.187769  5231 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.191370  5067 tablet_bootstrap.cc:654] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.192884  4772 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.193972  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:19.199729  4840 consensus_peers.cc:597] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:19.201323  4991 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.202375  5190 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.202991  5065 tablet_bootstrap.cc:492] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:19.203411  5065 ts_tablet_manager.cc:1403] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.155s	user 0.020s	sys 0.008s
I20260709 12:09:19.206142  5066 tablet_bootstrap.cc:492] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.206552  5066 ts_tablet_manager.cc:1403] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.001s
I20260709 12:09:19.208995  5066 raft_consensus.cc:359] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.209590  5066 raft_consensus.cc:385] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.209821  5066 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.210474  5066 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.212396  5066 ts_tablet_manager.cc:1434] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:19.213286  5066 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:19.218631  5066 tablet_bootstrap.cc:654] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.221065  5231 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.221518  5231 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.222631  5065 raft_consensus.cc:359] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.223454  5231 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.223599  5065 raft_consensus.cc:385] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.223907  5065 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.224613  5065 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.225144  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.226480  5065 ts_tablet_manager.cc:1434] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
W20260709 12:09:19.227504  4839 leader_election.cc:343] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.228833  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:19.232797  4840 leader_election.cc:343] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.233206  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.233816  5231 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.234373  5065 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:19.239123  5100 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.244858  5067 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.245281  5067 ts_tablet_manager.cc:1403] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.012s
I20260709 12:09:19.247783  5067 raft_consensus.cc:359] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.253335  5067 raft_consensus.cc:385] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.259262  5067 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.259742  5065 tablet_bootstrap.cc:654] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.259858  5067 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.261662  5067 ts_tablet_manager.cc:1434] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:09:19.263593  5067 tablet_bootstrap.cc:492] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.269105  5067 tablet_bootstrap.cc:654] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.275756  5065 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:19.276170  5065 ts_tablet_manager.cc:1403] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 12:09:19.279534  5067 tablet_bootstrap.cc:492] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.279870  5067 ts_tablet_manager.cc:1403] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 12:09:19.280539  5066 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.280980  5066 ts_tablet_manager.cc:1403] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.002s
I20260709 12:09:19.281888  5067 raft_consensus.cc:359] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.282527  5067 raft_consensus.cc:385] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.282196  5065 raft_consensus.cc:359] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.282783  5067 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.282940  5065 raft_consensus.cc:385] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.283427  5065 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.283322  5066 raft_consensus.cc:359] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.283428  5067 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.284053  5066 raft_consensus.cc:385] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.284339  5066 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.284497  5065 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.285126  5066 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.286563  5065 ts_tablet_manager.cc:1434] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:19.287567  5065 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:19.292174  5231 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.292987  5065 tablet_bootstrap.cc:654] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.292618  5231 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.298556  5231 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.300048  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:19.301748  4840 leader_election.cc:343] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.302734  5066 ts_tablet_manager.cc:1434] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 12:09:19.303566  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:19.304958  4839 leader_election.cc:343] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.305401  4839 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.306823  5066 tablet_bootstrap.cc:492] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:19.306943  5231 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.311722  5067 ts_tablet_manager.cc:1434] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:09:19.312697  5067 tablet_bootstrap.cc:492] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.314960  5066 tablet_bootstrap.cc:654] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.319835  5066 tablet_bootstrap.cc:492] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.320214  5066 ts_tablet_manager.cc:1403] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:09:19.320323  5065 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:19.320837  5065 ts_tablet_manager.cc:1403] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.018s
I20260709 12:09:19.321728  4948 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.322533  5066 raft_consensus.cc:359] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.323163  5066 raft_consensus.cc:385] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.323421  5066 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.323596  5065 raft_consensus.cc:359] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.324770  5065 raft_consensus.cc:385] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.324160  5066 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.325129  5065 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.326009  5065 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.330621  5263 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.331918  5067 tablet_bootstrap.cc:654] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.342096  5066 ts_tablet_manager.cc:1434] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 12:09:19.352618  5066 tablet_bootstrap.cc:492] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:19.353969  5074 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.354395  5074 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.356319  5074 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.357604  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.363287  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.363809  4873 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:19.364418  5263 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.364951  4917 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.365535  5074 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.364434  5231 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.366122  5231 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.367975  5231 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.370129  5067 tablet_bootstrap.cc:492] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.370549  5067 ts_tablet_manager.cc:1403] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.013s
I20260709 12:09:19.370628  5065 ts_tablet_manager.cc:1434] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:09:19.371835  5065 tablet_bootstrap.cc:492] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:19.375532  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:19.376751  4840 leader_election.cc:343] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.378072  5067 raft_consensus.cc:359] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.378742  5067 raft_consensus.cc:385] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.379001  5067 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.379371  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.379621  5067 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.381397  5067 ts_tablet_manager.cc:1434] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260709 12:09:19.381560  4839 leader_election.cc:343] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.381981  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.382660  5245 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.382791  5066 tablet_bootstrap.cc:654] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.376341  5074 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.385653  5067 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.393040  5065 tablet_bootstrap.cc:654] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.393258  5067 tablet_bootstrap.cc:654] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.405485  5263 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.405957  5263 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.407977  5263 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.409536  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.411259  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:19.411540  4988 leader_election.cc:343] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.411870  4873 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.413030  5067 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.412925  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.413434  5067 ts_tablet_manager.cc:1403] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.014s
I20260709 12:09:19.413688  5065 tablet_bootstrap.cc:492] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:19.413959  5263 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.414080  5066 tablet_bootstrap.cc:492] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.414108  5065 ts_tablet_manager.cc:1403] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.008s
I20260709 12:09:19.414512  5263 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.414649  5066 ts_tablet_manager.cc:1403] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.001s
I20260709 12:09:19.414981  5263 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.415776  5067 raft_consensus.cc:359] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.416399  5067 raft_consensus.cc:385] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.416663  5067 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.416934  5065 raft_consensus.cc:359] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.417587  5065 raft_consensus.cc:385] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.417325  5066 raft_consensus.cc:359] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.417346  5067 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.417910  5065 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.418121  5066 raft_consensus.cc:385] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.418435  5066 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.418560  5065 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.419060  5066 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.421005  5066 ts_tablet_manager.cc:1434] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:19.423779  5067 ts_tablet_manager.cc:1434] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:09:19.424614  5066 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:19.424614  5067 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.430845  5067 tablet_bootstrap.cc:654] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.430845  5066 tablet_bootstrap.cc:654] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.433638  5065 ts_tablet_manager.cc:1434] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 12:09:19.437882  5263 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.440639  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:19.441176  4873 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.442157  5066 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.442548  5066 ts_tablet_manager.cc:1403] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 12:09:19.442763  5065 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:19.445188  5066 raft_consensus.cc:359] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.445983  5066 raft_consensus.cc:385] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.446244  5066 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.447073  5066 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.447870  5266 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.448071  4873 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:19.448333  5065 tablet_bootstrap.cc:654] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.448297  5266 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.451970  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:19.453315  5266 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.453826  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.454439  4872 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.456370  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.457017  4945 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.458596  5066 ts_tablet_manager.cc:1434] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:19.459564  5066 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
W20260709 12:09:19.461179  4988 leader_election.cc:343] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.463340  4991 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:19.464277  5266 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.464640  5266 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.464978  5266 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.465927  5066 tablet_bootstrap.cc:654] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.467029  5067 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.467438  5067 ts_tablet_manager.cc:1403] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.016s
I20260709 12:09:19.469601  5074 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.470057  5074 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.470745  5067 raft_consensus.cc:359] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.471385  5067 raft_consensus.cc:385] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.471648  5067 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.471930  5074 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.472345  5067 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.473623  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.475134  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.475637  5263 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.475881  5021 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:19.475059  5266 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.477342  4915 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.478291  5074 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.483361  5067 ts_tablet_manager.cc:1434] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:19.484319  5266 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.486377  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.488058  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:19.489123  4872 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.489068  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:19.489670  4948 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.492882  5067 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.495241  4872 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:19.498163  5074 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.498075  4991 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:19.498847  5262 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.499100  5067 tablet_bootstrap.cc:654] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.499383  5262 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:19.500850  5262 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.487233  5266 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.502926  5266 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:19.503089  5066 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.503749  5066 ts_tablet_manager.cc:1403] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.016s
I20260709 12:09:19.499040  4948 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:19.505429  5266 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.506537  5065 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:19.506738  5066 raft_consensus.cc:359] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.507599  5066 raft_consensus.cc:385] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.507859  5066 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.508755  5066 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.506945  5065 ts_tablet_manager.cc:1403] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.006s
I20260709 12:09:19.510653  5066 ts_tablet_manager.cc:1434] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:19.510874  5067 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.511227  5067 ts_tablet_manager.cc:1403] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:09:19.511417  5066 tablet_bootstrap.cc:492] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:19.512014  5231 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.512385  5065 raft_consensus.cc:359] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.513013  5065 raft_consensus.cc:385] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.513257  5065 raft_consensus.cc:740] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.513489  5067 raft_consensus.cc:359] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.514199  5067 raft_consensus.cc:385] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.514448  5067 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.515192  5067 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.517336  5066 tablet_bootstrap.cc:654] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.520697  5231 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.534039  5067 ts_tablet_manager.cc:1434] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:09:19.534874  5067 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.538839  4771 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.540423  5067 tablet_bootstrap.cc:654] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.543628  5066 tablet_bootstrap.cc:492] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.544106  5066 ts_tablet_manager.cc:1403] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.007s
I20260709 12:09:19.546590  5066 raft_consensus.cc:359] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.546782  5065 consensus_queue.cc:260] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.548738  5065 ts_tablet_manager.cc:1434] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.000s
I20260709 12:09:19.547214  5066 raft_consensus.cc:385] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.550482  5066 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.551085  5066 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.553270  5066 ts_tablet_manager.cc:1434] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:09:19.553838  5101 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.554261  5101 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.556130  5101 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.558748  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.554064  5066 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
W20260709 12:09:19.561831  4840 leader_election.cc:343] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.563524  5065 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:19.571030  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.571913  5066 tablet_bootstrap.cc:654] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.576889  4839 leader_election.cc:343] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.577306  4839 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.578128  5067 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.578437  5101 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.578598  5067 ts_tablet_manager.cc:1403] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.014s
I20260709 12:09:19.586364  5067 raft_consensus.cc:359] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.587049  5067 raft_consensus.cc:385] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.587318  5067 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.589476  5067 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.590680  5065 tablet_bootstrap.cc:654] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.591252  5067 ts_tablet_manager.cc:1434] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:09:19.592238  5067 tablet_bootstrap.cc:492] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.584998  5101 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.593152  5191 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.594653  5191 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.596486  5191 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.596954  5101 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.601017  5233 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.601449  5233 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.602312  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.603273  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.601588  5101 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:19.604525  4839 leader_election.cc:343] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.607259  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.607393  5191 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.607887  5191 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:19.608321  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.608036  5233 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:19.609381  4840 leader_election.cc:343] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.609769  4840 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.611395  5101 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.608994  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.613186  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.613729  5020 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:19.615592  4915 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:19.616353  5233 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.617012  5233 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.617420  5233 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.617645  5020 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.621763  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.620882  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.622437  4872 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 0.
I20260709 12:09:19.623232  5101 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.623660  5101 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.626025  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:19.627290  4839 leader_election.cc:343] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.629215  5191 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.631656  4772 catalog_manager.cc:5697] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.636011  5074 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.637367  5233 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.638525  5066 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.639607  5066 ts_tablet_manager.cc:1403] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.018s
I20260709 12:09:19.640425  5074 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.641496  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.642066  5066 raft_consensus.cc:359] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.644060  5066 raft_consensus.cc:385] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.644357  5066 raft_consensus.cc:740] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.644999  5066 consensus_queue.cc:260] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.646000  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.646397  5066 ts_tablet_manager.cc:1434] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:19.646694  4948 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 1: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:19.647261  5066 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:19.642843  5101 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.648615  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.647908  4872 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.649221  5019 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:19.649794  5191 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.654003  4840 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.655069  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:19.658301  4873 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.658931  5262 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.660543  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.661295  5262 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.661631  5262 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.661935  5262 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.663187  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5aa0 after lost signal to thread 3728
W20260709 12:09:19.664064  4972 debug-util.cc:398] Leaking SignalData structure 0x7b0800166620 after lost signal to thread 4808
W20260709 12:09:19.665093  4972 debug-util.cc:398] Leaking SignalData structure 0x7b0800249120 after lost signal to thread 4900
W20260709 12:09:19.665977  4972 debug-util.cc:398] Leaking SignalData structure 0x7b0800249960 after lost signal to thread 4975
W20260709 12:09:19.666862  4972 debug-util.cc:398] Leaking SignalData structure 0x7b0800223580 after lost signal to thread 5049
I20260709 12:09:19.658538  5101 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.669425  5101 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.669771  5101 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.671690  5024 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.673175  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:19.653200  5191 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.679257  5065 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:19.681346  5065 ts_tablet_manager.cc:1403] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.015s
I20260709 12:09:19.653512  5233 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.671597  4873 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:19.684667  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:19.685395  5238 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.686980  5066 tablet_bootstrap.cc:654] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.685845  5238 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:19.688642  5263 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.688959  5238 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.666882  5262 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.690054  5065 raft_consensus.cc:359] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.693642  5065 raft_consensus.cc:385] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.693866  5065 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.690032  5266 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.694588  5245 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.695046  5245 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.697345  5245 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.697885  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.698642  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:19.699205  4839 leader_election.cc:343] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.700646  5101 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.702270  5019 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:19.702749  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.703351  4945 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.703719  5262 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.693303  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.704336  4988 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:19.704773  4873 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.707109  5067 tablet_bootstrap.cc:654] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.707355  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:19.709024  5065 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.687496  5191 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:19.713130  4840 leader_election.cc:343] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.715220  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.715530  5065 ts_tablet_manager.cc:1434] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 12:09:19.713832  5262 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.719542  5100 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.719729  5262 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.720101  5262 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.720888  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:19.722803  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:19.724042  4839 leader_election.cc:343] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.721643  4873 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 1: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:19.727442  5065 tablet_bootstrap.cc:492] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:19.730878  5228 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.731220  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.731353  5228 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.732355  5191 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.732790  5191 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.733376  5228 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.733860  5228 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.734252  5228 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.734552  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.734655  5191 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.737740  5266 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.743165  4839 leader_election.cc:343] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.746169  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.746898  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:19.748241  4988 leader_election.cc:343] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.749423  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:19.749948  5022 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.749886  5245 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.744458  5101 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.755506  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.751705  4874 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.750469  5245 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:19.758415  4840 leader_election.cc:343] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.763199  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.762856  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.766010  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.766702  5065 tablet_bootstrap.cc:654] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.768929  5191 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.769311  5191 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.769623  5191 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.771552  5266 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.768426  5231 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.778033  5266 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:19.804056  4839 leader_election.cc:343] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.805645  5262 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.809172  5262 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.810456  5022 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:19.811882  4840 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.813732  5101 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.814024  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:19.814189  5101 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:19.814469  5266 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.814972  5101 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.816401  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:19.814566  4951 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.820242  4876 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.822558  5228 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.827304  4991 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:19.828215  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.828790  4945 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:19.829645  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.830138  5270 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.830482  5270 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.830813  5270 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.825850  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:19.832788  4840 leader_election.cc:343] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.833988  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.836033  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:19.838629  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:19.839740  5228 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.839697  5270 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:19.841152  4839 leader_election.cc:343] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.845393  4840 leader_election.cc:343] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.845675  4840 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:19.846263  5228 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.844980  5245 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:19.833199  4872 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.830801  5191 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.851539  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:19.852118  4873 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.853381  5067 tablet_bootstrap.cc:492] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:19.853775  5067 ts_tablet_manager.cc:1403] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.262s	user 0.008s	sys 0.020s
I20260709 12:09:19.870934  4951 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:19.872141  4988 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:19.872613  5065 tablet_bootstrap.cc:492] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:19.873083  5065 ts_tablet_manager.cc:1403] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.146s	user 0.004s	sys 0.016s
I20260709 12:09:19.873283  5263 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.874773  5263 raft_consensus.cc:697] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:19.875041  5067 raft_consensus.cc:359] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.875746  5067 raft_consensus.cc:385] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.875553  5263 consensus_queue.cc:237] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.876027  5067 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.876688  5067 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.877135  5065 raft_consensus.cc:359] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.877862  5065 raft_consensus.cc:385] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.878177  5065 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.880867  5270 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.878885  5067 ts_tablet_manager.cc:1434] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.001s
I20260709 12:09:19.881373  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:19.881886  4876 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.882117  5067 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:19.883665  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:19.884080  4771 catalog_manager.cc:5697] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.884830  4951 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.879022  5065 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:19.880285  5066 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:19.880028  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:19.890362  4988 leader_election.cc:343] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.890841  5066 ts_tablet_manager.cc:1403] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.244s	user 0.019s	sys 0.013s
I20260709 12:09:19.861413  4873 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:19.879113  5191 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:19.892198  4876 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:19.894623  5065 ts_tablet_manager.cc:1434] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:09:19.895426  5065 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:19.896221  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:19.897310  4991 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:19.898077  5263 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.898561  5263 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:19.898991  5191 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.914716  5191 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:19.990008  4773 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.993306  5270 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.005023  5191 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.000552  4951 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.007404  5065 tablet_bootstrap.cc:654] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.053129  5263 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.056887  5066 raft_consensus.cc:359] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.057667  5066 raft_consensus.cc:385] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.057971  5066 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.058714  5066 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.077503  5066 ts_tablet_manager.cc:1434] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.186s	user 0.018s	sys 0.027s
I20260709 12:09:20.078241  5066 tablet_bootstrap.cc:492] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.086884  5067 tablet_bootstrap.cc:654] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.081859  4872 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.112151  4945 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.116111  4773 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.120657  5263 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.120307  4773 catalog_manager.cc:5697] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.120685  5330 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.121941  4773 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.116066  5066 tablet_bootstrap.cc:654] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.126499  5190 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.130051  5067 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:20.130772  5067 ts_tablet_manager.cc:1403] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.249s	user 0.036s	sys 0.056s
I20260709 12:09:20.133296  5067 raft_consensus.cc:359] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.133972  5067 raft_consensus.cc:385] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.134375  5067 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.135141  5067 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.152196  5067 ts_tablet_manager.cc:1434] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:09:20.153194  5067 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:20.154613  5065 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:20.155043  5065 ts_tablet_manager.cc:1403] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.260s	user 0.006s	sys 0.010s
I20260709 12:09:20.160401  5065 raft_consensus.cc:359] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.161027  5065 raft_consensus.cc:385] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.161278  5065 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.162055  5065 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.164623  5065 ts_tablet_manager.cc:1434] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:09:20.167088  5066 tablet_bootstrap.cc:492] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.167510  5066 ts_tablet_manager.cc:1403] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.005s
I20260709 12:09:20.169433  5066 raft_consensus.cc:359] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.169852  5066 raft_consensus.cc:385] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.170054  5066 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.170545  5066 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.171744  5065 tablet_bootstrap.cc:492] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:20.172214  5066 ts_tablet_manager.cc:1434] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:09:20.172883  5066 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.178014  5066 tablet_bootstrap.cc:654] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.181322  5065 tablet_bootstrap.cc:654] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.192950  5067 tablet_bootstrap.cc:654] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.205194  5066 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.205605  5066 ts_tablet_manager.cc:1403] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.008s
I20260709 12:09:20.205641  5065 tablet_bootstrap.cc:492] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:20.206180  5065 ts_tablet_manager.cc:1403] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 12:09:20.208025  5066 raft_consensus.cc:359] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.208652  5066 raft_consensus.cc:385] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.208940  5066 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.208791  5065 raft_consensus.cc:359] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.209579  5065 raft_consensus.cc:385] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.209875  5065 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.209712  5066 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.210534  5065 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.214902  5066 ts_tablet_manager.cc:1434] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:09:20.215764  5066 tablet_bootstrap.cc:492] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.220981  5066 tablet_bootstrap.cc:654] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.234584  5065 ts_tablet_manager.cc:1434] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:09:20.236542  5074 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.239758  5067 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:20.240171  5067 ts_tablet_manager.cc:1403] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.028s
I20260709 12:09:20.242645  5067 raft_consensus.cc:359] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.243248  5067 raft_consensus.cc:385] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.243513  5067 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.244359  5065 tablet_bootstrap.cc:492] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:20.244177  5067 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.246382  5067 ts_tablet_manager.cc:1434] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.006s
I20260709 12:09:20.246906  5066 tablet_bootstrap.cc:492] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.247298  5066 ts_tablet_manager.cc:1403] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.007s
I20260709 12:09:20.247850  5067 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:20.250531  5065 tablet_bootstrap.cc:654] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.253254  5074 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.251726  5066 raft_consensus.cc:359] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.254477  5066 raft_consensus.cc:385] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.254746  5066 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.255421  5066 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.257718  5330 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.258147  5330 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.260048  5330 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.261579  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:20.262183  4876 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:20.262302  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.263434  4991 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:20.263895  4988 leader_election.cc:343] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.265178  5191 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.265549  5191 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.265872  5191 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.276522  5191 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.278956  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:20.279363  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:20.279474  4876 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.280441  5066 ts_tablet_manager.cc:1434] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
W20260709 12:09:20.280886  4988 leader_election.cc:343] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.281358  5066 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.284953  5191 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.287592  5066 tablet_bootstrap.cc:654] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.288492  5065 tablet_bootstrap.cc:492] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:20.288938  5065 ts_tablet_manager.cc:1403] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.004s
I20260709 12:09:20.293848  4876 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.294364  5065 raft_consensus.cc:359] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.294834  4991 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:20.295977  5191 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.296451  5191 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:20.297253  5191 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.297678  5245 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.298115  5245 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.300007  5245 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:20.300407  5066 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.300861  5066 ts_tablet_manager.cc:1403] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 12:09:20.301164  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:20.295011  5065 raft_consensus.cc:385] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.301692  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.302109  5065 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
W20260709 12:09:20.302618  4840 leader_election.cc:343] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.302834  5065 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:20.303139  4839 leader_election.cc:343] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.303385  5066 raft_consensus.cc:359] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.304015  5066 raft_consensus.cc:385] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.303844  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:20.304273  5066 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.305043  5065 ts_tablet_manager.cc:1434] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:20.304859  5066 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.304924  5245 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.306612  5065 tablet_bootstrap.cc:492] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:20.306865  5066 ts_tablet_manager.cc:1434] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:20.307763  5066 tablet_bootstrap.cc:492] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.312391  5067 tablet_bootstrap.cc:654] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.326375  5066 tablet_bootstrap.cc:654] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.339193  4773 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.345813  5330 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.349362  5245 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.349864  5245 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.356282  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.390338  5263 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.391134  5263 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.420173  5190 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.420624  5190 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.425109  5270 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.430874  5228 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.432971  5065 tablet_bootstrap.cc:654] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.433887  5190 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:20.435063  5346 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:09:20.441852  5067 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:20.442385  5067 ts_tablet_manager.cc:1403] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.195s	user 0.008s	sys 0.010s
I20260709 12:09:20.450322  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:20.450908  4874 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:20.443946  5263 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.451956  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:20.452661  5263 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.453009  5263 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.453316  5263 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.469174  4839 leader_election.cc:343] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.470901  5245 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:20.440846  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:20.479426  4873 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:20.480298  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:20.481660  5067 raft_consensus.cc:359] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.482312  5067 raft_consensus.cc:385] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.482620  5067 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.483289  5067 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.484692  5067 ts_tablet_manager.cc:1434] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.001s
I20260709 12:09:20.482009  5190 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.485141  5190 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.485450  5190 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.485567  5067 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:20.487304  5066 tablet_bootstrap.cc:492] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.487712  5066 ts_tablet_manager.cc:1403] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.001s
I20260709 12:09:20.493049  5066 raft_consensus.cc:359] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.493561  4949 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.482529  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:20.494220  5022 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:20.494881  5066 raft_consensus.cc:385] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.495155  5066 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.495823  5066 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.498324  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.498625  5262 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:20.499810  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 168423us
W20260709 12:09:20.500530  4988 leader_election.cc:343] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.501452  5067 tablet_bootstrap.cc:654] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.507583  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:20.508441  5245 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.508769  5245 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.509109  5245 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.510313  5066 ts_tablet_manager.cc:1434] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:09:20.511111  5066 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.512749  5101 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.497130  5263 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.513710  5191 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:20.514554  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.519384  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:20.519294  5190 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.537842  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:20.538455  4874 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.519833  5263 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.545499  4943 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:20.549424  5065 tablet_bootstrap.cc:492] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:20.549836  5065 ts_tablet_manager.cc:1403] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.243s	user 0.007s	sys 0.005s
I20260709 12:09:20.554349  5323 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.562721  5323 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.565613  5323 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:20.568691  5245 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.571614  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:20.574316  5190 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.574967  5065 raft_consensus.cc:359] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.575603  5065 raft_consensus.cc:385] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.575846  5065 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.583493  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:20.584731  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:20.585321  4869 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.588583  5065 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.593734  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:20.598721  5065 ts_tablet_manager.cc:1434] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.003s
I20260709 12:09:20.599357  5065 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:20.600167  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:20.601667  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:20.602174  5020 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.594856  5245 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:20.608762  4874 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.611169  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:20.611645  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:20.613021  5266 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.613525  5266 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:20.614262  5266 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.614717  5262 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.616468  5233 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.624233  5231 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:20.624621  4988 leader_election.cc:343] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.624691  5231 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.611649  4869 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.650606  5231 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:20.651975  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:20.657397  4840 leader_election.cc:343] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.658756  4942 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.663663  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:20.665012  5262 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.665505  5262 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:20.652552  5020 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
W20260709 12:09:20.668462  4839 leader_election.cc:343] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.668363  4773 catalog_manager.cc:5697] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.673467  5066 tablet_bootstrap.cc:654] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.673897  5065 tablet_bootstrap.cc:654] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.675722  5067 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:20.676131  5067 ts_tablet_manager.cc:1403] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.025s
I20260709 12:09:20.677098  5262 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.683954  5266 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.686380  5067 raft_consensus.cc:359] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.687215  5067 raft_consensus.cc:385] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.687527  5067 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.688521  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:20.688469  5067 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.689622  5231 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.690373  5231 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:20.691843  5067 ts_tablet_manager.cc:1434] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:09:20.692557  5067 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:20.693892  5231 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.694649  5066 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.695111  5066 ts_tablet_manager.cc:1403] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.003s
I20260709 12:09:20.680117  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:20.705071  4839 leader_election.cc:343] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.705471  4839 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:20.706594  5357 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.714546  5066 raft_consensus.cc:359] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.715432  5066 raft_consensus.cc:385] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.715688  5190 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.716131  5190 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.719794  5190 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.715688  5066 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.727290  4773 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.728235  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:20.729907  4876 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:20.730454  5066 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.728974  5357 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.732399  5066 ts_tablet_manager.cc:1434] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 12:09:20.732686  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:20.731863  5357 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.733987  5245 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.734063  5330 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.734489  5330 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.734794  5330 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.735858  5066 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.737989  5065 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:20.738413  5065 ts_tablet_manager.cc:1403] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.139s	user 0.007s	sys 0.008s
I20260709 12:09:20.733621  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.734519  5245 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.747997  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.749919  5067 tablet_bootstrap.cc:654] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:20.755283  4839 leader_election.cc:343] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.755724  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:20.757476  5065 raft_consensus.cc:359] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:20.758056  4988 leader_election.cc:343] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.757576  4840 leader_election.cc:343] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.746681  5357 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:20.758159  5065 raft_consensus.cc:385] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.761912  5065 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.762176  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:20.762583  5065 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.763134  5330 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.764494  5065 ts_tablet_manager.cc:1434] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.003s
I20260709 12:09:20.759440  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:20.765007  5330 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:20.765573  4840 leader_election.cc:343] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.756421  5245 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:20.766206  5245 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.761438  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.766835  5263 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.768110  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:20.768265  4839 leader_election.cc:343] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.768709  4873 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.768750  4839 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:20.772006  5357 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.773401  4771 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.778580  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:20.779228  4942 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.774856  5065 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
W20260709 12:09:20.799772  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:20.810674  5066 tablet_bootstrap.cc:654] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.819358  5330 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.819449  4942 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.819870  5330 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.826365  5065 tablet_bootstrap.cc:654] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.806082  4873 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.830844  5330 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.833441  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:20.841599  4988 consensus_peers.cc:597] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.841703  5067 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:20.838768  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.842506  5067 ts_tablet_manager.cc:1403] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.150s	user 0.020s	sys 0.013s
I20260709 12:09:20.843232  5262 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.839000  5263 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.842833  4946 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:20.845167  5263 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:20.845954  5263 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.846351  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:20.847409  5330 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.847748  5330 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.842144  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:20.848049  5330 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.852202  5067 raft_consensus.cc:359] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.852663  5067 raft_consensus.cc:385] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.852891  5067 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.843629  5262 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.853581  5067 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.854681  5262 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.855522  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:20.856248  4869 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:20.857154  5066 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.856613  5330 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.857280  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:20.858052  5262 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.855574  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.858431  5262 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.848225  4873 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
W20260709 12:09:20.859423  4988 leader_election.cc:343] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.859372  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:20.860141  4876 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.859550  5330 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.861102  5066 ts_tablet_manager.cc:1403] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.001s
I20260709 12:09:20.858894  5262 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.862695  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:20.870620  4876 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.871227  4946 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.871737  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:20.872731  5330 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.873376  5330 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:20.874032  5262 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.874097  5330 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.875962  5262 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.877141  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:20.885751  4876 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.876189  5066 raft_consensus.cc:359] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.886976  5066 raft_consensus.cc:385] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.887307  5066 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.883160  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:20.892508  4988 leader_election.cc:343] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.893249  5066 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.894424  5067 ts_tablet_manager.cc:1434] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 12:09:20.897300  5067 tablet_bootstrap.cc:492] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:20.897367  5066 ts_tablet_manager.cc:1434] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:09:20.898157  5066 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.899024  5065 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:20.899428  5065 ts_tablet_manager.cc:1403] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.125s	user 0.006s	sys 0.013s
I20260709 12:09:20.911123  5066 tablet_bootstrap.cc:654] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.919750  5263 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.904157  5065 raft_consensus.cc:359] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.931851  5065 raft_consensus.cc:385] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.931524  5263 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.932128  5065 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.912954  4946 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.932775  5065 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.933992  5263 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.904981  4876 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.934840  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:20.900627  4772 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:20.935910  4988 leader_election.cc:343] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.937362  5065 ts_tablet_manager.cc:1434] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.003s
I20260709 12:09:20.938198  5065 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:20.939689  5066 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.940088  5066 ts_tablet_manager.cc:1403] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.017s
I20260709 12:09:20.942482  5066 raft_consensus.cc:359] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.943055  5066 raft_consensus.cc:385] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.943305  5066 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.943847  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:20.943873  5066 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.944901  5263 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.945338  5263 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:20.946127  5066 ts_tablet_manager.cc:1434] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:20.946084  5263 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.946969  5066 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.951710  5065 tablet_bootstrap.cc:654] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.952203  5066 tablet_bootstrap.cc:654] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.934046  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:20.952893  4869 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:20.954524  4991 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:20.955528  5262 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.955878  5262 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.956184  5262 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.928306  5067 tablet_bootstrap.cc:654] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.965052  4772 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.967211  5065 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:20.968326  5262 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.969300  5065 ts_tablet_manager.cc:1403] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.007s
I20260709 12:09:20.971168  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:20.971771  4869 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.971673  5065 raft_consensus.cc:359] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.973873  5065 raft_consensus.cc:385] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.974125  5065 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.974702  5065 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.978471  5262 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:20.979377  5067 tablet_bootstrap.cc:492] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:20.979440  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:20.979874  5067 ts_tablet_manager.cc:1403] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 12:09:20.981726  5065 ts_tablet_manager.cc:1434] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 12:09:20.982234  4869 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:20.982612  5067 raft_consensus.cc:359] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.983179  5066 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:20.983207  5067 raft_consensus.cc:385] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.983675  5066 ts_tablet_manager.cc:1403] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.023s
I20260709 12:09:20.983633  5067 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.984370  5067 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.984820  4991 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:20.985646  5262 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.986121  5066 raft_consensus.cc:359] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.986364  5262 raft_consensus.cc:697] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:20.986516  5067 ts_tablet_manager.cc:1434] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:09:20.986737  5066 raft_consensus.cc:385] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.987028  5066 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.987589  5067 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:20.987344  5262 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.987638  5066 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:20.989774  5066 ts_tablet_manager.cc:1434] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:09:20.990597  5066 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:20.995556  5067 tablet_bootstrap.cc:654] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.999199  5066 tablet_bootstrap.cc:654] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:20.999572  4988 leader_election.cc:343] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.005497  5067 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:21.005879  5067 ts_tablet_manager.cc:1403] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:09:21.008168  5067 raft_consensus.cc:359] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.008755  5067 raft_consensus.cc:385] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.009020  5067 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.009594  5067 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.011674  5067 ts_tablet_manager.cc:1434] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:21.012473  5067 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:21.015219  5066 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:21.015677  5066 ts_tablet_manager.cc:1403] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.007s
I20260709 12:09:21.018141  5067 tablet_bootstrap.cc:654] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.018081  5066 raft_consensus.cc:359] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.019002  5066 raft_consensus.cc:385] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.019309  5066 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.019958  5066 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.022840  5066 ts_tablet_manager.cc:1434] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:21.023659  5066 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:21.027011  4772 catalog_manager.cc:5697] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.028771  5067 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:21.028895  5066 tablet_bootstrap.cc:654] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.028904  5065 tablet_bootstrap.cc:492] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:21.028630  4772 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.029264  5067 ts_tablet_manager.cc:1403] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:09:21.032184  5067 raft_consensus.cc:359] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.032784  5067 raft_consensus.cc:385] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.033324  5067 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.034026  5067 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.035218  5065 tablet_bootstrap.cc:654] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.035871  5067 ts_tablet_manager.cc:1434] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:09:21.036698  5067 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:21.041790  5067 tablet_bootstrap.cc:654] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.047643  5066 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:21.048065  5066 ts_tablet_manager.cc:1403] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 12:09:21.050561  5066 raft_consensus.cc:359] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.051189  5066 raft_consensus.cc:385] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.051479  5066 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.052146  5066 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.054167  5066 ts_tablet_manager.cc:1434] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:21.055022  5066 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:21.059128  5262 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.060447  5066 tablet_bootstrap.cc:654] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.059682  5262 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.065402  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:21.066022  4869 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:21.066982  4991 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:21.067759  5330 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.068115  5330 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.068430  5330 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.072585  5066 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:21.073660  5066 ts_tablet_manager.cc:1403] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:09:21.077584  5190 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.077634  5270 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.077059  5066 raft_consensus.cc:359] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.079996  5066 raft_consensus.cc:385] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.087750  5066 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.088752  5066 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.084820  5330 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.092249  5066 ts_tablet_manager.cc:1434] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:09:21.115530  5066 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:21.093483  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:21.117215  4873 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.123526  5065 tablet_bootstrap.cc:492] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:21.123842  4873 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:21.125708  4991 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:21.126415  5263 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.126858  5263 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:21.127596  5263 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.098675  5262 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:21.106128  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:21.107793  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:21.111253  5245 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.124019  5065 ts_tablet_manager.cc:1403] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.000s
I20260709 12:09:21.099771  5330 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:21.139309  5067 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:21.139710  5067 ts_tablet_manager.cc:1403] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.103s	user 0.060s	sys 0.032s
W20260709 12:09:21.142477  4988 leader_election.cc:343] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.132534  5245 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.143355  5067 raft_consensus.cc:359] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.143996  5067 raft_consensus.cc:385] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.144245  5067 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.145033  5245 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.144923  5067 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:21.145504  4988 consensus_peers.cc:597] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.146044  5065 raft_consensus.cc:359] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.148969  5065 raft_consensus.cc:385] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.149188  5065 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.149693  5065 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.146327  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:21.153612  4839 leader_election.cc:343] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.212316  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 58739.3us
I20260709 12:09:21.217334  5065 ts_tablet_manager.cc:1434] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.018s
I20260709 12:09:21.218305  5065 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:21.218883  5066 tablet_bootstrap.cc:654] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.222312  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:21.230062  5067 ts_tablet_manager.cc:1434] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 12:09:21.231019  5067 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:21.215895  5245 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.233649  5245 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.235579  5245 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.235932  5238 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.237442  5323 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.237903  5323 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.239720  5323 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.154932  4947 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.240314  5330 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.240834  5330 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:21.241323  4840 leader_election.cc:343] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.241698  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:21.236397  5238 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.243193  5190 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.243686  5190 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.244302  5238 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.244544  5245 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.245528  5190 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:21.214862  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 61277.5us
I20260709 12:09:21.255366  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:21.268105  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:21.271443  4869 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:21.261484  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:21.272485  5022 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:21.273459  5330 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:21.271469  5357 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.274557  5231 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.282765  4840 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:21.282985  5357 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.283546  5231 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.283932  5231 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.284245  5231 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.284929  5357 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:21.286187  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 70372.2us
I20260709 12:09:21.288437  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:21.289594  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:21.297102  4869 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:21.310791  5067 tablet_bootstrap.cc:654] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.315325  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:21.324800  4991 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:21.326424  5262 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.326761  5262 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.327073  5262 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.329253  4773 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:21.330901  4840 leader_election.cc:343] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.333722  5231 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.334787  4873 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:21.336298  5231 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.336474  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:21.340487  5021 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.342195  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:21.348685  5390 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.349232  5390 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.351171  5390 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.355508  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:21.348722  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:21.358660  4915 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:21.358954  5065 tablet_bootstrap.cc:654] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.362342  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:21.362617  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:21.363214  5330 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.364156  4951 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.369338  5021 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:21.370358  4840 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:21.371029  5231 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.371687  5231 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:21.372989  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:21.373603  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:21.374239  5262 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.376730  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:21.377290  4876 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.377899  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:21.378705  5330 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.372466  5231 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.380921  5357 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.381247  5357 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.382932  5357 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.382983  5330 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:21.383569  4839 leader_election.cc:343] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.384847  4839 leader_election.cc:343] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.385280  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:21.372462  5066 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:21.388828  5066 ts_tablet_manager.cc:1403] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.273s	user 0.020s	sys 0.020s
I20260709 12:09:21.393906  5330 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.394301  5245 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.394799  5067 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:21.395249  5067 ts_tablet_manager.cc:1403] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.007s
I20260709 12:09:21.395598  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:21.396669  4988 leader_election.cc:343] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.397148  4840 leader_election.cc:343] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.403369  4988 leader_election.cc:343] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.403812  4988 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:21.409022  5190 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.403970  5245 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:21.404898  5390 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.415062  5067 raft_consensus.cc:359] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.415733  5067 raft_consensus.cc:385] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.415977  5067 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.405083  5357 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:21.403549  4839 leader_election.cc:343] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.417832  5067 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.406621  5270 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.413089  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:21.408085  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49497.4us
I20260709 12:09:21.428328  5065 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:21.428764  5065 ts_tablet_manager.cc:1403] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.211s	user 0.014s	sys 0.000s
I20260709 12:09:21.431115  5065 raft_consensus.cc:359] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.431689  5065 raft_consensus.cc:385] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.431926  5065 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.432507  5065 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.423465  5262 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:21.441342  5065 ts_tablet_manager.cc:1434] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:21.443362  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:21.422417  5357 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.486343  5357 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.487260  5262 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.487737  5262 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.491284  5065 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:21.489562  5392 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.501255  5392 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.503080  5392 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:21.524129  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:21.524588  4873 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:21.496654  5238 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.542793  4991 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:21.601678  5067 ts_tablet_manager.cc:1434] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.206s	user 0.008s	sys 0.041s
I20260709 12:09:21.602656  5067 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
W20260709 12:09:21.514885  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 80708.3us
I20260709 12:09:21.613903  5270 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.614364  5270 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.623868  4876 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
W20260709 12:09:21.627169  5402 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:09:21.630452  5330 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.630829  5330 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.631150  5330 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.634999  5399 log.cc:927] Time spent T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:09:21.638545  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:21.673655  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 268144us
I20260709 12:09:21.732874  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:21.860213  4988 leader_election.cc:343] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.122988  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 262792us
I20260709 12:09:22.127460  5400 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.130466  4949 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.120942  5066 raft_consensus.cc:359] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.133314  5066 raft_consensus.cc:385] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.135802  5404 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.141845  5404 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.777644  5390 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:22.138909  4946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.014s
I20260709 12:09:22.142918  5066 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
W20260709 12:09:21.558693  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 125047us
I20260709 12:09:21.975739  5357 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:22.151242  4988 consensus_peers.cc:597] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.151161  5066 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:21.825327  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:21.786568  4951 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.734032  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:21.737962  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:21.893081  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:22.151543  4946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.007s	sys 0.014s
I20260709 12:09:21.836403  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:22.107733  5330 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:22.173780  4988 leader_election.cc:343] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.174422  4988 leader_election.cc:343] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.178826  5065 tablet_bootstrap.cc:654] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.155757  5357 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.181610  5066 ts_tablet_manager.cc:1434] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.793s	user 0.027s	sys 0.022s
W20260709 12:09:22.181850  5066 ts_tablet_manager.cc:1467] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Tablet startup took 792ms
W20260709 12:09:22.182792  5066 ts_tablet_manager.cc:1469] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Trace:
0709 12:09:16.005797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:16.025734 (+ 19937us) service_pool.cc:224] Handling call
0709 12:09:16.079284 (+ 53550us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:16.079368 (+    84us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:16.133114 (+ 53746us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:16.173452 (+ 40338us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:16.186282 (+ 12830us) inbound_call.cc:177] Queueing success response
0709 12:09:21.115227 (+4928945us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:09:21.389073 (+273846us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:09:21.521952 (+132879us) tablet_replica.cc:261] Starting instrumentation
0709 12:09:21.522423 (+   471us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":25221,"raft.queue_time_us":3432,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2742,"tablet-open.queue_time_us":4930842}
I20260709 12:09:22.184783  5066 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
W20260709 12:09:22.192605  4840 leader_election.cc:343] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.195603  5262 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:22.197839  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:22.199779  5270 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:22.231467  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.242549  5357 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:22.244045  5067 tablet_bootstrap.cc:654] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.261231  5066 tablet_bootstrap.cc:654] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.273383  4839 leader_election.cc:343] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.273828  4839 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:22.275094  4839 leader_election.cc:343] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.275482  4839 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:22.263494  4773 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.262372  5330 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:22.279915  5411 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.291091  5403 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.300112  5190 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.297673  5404 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:22.303313  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:22.303900  5018 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:22.305570  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:22.310608  4840 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:22.311578  4840 leader_election.cc:343] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.296731  5389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.017s	sys 0.022s
I20260709 12:09:22.323441  5190 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.324612  5401 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.324999  5401 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.325304  5401 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.325390  5190 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:22.326684  5389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.017s	sys 0.022s
I20260709 12:09:22.330499  5067 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:22.330991  5067 ts_tablet_manager.cc:1403] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.729s	user 0.018s	sys 0.016s
I20260709 12:09:22.351647  5067 raft_consensus.cc:359] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.352322  5067 raft_consensus.cc:385] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.353248  5067 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.354197  5067 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.337000  5245 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:09:22.366369  5065 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
W20260709 12:09:22.433386  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 151678us
I20260709 12:09:22.464092  5067 ts_tablet_manager.cc:1434] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.133s	user 0.004s	sys 0.003s
I20260709 12:09:22.499004  5067 tablet_bootstrap.cc:492] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:22.475170  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:22.501854  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:22.475912  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:22.502730  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:22.483947  5066 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
W20260709 12:09:22.468086  4988 consensus_peers.cc:597] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.482995  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:22.503963  4868 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.504084  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:22.504702  4870 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:22.431998  5401 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.387770  4991 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:22.401294  5323 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:22.510279  5323 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.510820  5401 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:22.512682  4839 leader_election.cc:343] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.513127  4839 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:22.460881  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:22.513693  5401 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.514273  4874 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:22.504733  5410 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:22.496773  5065 ts_tablet_manager.cc:1403] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 1.006s	user 0.028s	sys 0.077s
I20260709 12:09:22.503571  5066 ts_tablet_manager.cc:1403] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.319s	user 0.013s	sys 0.025s
W20260709 12:09:22.517693  4839 leader_election.cc:343] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.518683  4839 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.519315  5065 raft_consensus.cc:359] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.519979  5065 raft_consensus.cc:385] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.520220  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:22.431975  4915 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:22.529659  5238 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:22.530400  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 98518.2us
I20260709 12:09:22.530651  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:22.531301  5022 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.522248  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 134557us
I20260709 12:09:22.533367  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:22.534212  5238 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.522560  5190 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.535230  5190 raft_consensus.cc:697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:22.533458  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:22.536090  5190 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.530786  5065 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.528142  5404 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.540511  5416 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:22.525211  4988 leader_election.cc:343] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.542032  5067 tablet_bootstrap.cc:654] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.541688  5389 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:22.544315  5404 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.539505  5323 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:22.537348  5066 raft_consensus.cc:359] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.546191  5066 raft_consensus.cc:385] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.546559  5404 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:22.547189  4839 leader_election.cc:343] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.547674  5066 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.547765  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:22.549393  5066 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:22.548125  4988 leader_election.cc:343] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.550396  5065 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.552402  5065 ts_tablet_manager.cc:1434] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.002s
I20260709 12:09:22.556476  4951 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.560981  5065 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:22.565352  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:22.566021  4948 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:22.569181  5022 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:22.570813  4840 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:22.575238  4839 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:22.576943  5245 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:22.577284  5245 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.577625  5245 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:22.580981  5066 ts_tablet_manager.cc:1434] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:09:22.581840  5066 tablet_bootstrap.cc:492] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:22.540613  4868 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:22.584391  4991 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:22.586550  4991 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:22.592712  5388 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.583058  5357 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.608335  4991 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:22.593918  5411 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.592170  5262 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.616039  5066 tablet_bootstrap.cc:654] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.613297  5411 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.593765  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:22.596844  5357 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:22.616446  5262 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.615675  5410 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.624334  5410 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:22.623939  5262 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.645427  4915 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:22.626525  5410 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.646456  5390 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.626737  5357 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.715040  5245 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.716619  4875 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:09:22.755052  5262 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.796528  5245 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:22.797891  5262 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:22.810074  5412 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.810583  5412 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.813337  5410 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.814204  5410 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:22.814577  5410 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:22.815464  5410 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.812602  5412 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:22.816587  5410 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:22.823513  5411 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:22.826408  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:22.827057  5065 tablet_bootstrap.cc:654] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.829005  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:22.830719  4870 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.832072  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:22.833141  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:22.834187  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:22.857534  4771 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.840180  4870 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
W20260709 12:09:22.853816  4839 leader_election.cc:343] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.878599  5067 tablet_bootstrap.cc:492] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:22.878923  5067 ts_tablet_manager.cc:1403] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.380s	user 0.031s	sys 0.032s
I20260709 12:09:22.882460  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:22.883072  4839 leader_election.cc:343] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.883044  5019 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:22.887634  5067 raft_consensus.cc:359] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.889134  5067 raft_consensus.cc:385] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.889331  5067 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.889796  5067 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.890856  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:22.893822  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:22.899154  5017 raft_consensus.cc:2410] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:09:22.908061  5066 tablet_bootstrap.cc:492] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:22.908485  5066 ts_tablet_manager.cc:1403] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.327s	user 0.013s	sys 0.007s
W20260709 12:09:22.913960  4840 leader_election.cc:343] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.914353  4840 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:22.915329  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:22.914354  5067 ts_tablet_manager.cc:1434] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.002s
I20260709 12:09:22.916497  5067 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:22.917765  5245 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.918370  5245 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.918746  5245 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.919050  5245 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.920076  5066 raft_consensus.cc:359] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.920693  5066 raft_consensus.cc:385] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.920984  5066 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.921582  5066 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.923493  5066 ts_tablet_manager.cc:1434] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:09:22.924325  5066 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
W20260709 12:09:22.925047  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47551.3us
I20260709 12:09:22.925369  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:22.920789  4988 leader_election.cc:343] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.926180  4991 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:22.926673  5412 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.930804  4772 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.935974  5416 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.939107  5245 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.941037  5245 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:22.942318  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:22.950022  5416 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:09:22.946177  4839 leader_election.cc:343] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.950856  5416 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.967908  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:22.968472  5019 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.969807  5065 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:22.970245  5065 ts_tablet_manager.cc:1403] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.410s	user 0.022s	sys 0.008s
I20260709 12:09:22.972642  5065 raft_consensus.cc:359] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.973271  5065 raft_consensus.cc:385] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.973522  5065 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.974220  5065 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:22.976475  5065 ts_tablet_manager.cc:1434] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:22.977259  5065 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:22.993870  5067 tablet_bootstrap.cc:654] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.999572  5066 tablet_bootstrap.cc:654] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.001824  5065 tablet_bootstrap.cc:654] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.003453  5019 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:23.006181  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:23.006906  5357 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.007344  5357 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:23.008095  5357 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.013025  4771 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.016692  4771 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.040670  5066 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:23.041139  5066 ts_tablet_manager.cc:1403] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.011s
I20260709 12:09:23.044126  5066 raft_consensus.cc:359] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.044723  5066 raft_consensus.cc:385] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.044991  5066 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.045836  5066 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.047715  5066 ts_tablet_manager.cc:1434] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:23.048501  5066 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:23.052117  5067 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:23.052529  5067 ts_tablet_manager.cc:1403] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.009s
I20260709 12:09:23.054932  5067 raft_consensus.cc:359] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.055534  5067 raft_consensus.cc:385] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.055789  5067 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.057904  5065 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:23.058321  5065 ts_tablet_manager.cc:1403] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.012s
I20260709 12:09:23.059633  4771 catalog_manager.cc:5697] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.060716  5065 raft_consensus.cc:359] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.061381  5065 raft_consensus.cc:385] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.061637  5065 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.062247  5065 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.076248  5067 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.084844  5066 tablet_bootstrap.cc:654] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.099495  5067 ts_tablet_manager.cc:1434] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:09:23.101974  5065 ts_tablet_manager.cc:1434] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 12:09:23.102828  5065 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:23.108283  5065 tablet_bootstrap.cc:654] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.100484  5067 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:23.111353  5066 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:23.111753  5066 ts_tablet_manager.cc:1403] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.001s
I20260709 12:09:23.114199  5066 raft_consensus.cc:359] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.114820  5066 raft_consensus.cc:385] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.115072  5066 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.115662  5066 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.116739  5067 tablet_bootstrap.cc:654] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.129033  5066 ts_tablet_manager.cc:1434] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:23.129973  5066 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:23.138124  5065 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:23.138614  5065 ts_tablet_manager.cc:1403] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.005s
I20260709 12:09:23.141090  5065 raft_consensus.cc:359] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.141747  5065 raft_consensus.cc:385] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.142040  5065 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.142704  5065 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.144661  5065 ts_tablet_manager.cc:1434] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:23.145484  5065 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:23.148064  5416 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.150647  5323 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.151103  5323 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.157656  5323 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.159125  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:23.162310  5065 tablet_bootstrap.cc:654] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.164507  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.165325  4869 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:09:23.166954  4988 consensus_peers.cc:597] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.168661  4917 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:23.169677  5390 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.171173  4988 consensus_peers.cc:597] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:23.175259  5245 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.175710  5245 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.176705  5390 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.177630  5245 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.178303  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:23.180716  4839 leader_election.cc:343] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.178776  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:23.183954  4840 leader_election.cc:343] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.184499  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:23.185226  5245 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.190131  5066 tablet_bootstrap.cc:654] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.193267  5390 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.193696  5390 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.200130  5390 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.202764  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.203469  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:23.204201  5019 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:23.207774  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:23.207988  4947 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.222409  5266 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.222855  5266 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.224380  5067 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:23.224795  5067 ts_tablet_manager.cc:1403] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.023s
I20260709 12:09:23.225831  5390 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.227324  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.227893  4868 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:23.229848  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:23.230106  5067 raft_consensus.cc:359] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.230765  5067 raft_consensus.cc:385] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.231007  5067 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.231177  5416 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.231346  5065 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:23.231803  5065 ts_tablet_manager.cc:1403] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.017s
I20260709 12:09:23.233323  5067 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.234195  5245 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.234184  5065 raft_consensus.cc:359] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.235975  5066 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:23.236568  5066 ts_tablet_manager.cc:1403] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.107s	user 0.003s	sys 0.007s
I20260709 12:09:23.238823  5066 raft_consensus.cc:359] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.239409  5066 raft_consensus.cc:385] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.239636  5066 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.240185  5066 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.242061  5066 ts_tablet_manager.cc:1434] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:23.242365  5065 raft_consensus.cc:385] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.242614  5065 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.243216  5065 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.245385  5065 ts_tablet_manager.cc:1434] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:09:23.246227  5066 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:23.249203  5416 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.249579  5416 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.249749  5067 ts_tablet_manager.cc:1434] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:09:23.254658  5065 tablet_bootstrap.cc:492] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:23.258049  5323 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.258168  5266 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.263592  5067 tablet_bootstrap.cc:492] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:23.258499  5323 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.267161  5403 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.267580  5403 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.268397  5323 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.273510  5403 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.273716  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.279877  5066 tablet_bootstrap.cc:654] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.290023  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:23.285729  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:23.291457  4839 leader_election.cc:343] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.292868  4988 leader_election.cc:343] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.297039  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:23.298382  4840 leader_election.cc:343] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.298805  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:23.299528  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.299774  5403 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.293088  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:23.301947  5024 raft_consensus.cc:2393] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:23.307421  4915 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:23.308179  5390 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.316094  5390 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.316179  4950 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.316507  5416 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.321359  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:23.321983  4869 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.327610  5065 tablet_bootstrap.cc:654] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.332649  5388 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.343832  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:23.345037  4988 leader_election.cc:343] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.345621  5245 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.346074  5245 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.348963  5067 tablet_bootstrap.cc:654] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.335868  5416 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.361446  5403 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.374946  4869 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:23.376734  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:23.361662  5266 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.381385  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:23.385032  5266 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.387048  5266 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.382980  5450 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.388031  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:23.388520  5450 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:23.389346  5450 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.396553  5357 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.399293  5262 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.402844  5245 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.381587  5403 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:23.404848  4839 leader_election.cc:343] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.407382  5065 tablet_bootstrap.cc:492] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:23.407809  5065 ts_tablet_manager.cc:1403] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.015s
I20260709 12:09:23.411327  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.423185  4875 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:23.426162  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:23.427512  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:23.428076  5024 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:23.428181  5403 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.429423  4991 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:23.432567  5416 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.432934  5416 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.433243  5416 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.438506  5412 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.438635  4840 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:23.439455  5403 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.439803  5403 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.440141  5403 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.430433  4839 leader_election.cc:343] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.442806  5451 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.453126  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:23.454344  4840 leader_election.cc:343] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.454723  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:23.455559  5245 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.473456  5388 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.469264  5416 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.475492  5388 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.465905  5403 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.498710  5388 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.496745  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.500604  4872 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:23.502521  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:23.506779  4988 leader_election.cc:343] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.508109  5190 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.508529  5190 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.510406  5190 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.510701  5065 raft_consensus.cc:359] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.511330  5065 raft_consensus.cc:385] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.511590  5065 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.512157  5065 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.520501  4991 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:23.523947  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.524521  4872 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:23.524559  5451 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.528298  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:23.529604  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:23.529592  5451 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.537861  5451 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.545892  5066 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:23.546353  5066 ts_tablet_manager.cc:1403] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.300s	user 0.021s	sys 0.050s
I20260709 12:09:23.553362  5065 ts_tablet_manager.cc:1434] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.145s	user 0.015s	sys 0.003s
I20260709 12:09:23.573947  5403 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.575949  5065 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
W20260709 12:09:23.578984  5473 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:09:23.580296  5066 raft_consensus.cc:359] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.581751  5066 raft_consensus.cc:385] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.582507  5066 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.548933  5450 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.584314  5066 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.584762  5450 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.598423  5066 ts_tablet_manager.cc:1434] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:09:23.599300  5066 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:23.586341  5190 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.602370  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:23.607344  4988 leader_election.cc:343] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.605376  4772 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.609663  5017 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:23.611141  5067 tablet_bootstrap.cc:492] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:23.611478  5067 ts_tablet_manager.cc:1403] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.355s	user 0.008s	sys 0.007s
I20260709 12:09:23.601119  5450 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.607383  5416 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.614200  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:23.608062  5190 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.614849  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:23.620427  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:23.628068  5403 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:23.635298  4868 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:23.635030  5067 raft_consensus.cc:359] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.635696  5067 raft_consensus.cc:385] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.635952  5067 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.638960  4988 leader_election.cc:343] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.636551  5067 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:23.639699  4839 leader_election.cc:343] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.640096  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:23.646358  5245 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.654793  4991 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:23.661978  5388 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.670107  5067 ts_tablet_manager.cc:1434] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.003s
I20260709 12:09:23.676025  5065 tablet_bootstrap.cc:654] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.676422  5190 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.682016  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.682608  4872 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:23.683710  4991 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:23.685120  5388 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.685477  5388 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.685782  5388 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.637990  5451 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:23.692332  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 52495.2us
I20260709 12:09:23.694141  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:23.698312  5388 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.699256  5451 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.699930  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:23.702368  4869 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.705358  4988 leader_election.cc:343] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.708734  5478 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.705502  5067 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:23.709263  5478 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.707214  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:23.728416  5478 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.729254  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.731940  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:23.733521  4872 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:23.734365  4917 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:23.735796  5477 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.735384  4869 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:23.738142  4991 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:23.740033  5065 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:23.740502  5065 ts_tablet_manager.cc:1403] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.186s	user 0.013s	sys 0.004s
I20260709 12:09:23.743211  5065 raft_consensus.cc:359] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.743983  5065 raft_consensus.cc:385] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.744247  5065 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
W20260709 12:09:23.745143  4988 leader_election.cc:343] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.745137  5065 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.748842  5450 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.750555  5450 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.752055  5066 tablet_bootstrap.cc:654] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.757889  5065 ts_tablet_manager.cc:1434] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:09:23.800195  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:23.854691  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:23.758210  5480 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.862550  5476 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.864997  5065 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:23.860850  5388 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:23.870338  5067 tablet_bootstrap.cc:654] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.872552  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:23.869689  5476 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.877060  5476 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.877964  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:23.878517  4869 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.879874  4988 leader_election.cc:343] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.881660  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:23.882372  4876 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:23.867681  4872 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.885824  5480 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:23.890019  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:23.887784  5480 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:23.900375  4988 leader_election.cc:343] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.906090  5411 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.906564  5411 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.909682  4915 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:23.928210  5411 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:23.928845  5476 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.930815  4869 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:23.939141  5476 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.939862  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:23.941499  4839 leader_election.cc:343] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.942806  5477 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.945775  4872 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:23.948381  5065 tablet_bootstrap.cc:654] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.949729  5066 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:23.950161  5066 ts_tablet_manager.cc:1403] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.351s	user 0.015s	sys 0.008s
I20260709 12:09:23.958904  4772 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.981389  5066 raft_consensus.cc:359] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.982062  5066 raft_consensus.cc:385] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.982313  5066 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.985848  5480 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.991197  5066 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:23.993484  5066 ts_tablet_manager.cc:1434] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:09:23.994328  5066 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:24.004631  4991 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:24.005324  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:24.005612  5416 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.006060  5416 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:24.006830  5416 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.010375  5480 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.016130  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:24.017019  5482 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.017486  5482 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:24.018255  5482 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.040555  5067 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:24.040984  5067 ts_tablet_manager.cc:1403] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.336s	user 0.027s	sys 0.026s
W20260709 12:09:24.042721  4840 leader_election.cc:343] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.043118  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:24.043882  5067 raft_consensus.cc:359] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.044543  5067 raft_consensus.cc:385] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.045428  5431 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.049300  5065 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.049714  5065 ts_tablet_manager.cc:1403] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.186s	user 0.008s	sys 0.035s
I20260709 12:09:24.052034  5065 raft_consensus.cc:359] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.052608  5065 raft_consensus.cc:385] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.052863  5065 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.053439  5065 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.055446  5065 ts_tablet_manager.cc:1434] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:24.056347  5065 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.044796  5067 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.061466  5067 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.062826  5066 tablet_bootstrap.cc:654] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.063395  5067 ts_tablet_manager.cc:1434] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:09:24.064270  5067 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:24.069541  5067 tablet_bootstrap.cc:654] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.071055  4772 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.072168  5065 tablet_bootstrap.cc:654] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.072180  4772 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.093012  5067 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:24.093408  5067 ts_tablet_manager.cc:1403] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.002s
I20260709 12:09:24.099573  5067 raft_consensus.cc:359] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.100175  5067 raft_consensus.cc:385] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.100427  5067 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.101055  5067 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.102855  5067 ts_tablet_manager.cc:1434] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:09:24.104694  5065 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.105123  5065 ts_tablet_manager.cc:1403] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.004s
I20260709 12:09:24.106009  5067 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Bootstrap starting.
I20260709 12:09:24.107502  5065 raft_consensus.cc:359] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.108129  5065 raft_consensus.cc:385] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.108388  5065 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.111786  5065 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.111447  5066 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:24.115489  5066 ts_tablet_manager.cc:1403] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.000s
I20260709 12:09:24.116050  5067 tablet_bootstrap.cc:654] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.117817  5065 ts_tablet_manager.cc:1434] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:24.118641  5065 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.118781  5476 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:24.119239  5476 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.124553  5065 tablet_bootstrap.cc:654] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.129017  5065 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.129419  5065 ts_tablet_manager.cc:1403] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 12:09:24.131735  5065 raft_consensus.cc:359] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.132367  5065 raft_consensus.cc:385] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.132613  5065 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.133244  5065 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.134050  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.134779  4872 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:24.135118  5065 ts_tablet_manager.cc:1434] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:24.135965  5065 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.137032  5067 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: No bootstrap required, opened a new log
I20260709 12:09:24.137188  5476 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.137432  5067 ts_tablet_manager.cc:1403] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.011s
I20260709 12:09:24.138706  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:24.139281  5019 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:24.139770  5067 raft_consensus.cc:359] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.140378  5067 raft_consensus.cc:385] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.140633  5067 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.141182  5065 tablet_bootstrap.cc:654] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.141392  5067 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.143318  5067 ts_tablet_manager.cc:1434] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:24.144208  4915 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:24.144917  5479 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:24.145263  5479 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:24.145576  5479 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:24.146430  5065 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.148129  5065 ts_tablet_manager.cc:1403] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:24.150413  5065 raft_consensus.cc:359] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.151000  5065 raft_consensus.cc:385] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.118346  5066 raft_consensus.cc:359] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.151590  5066 raft_consensus.cc:385] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.151928  5066 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.151765  5479 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.151271  5065 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.152752  5065 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.154731  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:24.155426  4872 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:24.153860  5066 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.157285  5066 ts_tablet_manager.cc:1434] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 12:09:24.157970  5065 ts_tablet_manager.cc:1434] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:09:24.158778  5065 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.161396  5066 tablet_bootstrap.cc:492] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:24.164207  5065 tablet_bootstrap.cc:654] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.165201  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:24.167346  5066 tablet_bootstrap.cc:654] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.171561  5019 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:24.177151  4915 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:24.177973  5476 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:24.178574  5476 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:24.179358  5476 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.186832  5479 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.189983  5065 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.190462  5065 ts_tablet_manager.cc:1403] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.017s
I20260709 12:09:24.193181  5065 raft_consensus.cc:359] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.193837  5065 raft_consensus.cc:385] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.194176  5065 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.194875  5065 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.196892  5065 ts_tablet_manager.cc:1434] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:24.197875  5065 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.203416  5065 tablet_bootstrap.cc:654] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.207233  5066 tablet_bootstrap.cc:492] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:24.207687  5066 ts_tablet_manager.cc:1403] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.020s
I20260709 12:09:24.210417  5066 raft_consensus.cc:359] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.211061  5066 raft_consensus.cc:385] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.211359  5066 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.211973  5066 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.214062  5066 ts_tablet_manager.cc:1434] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:09:24.213531  4773 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.215034  5066 tablet_bootstrap.cc:492] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:24.215790  5411 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.216223  5411 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.218724  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:24.219985  4839 leader_election.cc:343] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.221534  5066 tablet_bootstrap.cc:654] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.221800  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:24.222384  5017 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 0.
I20260709 12:09:24.225857  4950 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.231838  4840 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:24.232643  5431 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.232996  5431 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.233286  5431 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.239554  5066 tablet_bootstrap.cc:492] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:24.239956  5066 ts_tablet_manager.cc:1403] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.015s
I20260709 12:09:24.240495  5065 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.240919  5065 ts_tablet_manager.cc:1403] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.022s
I20260709 12:09:24.242257  5066 raft_consensus.cc:359] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.242877  5066 raft_consensus.cc:385] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.243214  5066 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.243214  5065 raft_consensus.cc:359] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.242914  5411 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.243952  5065 raft_consensus.cc:385] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.244264  5065 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.243952  5066 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.246162  5065 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.246476  5431 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.248071  5065 ts_tablet_manager.cc:1434] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:09:24.248900  5065 tablet_bootstrap.cc:492] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.249081  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:24.251027  4839 leader_election.cc:343] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.253899  5065 tablet_bootstrap.cc:654] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.257252  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:24.257594  5066 ts_tablet_manager.cc:1434] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:24.257905  5019 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.258484  5066 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
I20260709 12:09:24.264374  5066 tablet_bootstrap.cc:654] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.267315  5019 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:24.269371  5411 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.269654  4840 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:24.269847  5411 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.270467  5412 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.270951  5412 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:24.271829  5411 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.271744  5412 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.274001  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:24.275202  4839 leader_election.cc:343] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.276755  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:24.277503  5066 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:24.277884  5066 ts_tablet_manager.cc:1403] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 12:09:24.280181  5066 raft_consensus.cc:359] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.280777  5066 raft_consensus.cc:385] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.281054  5066 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.281643  5066 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.281813  5416 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.283586  5066 ts_tablet_manager.cc:1434] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:09:24.284379  5066 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Bootstrap starting.
W20260709 12:09:24.289402  4840 leader_election.cc:343] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.289834  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:24.290465  5411 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.297585  5066 tablet_bootstrap.cc:654] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.297729  5476 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.298182  5476 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.299602  5065 tablet_bootstrap.cc:492] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.300043  5065 ts_tablet_manager.cc:1403] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.008s
I20260709 12:09:24.309765  5476 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.312283  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:24.313017  5017 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:24.325543  5065 raft_consensus.cc:359] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.326150  5065 raft_consensus.cc:385] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.326399  5065 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.326990  5065 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.328365  5065 ts_tablet_manager.cc:1434] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 12:09:24.335599  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.336225  4873 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 1: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:24.336404  5065 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.338501  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:24.342370  5479 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.349244  5066 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: No bootstrap required, opened a new log
I20260709 12:09:24.349671  5066 ts_tablet_manager.cc:1403] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Time spent bootstrapping tablet: real 0.065s	user 0.025s	sys 0.029s
I20260709 12:09:24.350664  5479 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.352494  5066 raft_consensus.cc:359] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.353129  5066 raft_consensus.cc:385] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.353379  5066 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.353741  5065 tablet_bootstrap.cc:654] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.354020  5066 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.355419  5066 ts_tablet_manager.cc:1434] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:09:24.256335  5431 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 1 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.376652  5480 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:24.382927  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.384864  5065 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.385277  5065 ts_tablet_manager.cc:1403] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 12:09:24.387655  5065 raft_consensus.cc:359] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.388248  5065 raft_consensus.cc:385] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.388494  5065 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.389096  5065 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.390998  5065 ts_tablet_manager.cc:1434] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:24.391801  5065 tablet_bootstrap.cc:492] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.409690  5065 tablet_bootstrap.cc:654] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.416494  4773 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.432611  4951 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.438465  5065 tablet_bootstrap.cc:492] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.439378  5065 ts_tablet_manager.cc:1403] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.006s
I20260709 12:09:24.441784  5065 raft_consensus.cc:359] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.442478  5065 raft_consensus.cc:385] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.442755  5065 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.443074  5451 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.443363  5065 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.443540  5451 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.445428  5065 ts_tablet_manager.cc:1434] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:24.446260  5065 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.446218  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.446895  4873 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.447667  4950 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.447892  4991 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:24.448832  5416 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.449172  5416 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.449496  5416 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.451809  5065 tablet_bootstrap.cc:654] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.455528  5451 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.460644  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:24.461241  4947 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.474145  5451 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.474572  5451 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.474743  5482 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.477837  5479 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.478278  5479 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.480562  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.481139  4870 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.481215  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.483095  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:24.483747  4944 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.488021  4988 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:24.492419  5482 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.494580  5482 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.496881  5482 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.498292  5479 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.500854  5451 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.503790  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.504494  4872 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.506821  5480 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.507200  5480 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.507519  5480 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.509951  5390 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:24.510434  5390 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.517401  5480 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.518291  5390 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.524755  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:24.527060  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.519392  5480 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.538252  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:24.541219  5451 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.541574  5451 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.541729  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:24.541846  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:24.542294  4872 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.503880  5416 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.548378  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:24.551321  5416 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.541949  5451 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.555269  5450 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:24.557900  4988 leader_election.cc:343] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.559482  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:24.560012  4944 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.562839  4872 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:24.565554  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:24.566082  4874 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.566287  4944 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:24.568128  5518 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.571866  4874 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:24.574357  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:24.575636  4991 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:24.576787  4915 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:24.578158  4915 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:24.580368  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:24.581099  4951 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.584421  5482 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.584906  5482 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:24.632766  4951 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:24.585160  5477 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.581051  5450 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.587556  5390 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:24.691969  5451 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.648054  5450 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:24.697242  5450 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:24.798439  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 148791us
I20260709 12:09:24.809149  5416 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.809664  5416 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.816504  4951 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.817193  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 189839us
I20260709 12:09:24.820500  5451 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.811981  5416 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.821488  5065 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.821918  5065 ts_tablet_manager.cc:1403] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.376s	user 0.068s	sys 0.078s
I20260709 12:09:24.824287  5065 raft_consensus.cc:359] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.825174  5065 raft_consensus.cc:385] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.825475  5065 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.826092  5065 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.828086  5065 ts_tablet_manager.cc:1434] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:24.828994  5065 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:24.720920  5482 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.830128  5451 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.830588  5451 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.832406  5451 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.847518  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:24.860292  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:24.860790  4947 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.865474  5065 tablet_bootstrap.cc:654] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.866192  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:24.868237  4947 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.871773  4947 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.877496  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.878049  4870 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.881999  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:24.882608  4874 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.885113  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.885691  4868 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 0.
I20260709 12:09:24.886868  5017 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:24.895135  4988 leader_election.cc:343] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.895762  4988 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:24.896283  5479 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.896457  5065 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:24.897665  5065 ts_tablet_manager.cc:1403] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.003s
I20260709 12:09:24.897744  5479 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.898123  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:24.898901  5450 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.899221  5450 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.899520  5450 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.901866  5480 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.903610  5480 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.903949  5480 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.905591  5390 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.909153  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:24.909456  4874 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:24.911636  4773 catalog_manager.cc:5697] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.900074  5479 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:24.912889  5482 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.931830  5480 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.934126  5480 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.935339  4871 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:24.936707  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:24.940510  5450 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.950289  5390 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.942339  5450 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:24.956395  5527 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.931519  5065 raft_consensus.cc:359] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.960216  5065 raft_consensus.cc:385] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.960280  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:24.965080  5065 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.960352  4917 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:24.965477  4874 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.965914  5065 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.970044  4951 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.970359  5065 ts_tablet_manager.cc:1434] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.072s	user 0.000s	sys 0.004s
I20260709 12:09:24.971557  4874 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:24.977649  5527 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.984863  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:24.987119  5531 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.987591  5531 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:24.988309  5531 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:24.994427  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:24.994962  4944 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.001684  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:25.007179  5450 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.008837  5450 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:25.010154  4944 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:25.010002  5450 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:25.011170  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:25.011662  4951 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.020795  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:25.022143  4874 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.024143  5065 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: Bootstrap starting.
I20260709 12:09:25.021463  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:25.029879  5519 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.030004  4951 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:25.030345  5519 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:25.031136  5519 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:25.167695  4874 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:25.185328  5065 tablet_bootstrap.cc:700] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: Time spent opening tablet: real 0.142s	user 0.004s	sys 0.008s
I20260709 12:09:25.186110  5065 tablet_bootstrap.cc:654] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.193429  5390 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:25.197393  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 159698us
I20260709 12:09:25.226740  5065 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: No bootstrap required, opened a new log
I20260709 12:09:25.227236  5065 ts_tablet_manager.cc:1403] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: Time spent bootstrapping tablet: real 0.203s	user 0.010s	sys 0.012s
I20260709 12:09:25.229027  5065 raft_consensus.cc:359] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:25.241133  5065 raft_consensus.cc:385] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.241417  5065 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.242002  5065 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:25.243134  5065 ts_tablet_manager.cc:1434] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.000s
I20260709 12:09:25.257764  4773 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.267553  5523 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.295859  5523 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.322043  5523 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.324019  4771 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.327534  4771 catalog_manager.cc:5697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.329315  4771 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.354851  5524 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:25.421571  4822 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.479964  5518 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.485971  5479 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.486459  5479 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:25.488330  5479 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:25.491690  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:25.510591  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:25.519758  4915 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:25.529273  5522 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.540727  4942 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.542892  5527 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.543340  5527 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:25.545289  5527 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:25.546182  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:25.546784  5022 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:25.548172  4840 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:25.548961  5482 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.549103  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:25.550529  5528 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:25.550822  4950 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:25.550899  5528 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.551304  5528 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.557341  5528 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:25.559585  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:25.560098  4950 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.560287  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:25.560793  5022 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.567291  4950 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:25.568184  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:25.568600  5022 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:25.570052  5526 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:25.570529  5526 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:25.562255  5528 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:25.573292  5526 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:25.575217  5523 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.590061  5523 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.594808  5524 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.600934  5524 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.666035  4772 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.892096  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:25.914450  5558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:25.914479  5559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:25.916234  5561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:25.917452  3725 server_base.cc:1061] running on GCE node
I20260709 12:09:25.919214  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:25.919438  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:25.919628  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783598965919611 us; error 0 us; skew 500 ppm
I20260709 12:09:25.920172  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:25.926877  3725 webserver.cc:533] Webserver started at http://127.3.163.68:42633/ using document root <none> and password file <none>
I20260709 12:09:25.927490  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:25.927739  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:25.928150  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:25.929978  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-3-root/instance:
uuid: "ab9da67236874634be59ebfd05b18255"
format_stamp: "Formatted at 2026-07-09 12:09:25 on dist-test-slave-s43n"
I20260709 12:09:25.942405  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.001s	sys 0.009s
I20260709 12:09:25.946667  5566 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:25.947453  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:09:25.947819  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-3-root
uuid: "ab9da67236874634be59ebfd05b18255"
format_stamp: "Formatted at 2026-07-09 12:09:25 on dist-test-slave-s43n"
I20260709 12:09:25.948167  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:25.968936  4950 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:25.972196  5526 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:25.973716  5022 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:25.975809  5431 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.014887  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:26.016695  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:26.028697  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:26.040277  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:26.040553  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:26.040863  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:26.041096  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:26.164881  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.68:44297
I20260709 12:09:26.165102  5630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.68:44297 every 8 connection(s)
I20260709 12:09:26.191037  3725 auto_leader_rebalancer-test.cc:439] add a tserver: ab9da67236874634be59ebfd05b18255
I20260709 12:09:26.214794  5631 heartbeater.cc:344] Connected to a master server at 127.3.163.126:34023
I20260709 12:09:26.215245  5631 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:26.216091  5631 heartbeater.cc:507] Master 127.3.163.126:34023 requested a full tablet report, sending...
I20260709 12:09:26.218482  4771 ts_manager.cc:194] Registered new tserver with Master: ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:26.220221  4771 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36362
I20260709 12:09:26.523119  5024 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:26.533006  4871 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.533474  4942 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.535161  5524 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:26.548878  5523 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.552649  5518 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:26.556638  4871 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.567250  5024 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:09:26.575080  4990 consensus_peers.cc:597] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7da05b23b88546d1b3a9c8ec5ec7bb26. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.576900  4942 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.577286  4771 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:26.599152  4990 consensus_peers.cc:597] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f4e29d1896a40e18a1e129dfc2a01c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.599205  4950 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.600845  5523 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.600919  4874 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.632675  5641 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:26.687227  5641 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.688891  4871 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.690246  4942 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.711396  4772 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.723413  4871 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:26.739256  5024 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.740938  5526 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.746201  4950 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.748442  5431 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.758819  5024 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:09:26.763677  4841 consensus_peers.cc:597] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 694e27a66efd449e81ce6297d4201cc3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.765311  5431 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.776746  4945 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.777513  4773 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.796984  4874 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:26.814277  5024 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:26.813021  4841 consensus_peers.cc:597] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88f88700ce294dc2bbfa0b1c51666ce7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.814831  4945 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.817955  5431 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.821591  5526 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.828361  5654 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.829584  5024 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.834599  4945 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:26.846263  4773 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.092208  5658 ts_tablet_manager.cc:933] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:27.124786  5660 ts_tablet_manager.cc:933] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:27.126086  5658 tablet_copy_client.cc:323] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:27.137328  5660 tablet_copy_client.cc:323] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:27.152786  5035 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 6f4e29d1896a40e18a1e129dfc2a01c4 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:27.153362  5035 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 6f4e29d1896a40e18a1e129dfc2a01c4 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-6f4e29d1896a40e18a1e129dfc2a01c4
I20260709 12:09:27.161188  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:27.161739  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-7da05b23b88546d1b3a9c8ec5ec7bb26
I20260709 12:09:27.168643  5034 tablet_copy_source_session.cc:215] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.170735  5035 tablet_copy_source_session.cc:215] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.172272  5660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.176381  5658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4e29d1896a40e18a1e129dfc2a01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.193980  5660 tablet_copy_client.cc:806] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.194326  5658 tablet_copy_client.cc:806] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.194543  5660 tablet_copy_client.cc:670] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.194916  5658 tablet_copy_client.cc:670] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.203794  5658 tablet_copy_client.cc:538] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.208094  5660 tablet_copy_client.cc:538] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.213366  5658 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:27.216284  5660 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:27.223004  5631 heartbeater.cc:499] Master 127.3.163.126:34023 was elected leader, sending a full tablet report...
I20260709 12:09:27.283870  5658 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.284855  5658 tablet_bootstrap.cc:492] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:27.285552  5658 ts_tablet_manager.cc:1403] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.072s	user 0.030s	sys 0.027s
I20260709 12:09:27.289597  5658 raft_consensus.cc:359] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:27.291610  5658 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:27.291826  5666 ts_tablet_manager.cc:933] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:09:27.292330  5658 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:27.301236  5666 tablet_copy_client.cc:323] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:09:27.302137  5658 ts_tablet_manager.cc:1434] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:09:27.311830  5660 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.312704  5660 tablet_bootstrap.cc:492] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:27.317601  5035 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-6f4e29d1896a40e18a1e129dfc2a01c4 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:27.330042  5035 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-6f4e29d1896a40e18a1e129dfc2a01c4 on tablet 6f4e29d1896a40e18a1e129dfc2a01c4 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:27.313380  5660 ts_tablet_manager.cc:1403] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.097s	user 0.029s	sys 0.003s
I20260709 12:09:27.334424  5660 raft_consensus.cc:359] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:27.335268  5660 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:27.336217  5660 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:27.340502  4886 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 88f88700ce294dc2bbfa0b1c51666ce7 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:09:27.341012  4886 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 88f88700ce294dc2bbfa0b1c51666ce7 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-88f88700ce294dc2bbfa0b1c51666ce7
I20260709 12:09:27.343997  5660 ts_tablet_manager.cc:1434] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:27.352214  5035 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-7da05b23b88546d1b3a9c8ec5ec7bb26 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:27.352591  5035 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-7da05b23b88546d1b3a9c8ec5ec7bb26 on tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:27.355073  4886 tablet_copy_source_session.cc:215] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.359264  5666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f88700ce294dc2bbfa0b1c51666ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.368793  5660 ts_tablet_manager.cc:933] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:09:27.383384  5660 tablet_copy_client.cc:323] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:09:27.385046  4886 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 694e27a66efd449e81ce6297d4201cc3 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:09:27.385531  4886 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 694e27a66efd449e81ce6297d4201cc3 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-694e27a66efd449e81ce6297d4201cc3
I20260709 12:09:27.393689  5666 tablet_copy_client.cc:806] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.394264  5666 tablet_copy_client.cc:670] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.397145  4886 tablet_copy_source_session.cc:215] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.398360  5666 tablet_copy_client.cc:538] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.401379  5660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 694e27a66efd449e81ce6297d4201cc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.425246  5666 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:27.429891  5660 tablet_copy_client.cc:806] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.433624  5660 tablet_copy_client.cc:670] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.436909  5660 tablet_copy_client.cc:538] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.461218  5660 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:27.470039  5666 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.471362  5666 tablet_bootstrap.cc:492] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:27.472057  5666 ts_tablet_manager.cc:1403] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.013s
I20260709 12:09:27.480917  5666 raft_consensus.cc:359] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:27.481746  5666 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:27.483261  5666 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:27.486609  5666 ts_tablet_manager.cc:1434] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:09:27.489048  4886 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-88f88700ce294dc2bbfa0b1c51666ce7 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:09:27.489481  4886 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-88f88700ce294dc2bbfa0b1c51666ce7 on tablet 88f88700ce294dc2bbfa0b1c51666ce7 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:27.499361  5660 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.500147  5660 tablet_bootstrap.cc:492] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:27.501165  5660 ts_tablet_manager.cc:1403] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.004s
I20260709 12:09:27.506209  5660 raft_consensus.cc:359] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:27.507081  5660 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:27.507699  5660 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:27.517895  5660 ts_tablet_manager.cc:1434] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:09:27.529395  4886 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-694e27a66efd449e81ce6297d4201cc3 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:09:27.529778  4886 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-694e27a66efd449e81ce6297d4201cc3 on tablet 694e27a66efd449e81ce6297d4201cc3 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:27.534864  5606 raft_consensus.cc:1217] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.623260  5606 raft_consensus.cc:1217] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.643834  5606 raft_consensus.cc:1217] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.902798  5606 raft_consensus.cc:1217] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:28.043008  5673 raft_consensus.cc:1064] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:28.045655  5673 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:28.061769  5606 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.063278  5526 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.075256  4945 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.076476  5526 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.083217  5022 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.094224  5673 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.128247  5017 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.124038  5526 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.136106  5641 raft_consensus.cc:1064] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:28.138341  5641 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:28.166028  4950 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.169641  4772 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.190863  5606 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:09:28.202975  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51412us
I20260709 12:09:28.221783  5606 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.223413  5518 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.233170  5518 raft_consensus.cc:1064] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:28.236622  5518 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:28.240609  4950 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.242069  4871 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.253839  5641 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.266074  5685 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.287571  5605 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.289554  5685 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:28.299610  4868 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.310627  4950 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.310501  5685 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.330878  5641 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.342782  4871 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:28.351354  5523 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.356788  5604 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.357820  4773 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.358117  4868 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.361276  4942 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.362572  5431 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.368716  5673 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.372316  5022 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:28.371891  4945 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.353822  5606 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.378969  5681 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.383163  4950 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.383221  5604 raft_consensus.cc:2955] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.399641  5431 raft_consensus.cc:1064] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:28.401716  5431 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:28.402606  4942 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.407908  5605 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.401238  5518 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.412165  5524 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:28.416514  4874 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.422608  4771 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.427886  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88f88700ce294dc2bbfa0b1c51666ce7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:28.432065  5022 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.433490  5605 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.442991  4773 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.444120  5605 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.448854  5686 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.450073  5526 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.449587  5606 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.456957  4869 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.458325  5518 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.462386  5431 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.463838  4945 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.476452  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 88f88700ce294dc2bbfa0b1c51666ce7 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55706
I20260709 12:09:28.482846  5526 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.505316  4874 raft_consensus.cc:2955] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.513720  5017 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:28.550325  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f4e29d1896a40e18a1e129dfc2a01c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:28.572894  5697 tablet_replica.cc:333] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:09:28.672951  5603 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.675073  5697 raft_consensus.cc:2243] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:28.675822  5697 raft_consensus.cc:2272] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:28.688468  5641 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.708367  5431 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.722905  4944 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.709046  4771 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.744434  5603 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.750897  4951 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.767372  5699 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.774755  5605 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.766065  5697 ts_tablet_manager.cc:1916] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:28.780901  4771 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.795874  5686 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.809988  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:09:28.815109  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 105431us
I20260709 12:09:28.822283  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f4e29d1896a40e18a1e129dfc2a01c4 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52362
I20260709 12:09:28.839010  5022 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.834290  4946 raft_consensus.cc:2955] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.857334  4774 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.870283  4872 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:28.875764  5605 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.876137  4944 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.877166  5710 tablet_replica.cc:333] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:09:28.878264  5710 raft_consensus.cc:2243] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:28.878079  5673 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.878981  5710 raft_consensus.cc:2272] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:28.880466  5708 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:28.892894  5710 ts_tablet_manager.cc:1916] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:28.907506  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39302
I20260709 12:09:28.907950  5708 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.909725  4948 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.944727  5605 raft_consensus.cc:2955] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:28.967607  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 694e27a66efd449e81ce6297d4201cc3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:28.971307  5697 ts_tablet_manager.cc:1929] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:28.971804  5697 log.cc:1199] T 88f88700ce294dc2bbfa0b1c51666ce7 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/88f88700ce294dc2bbfa0b1c51666ce7
I20260709 12:09:28.978317  5713 tablet_replica.cc:333] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:09:28.979296  5713 raft_consensus.cc:2243] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:28.980110  5713 raft_consensus.cc:2272] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:28.967164  4772 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.991611  5710 ts_tablet_manager.cc:1929] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:28.992113  5710 log.cc:1199] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/6f4e29d1896a40e18a1e129dfc2a01c4
I20260709 12:09:28.994047  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 6f4e29d1896a40e18a1e129dfc2a01c4 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:28.995075  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 88f88700ce294dc2bbfa0b1c51666ce7 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:28.996783  5713 ts_tablet_manager.cc:1916] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.014839  5713 ts_tablet_manager.cc:1929] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.015287  5713 log.cc:1199] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/7da05b23b88546d1b3a9c8ec5ec7bb26
I20260709 12:09:29.016844  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 7da05b23b88546d1b3a9c8ec5ec7bb26 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:29.035271  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 694e27a66efd449e81ce6297d4201cc3 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55706
I20260709 12:09:29.036093  5697 tablet_replica.cc:333] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:09:29.037083  5697 raft_consensus.cc:2243] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:29.037809  5697 raft_consensus.cc:2272] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:29.041002  5697 ts_tablet_manager.cc:1916] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.055984  5697 ts_tablet_manager.cc:1929] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.056353  5697 log.cc:1199] T 694e27a66efd449e81ce6297d4201cc3 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/694e27a66efd449e81ce6297d4201cc3
I20260709 12:09:29.057719  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 694e27a66efd449e81ce6297d4201cc3 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:30.119446  5022 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:09:30.125682  4990 consensus_peers.cc:597] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 737cb737da3146798e07c2c2026eebcc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.126123  4944 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.126478  4873 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.127453  5711 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.128283  5686 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.137552  5711 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.139109  4873 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.139572  4944 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.158066  4772 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.213017  4944 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:30.238013  5022 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.239411  4873 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.239688  5675 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.241420  5675 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.266067  5675 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.276223  4873 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.287668  4944 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:30.288316  4773 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:30.311430  4916 consensus_peers.cc:597] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15263062183540bdbd45628b3342a3d5. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:30.316100  4916 consensus_peers.cc:597] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2004e797943d48d0ab1d7ed726902783. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.318118  5025 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.318043  4868 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.325728  5022 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.325632  5726 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:30.327277  5675 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.342023  5709 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.350775  4873 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.360376  5025 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.374979  4774 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.375603  4873 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:30.409963  4944 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.410795  5025 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:30.410846  4841 consensus_peers.cc:597] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b33c26da92464c7896c3c4d2243075e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.411341  5673 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.412384  5526 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.433254  5721 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.441202  5025 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.459414  4773 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.459743  4944 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:30.755070  5741 ts_tablet_manager.cc:933] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:30.761528  5741 tablet_copy_client.cc:323] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:09:30.881795  5745 ts_tablet_manager.cc:933] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:30.895285  5745 tablet_copy_client.cc:323] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:30.927235  5749 ts_tablet_manager.cc:933] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:30.932618  5749 tablet_copy_client.cc:323] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:09:30.935655  4960 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet 2004e797943d48d0ab1d7ed726902783 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:09:30.936172  4960 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet 2004e797943d48d0ab1d7ed726902783 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-2004e797943d48d0ab1d7ed726902783
I20260709 12:09:30.955005  4960 tablet_copy_source_session.cc:215] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.993413  5035 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 737cb737da3146798e07c2c2026eebcc from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:31.009838  5035 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 737cb737da3146798e07c2c2026eebcc from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-737cb737da3146798e07c2c2026eebcc
I20260709 12:09:31.016717  5035 tablet_copy_source_session.cc:215] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.019923  5745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 737cb737da3146798e07c2c2026eebcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.110203  5749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2004e797943d48d0ab1d7ed726902783. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:31.138527  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 95492us
I20260709 12:09:31.157466  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet 15263062183540bdbd45628b3342a3d5 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:09:31.198179  5745 tablet_copy_client.cc:806] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.198822  5745 tablet_copy_client.cc:670] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.224959  5749 tablet_copy_client.cc:806] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.227258  5749 tablet_copy_client.cc:670] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.236009  5749 tablet_copy_client.cc:538] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:31.259320  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 166419us
I20260709 12:09:31.279160  5749 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
W20260709 12:09:31.285110  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 257286us
I20260709 12:09:31.291057  5745 tablet_copy_client.cc:538] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.300076  5745 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:31.306079  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet 15263062183540bdbd45628b3342a3d5 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-15263062183540bdbd45628b3342a3d5
I20260709 12:09:31.313797  4961 tablet_copy_source_session.cc:215] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.321631  5749 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.322570  5749 tablet_bootstrap.cc:492] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:31.323207  5749 ts_tablet_manager.cc:1403] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.008s
I20260709 12:09:31.326139  5749 raft_consensus.cc:359] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:31.327988  5741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15263062183540bdbd45628b3342a3d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:31.335959  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 196693us
I20260709 12:09:31.357743  5741 tablet_copy_client.cc:806] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.358395  5741 tablet_copy_client.cc:670] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.375182  5745 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.376104  5745 tablet_bootstrap.cc:492] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:31.376773  5745 ts_tablet_manager.cc:1403] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.077s	user 0.032s	sys 0.000s
I20260709 12:09:31.379674  5745 raft_consensus.cc:359] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:31.380492  5745 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:31.381270  5745 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:31.327553  5749 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:31.386909  5749 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:31.391826  5745 ts_tablet_manager.cc:1434] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 12:09:31.397013  5741 tablet_copy_client.cc:538] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:31.403779  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 48227.5us
I20260709 12:09:31.405545  5749 ts_tablet_manager.cc:1434] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.000s
I20260709 12:09:31.405751  5741 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:31.415318  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-2004e797943d48d0ab1d7ed726902783 received from {username='slave'} at 127.0.0.1:43248
I20260709 12:09:31.415743  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-2004e797943d48d0ab1d7ed726902783 on tablet 2004e797943d48d0ab1d7ed726902783 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:31.404129  5760 ts_tablet_manager.cc:933] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:09:31.435003  5760 tablet_copy_client.cc:323] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:09:31.445461  5035 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-737cb737da3146798e07c2c2026eebcc received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:31.445806  5035 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-737cb737da3146798e07c2c2026eebcc on tablet 737cb737da3146798e07c2c2026eebcc with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:31.453368  5741 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.454192  5741 tablet_bootstrap.cc:492] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:31.454803  5741 ts_tablet_manager.cc:1403] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.005s
I20260709 12:09:31.457962  5741 raft_consensus.cc:359] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:31.468921  5741 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:31.469576  5741 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:31.470388  4886 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet b33c26da92464c7896c3c4d2243075e8 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:09:31.470943  4886 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet b33c26da92464c7896c3c4d2243075e8 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-b33c26da92464c7896c3c4d2243075e8
I20260709 12:09:31.477463  5741 ts_tablet_manager.cc:1434] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:09:31.491385  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-15263062183540bdbd45628b3342a3d5 received from {username='slave'} at 127.0.0.1:43248
I20260709 12:09:31.491776  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-15263062183540bdbd45628b3342a3d5 on tablet 15263062183540bdbd45628b3342a3d5 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:31.501458  4886 tablet_copy_source_session.cc:215] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.511749  5760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33c26da92464c7896c3c4d2243075e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.542114  5760 tablet_copy_client.cc:806] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.542690  5760 tablet_copy_client.cc:670] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.548475  5760 tablet_copy_client.cc:538] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.560648  5760 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:31.596792  5760 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.597654  5760 tablet_bootstrap.cc:492] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:31.598271  5760 ts_tablet_manager.cc:1403] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.009s
I20260709 12:09:31.623688  5760 raft_consensus.cc:359] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:31.624557  5760 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:31.625244  5760 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:31.629927  5760 ts_tablet_manager.cc:1434] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.013s
I20260709 12:09:31.633466  4886 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-b33c26da92464c7896c3c4d2243075e8 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:09:31.633862  4886 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-b33c26da92464c7896c3c4d2243075e8 on tablet b33c26da92464c7896c3c4d2243075e8 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:31.653434  5605 raft_consensus.cc:1217] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.803020  5605 raft_consensus.cc:1217] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.825202  5605 raft_consensus.cc:1217] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.013666  5605 raft_consensus.cc:1217] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.198280  5726 raft_consensus.cc:1064] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:32.200654  5726 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:32.213550  5046 debug-util.cc:398] Leaking SignalData structure 0x7b080010db40 after lost signal to thread 3728
W20260709 12:09:32.214532  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4080 after lost signal to thread 4808
W20260709 12:09:32.215595  5046 debug-util.cc:398] Leaking SignalData structure 0x7b080006fbc0 after lost signal to thread 4900
W20260709 12:09:32.216647  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003274c0 after lost signal to thread 4975
W20260709 12:09:32.217629  5046 debug-util.cc:398] Leaking SignalData structure 0x7b0800284ee0 after lost signal to thread 5049
W20260709 12:09:32.218595  5046 debug-util.cc:398] Leaking SignalData structure 0x7b0800121f60 after lost signal to thread 5630
I20260709 12:09:32.222239  5605 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.223935  5025 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.225219  5739 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.227574  5739 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.242030  4871 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.251422  5726 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.261528  5726 raft_consensus.cc:1064] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:32.263839  5726 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:32.274559  5711 raft_consensus.cc:1064] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:32.276621  5711 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:32.331666  5603 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.333343  5751 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.400262  5739 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:09:32.405063  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 50372.2us
I20260709 12:09:32.415158  5603 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.426319  4773 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.438177  5020 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.471246  5605 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.482714  5025 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.490633  4876 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.497720  5709 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.499730  4948 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.514328  5699 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.525903  4876 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.530059  4876 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.542327  5726 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.545720  5709 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.552374  5751 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 12:09:32.611881  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 58314.7us
W20260709 12:09:32.614219  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 62541.4us
I20260709 12:09:32.625591  5784 raft_consensus.cc:1064] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:32.629124  5784 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:32.656616  5714 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.640368  4947 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:32.670172  4870 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.673128  5603 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.678407  5020 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.679214  4948 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.684659  5784 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:32.685665  5721 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.687606  4772 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.681078  5605 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.681449  5606 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.694375  5025 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.703786  5739 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.679961  5782 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.710055  5709 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.723865  4875 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.728925  5025 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:32.732364  5022 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.740989  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15263062183540bdbd45628b3342a3d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.748337  4870 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.750695  4771 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:32.751396  5788 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.756768  5606 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.764523  5721 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.766892  5761 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.768550  5606 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.770994  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 15263062183540bdbd45628b3342a3d5 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39302
I20260709 12:09:32.773778  5786 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.778585  4947 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.784387  5604 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.789580  4875 raft_consensus.cc:2955] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.794486  5787 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:32.797320  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 737cb737da3146798e07c2c2026eebcc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.801420  5020 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.803923  4774 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.805940  4771 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.822602  5721 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.825740  5795 tablet_replica.cc:333] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:09:32.826720  5795 raft_consensus.cc:2243] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.827301  5795 raft_consensus.cc:2272] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:32.828522  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 737cb737da3146798e07c2c2026eebcc with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52362
I20260709 12:09:32.835989  5603 raft_consensus.cc:2955] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.848035  5605 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.857381  5795 ts_tablet_manager.cc:1916] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.869952  4944 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.881026  5020 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.889787  4774 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.898147  4942 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:32.908176  5797 tablet_replica.cc:333] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:09:32.909101  5797 raft_consensus.cc:2243] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.909759  5797 raft_consensus.cc:2272] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:32.911180  5795 ts_tablet_manager.cc:1929] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.911891  5795 log.cc:1199] T 15263062183540bdbd45628b3342a3d5 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/15263062183540bdbd45628b3342a3d5
I20260709 12:09:32.913798  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 15263062183540bdbd45628b3342a3d5 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:32.917261  5603 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.919600  5787 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.921432  4870 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.926112  5782 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.929250  4876 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:32.929421  5709 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.935336  5605 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.936703  5721 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.937443  5797 ts_tablet_manager.cc:1916] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.939270  5020 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.944711  5721 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.942564  4867 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.955199  5784 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.956776  5603 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.965431  5020 raft_consensus.cc:2955] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.973238  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2004e797943d48d0ab1d7ed726902783 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.987277  5797 ts_tablet_manager.cc:1929] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.987730  5797 log.cc:1199] T 737cb737da3146798e07c2c2026eebcc P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/737cb737da3146798e07c2c2026eebcc
I20260709 12:09:32.989352  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 737cb737da3146798e07c2c2026eebcc (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:32.985988  5605 raft_consensus.cc:2955] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.991271  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b33c26da92464c7896c3c4d2243075e8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.993808  4771 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:32.995409  4773 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:33.011968  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet b33c26da92464c7896c3c4d2243075e8 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52362
I20260709 12:09:33.012868  5797 tablet_replica.cc:333] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:09:33.013739  5797 raft_consensus.cc:2243] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.014348  5797 raft_consensus.cc:2272] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.017457  5797 ts_tablet_manager.cc:1916] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.020377  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 2004e797943d48d0ab1d7ed726902783 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55706
I20260709 12:09:33.028275  5798 tablet_replica.cc:333] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:09:33.029217  5798 raft_consensus.cc:2243] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.029874  5798 raft_consensus.cc:2272] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.035459  5798 ts_tablet_manager.cc:1916] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.045558  5797 ts_tablet_manager.cc:1929] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.046030  5797 log.cc:1199] T b33c26da92464c7896c3c4d2243075e8 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/b33c26da92464c7896c3c4d2243075e8
I20260709 12:09:33.046766  5798 ts_tablet_manager.cc:1929] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.047199  5798 log.cc:1199] T 2004e797943d48d0ab1d7ed726902783 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/2004e797943d48d0ab1d7ed726902783
I20260709 12:09:33.047611  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet b33c26da92464c7896c3c4d2243075e8 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:33.049149  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 2004e797943d48d0ab1d7ed726902783 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:34.091442  5020 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:34.104004  4870 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.104707  4942 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:34.105757  4990 consensus_peers.cc:597] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49d7b189f495402dbbaadba00a5cebb8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.106468  5786 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.107390  5799 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.114287  5761 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.115887  4870 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.124038  4947 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.128479  4770 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.181823  5020 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:34.193159  4947 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:34.193861  4990 consensus_peers.cc:597] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0ae020fc77f442c9f248fa0f3e45fe4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.195772  5804 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.199084  4867 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.200135  5804 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.206333  5805 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.222148  5022 consensus_queue.cc:237] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:34.231592  4876 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.226307  4947 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.227020  4773 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:34.271138  4990 consensus_peers.cc:597] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd5508a3d98b403c8be99338c7e12502. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.275091  4942 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.276643  5805 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.285698  4876 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.287842  5786 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.292088  5805 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.300314  4867 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.302613  4947 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.306061  4876 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:34.311408  4774 catalog_manager.cc:5697] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:34.347079  4841 consensus_peers.cc:597] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fb0f431b68a4f78a03a58597b9cc66a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.347777  4947 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:34.349083  5770 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.350838  5022 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:34.352465  5784 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.370098  5770 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.373171  4942 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.388978  4770 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.410943  5020 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:34.721328  5822 ts_tablet_manager.cc:933] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:34.723183  5822 tablet_copy_client.cc:323] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:34.724694  5035 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 49d7b189f495402dbbaadba00a5cebb8 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:34.725226  5035 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 49d7b189f495402dbbaadba00a5cebb8 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-49d7b189f495402dbbaadba00a5cebb8
I20260709 12:09:34.732069  5035 tablet_copy_source_session.cc:215] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.734943  5822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d7b189f495402dbbaadba00a5cebb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.762130  5822 tablet_copy_client.cc:806] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.762676  5822 tablet_copy_client.cc:670] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.766048  5824 ts_tablet_manager.cc:933] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:34.770064  5822 tablet_copy_client.cc:538] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.781023  5822 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:34.785660  5826 ts_tablet_manager.cc:933] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:34.785597  5824 tablet_copy_client.cc:323] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:34.798063  5035 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet cd5508a3d98b403c8be99338c7e12502 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:34.798568  5035 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet cd5508a3d98b403c8be99338c7e12502 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-cd5508a3d98b403c8be99338c7e12502
I20260709 12:09:34.801914  5826 tablet_copy_client.cc:323] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:34.805598  5035 tablet_copy_source_session.cc:215] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.810572  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet b0ae020fc77f442c9f248fa0f3e45fe4 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:34.811106  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet b0ae020fc77f442c9f248fa0f3e45fe4 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-b0ae020fc77f442c9f248fa0f3e45fe4
I20260709 12:09:34.818939  5034 tablet_copy_source_session.cc:215] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.820312  5824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5508a3d98b403c8be99338c7e12502. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.841679  5826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ae020fc77f442c9f248fa0f3e45fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.851946  5829 ts_tablet_manager.cc:933] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:09:34.858368  5824 tablet_copy_client.cc:806] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.860044  5824 tablet_copy_client.cc:670] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.881711  5824 tablet_copy_client.cc:538] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.883837  5826 tablet_copy_client.cc:806] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:34.889313  5826 tablet_copy_client.cc:670] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:34.897545  5829 tablet_copy_client.cc:323] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:09:34.896777  5824 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:34.927397  5822 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.930554  5822 tablet_bootstrap.cc:492] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:34.931211  5822 ts_tablet_manager.cc:1403] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.150s	user 0.040s	sys 0.031s
I20260709 12:09:34.934326  5822 raft_consensus.cc:359] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:34.935158  5822 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:34.935817  5822 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:34.939015  5826 tablet_copy_client.cc:538] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:34.948014  5826 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:34.950091  5822 ts_tablet_manager.cc:1434] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:09:34.957366  4886 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 1fb0f431b68a4f78a03a58597b9cc66a from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:09:34.957858  4886 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 1fb0f431b68a4f78a03a58597b9cc66a from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-1fb0f431b68a4f78a03a58597b9cc66a
I20260709 12:09:34.961011  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-49d7b189f495402dbbaadba00a5cebb8 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:34.961401  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-49d7b189f495402dbbaadba00a5cebb8 on tablet 49d7b189f495402dbbaadba00a5cebb8 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:34.970062  5824 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:34.976495  4886 tablet_copy_source_session.cc:215] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.981314  5824 tablet_bootstrap.cc:492] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:34.982021  5824 ts_tablet_manager.cc:1403] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.003s
I20260709 12:09:34.990582  5824 raft_consensus.cc:359] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:34.993577  5824 raft_consensus.cc:740] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:34.994238  5824 consensus_queue.cc:260] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:34.996832  5824 ts_tablet_manager.cc:1434] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:09:35.002012  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-cd5508a3d98b403c8be99338c7e12502 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:35.002381  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-cd5508a3d98b403c8be99338c7e12502 on tablet cd5508a3d98b403c8be99338c7e12502 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:35.003026  5829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fb0f431b68a4f78a03a58597b9cc66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.027105  5829 tablet_copy_client.cc:806] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.029165  5826 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.029588  5829 tablet_copy_client.cc:670] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.030097  5826 tablet_bootstrap.cc:492] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:35.031446  5826 ts_tablet_manager.cc:1403] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.008s
I20260709 12:09:35.033209  5829 tablet_copy_client.cc:538] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.034586  5826 raft_consensus.cc:359] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:35.035530  5826 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:35.036187  5826 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:35.038841  5826 ts_tablet_manager.cc:1434] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:35.040521  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-b0ae020fc77f442c9f248fa0f3e45fe4 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:35.040915  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-b0ae020fc77f442c9f248fa0f3e45fe4 on tablet b0ae020fc77f442c9f248fa0f3e45fe4 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:35.042970  5829 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:35.070815  5829 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.072767  5829 tablet_bootstrap.cc:492] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:35.073411  5829 ts_tablet_manager.cc:1403] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 12:09:35.076048  5829 raft_consensus.cc:359] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:35.076619  5829 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:35.077098  5829 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:35.079016  5829 ts_tablet_manager.cc:1434] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 12:09:35.081938  4886 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-1fb0f431b68a4f78a03a58597b9cc66a received from {username='slave'} at 127.0.0.1:57560
I20260709 12:09:35.082329  4886 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-1fb0f431b68a4f78a03a58597b9cc66a on tablet 1fb0f431b68a4f78a03a58597b9cc66a with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:35.186055  5605 raft_consensus.cc:1217] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.281068  5605 raft_consensus.cc:1217] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.300426  5605 raft_consensus.cc:1217] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.386881  5605 raft_consensus.cc:1217] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:09:35.654940  5786 raft_consensus.cc:1064] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:35.657119  5786 consensus_queue.cc:237] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:35.663378  4951 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.663846  5605 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.665247  5799 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.666304  4875 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.667992  5786 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.670142  5805 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:35.718508  5786 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:35.724002  4875 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:35.736507  5605 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:35.765956  5805 raft_consensus.cc:1064] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:35.768532  5805 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:35.809487  4947 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:35.800233  4773 catalog_manager.cc:5697] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:35.861418  5603 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.865986  5804 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.869851  5849 raft_consensus.cc:1064] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:35.874436  4944 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.876709  5799 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.878216  4871 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.892740  5847 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:35.901310  5849 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:35.932554  5603 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:35.932768  5786 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:35.951591  5820 raft_consensus.cc:1064] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:35.961112  4951 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:35.978034  5820 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:36.015214  4951 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.017014  5845 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.029259  4870 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.030974  5603 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.035458  5804 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.039999  5845 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.060688  4868 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.101312  5804 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.105713  4772 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.115206  5603 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.111123  5605 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:36.123965  5821 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.113372  4951 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:36.132371  5821 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.141356  4951 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.161671  4773 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.170812  5020 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:36.178066  5020 consensus_queue.cc:237] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:36.182672  5821 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.184305  5022 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:36.186362  5603 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.187696  5786 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.192396  5604 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.195346  5847 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.198190  4871 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.203244  5804 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.207813  4947 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.209383  5603 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.210134  5847 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.215694  5606 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.229364  4951 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.231382  5836 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.233094  5604 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.241403  4774 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.246119  5843 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.250334  5844 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.253154  4947 raft_consensus.cc:2955] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.256659  4951 raft_consensus.cc:2955] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.265326  5022 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.267071  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cd5508a3d98b403c8be99338c7e12502 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.270556  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49d7b189f495402dbbaadba00a5cebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.280087  4771 catalog_manager.cc:5697] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.286290  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 49d7b189f495402dbbaadba00a5cebb8 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39302
I20260709 12:09:36.294797  5867 tablet_replica.cc:333] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:09:36.295821  5867 raft_consensus.cc:2243] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.296516  5867 raft_consensus.cc:2272] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.299829  5867 ts_tablet_manager.cc:1916] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.305002  4772 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.306238  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet cd5508a3d98b403c8be99338c7e12502 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39302
I20260709 12:09:36.341740  4951 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.352016  5022 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:36.359098  5604 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.360697  5843 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.365089  4870 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.369071  5804 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.370940  5847 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.375178  4870 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.380059  5604 raft_consensus.cc:2955] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.381014  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0ae020fc77f442c9f248fa0f3e45fe4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.400036  4870 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:36.412070  4951 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:36.413370  5603 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:36.415313  5820 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.418797  5821 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.428423  5603 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.436375  5821 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.440114  4947 raft_consensus.cc:2955] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.442646  5867 ts_tablet_manager.cc:1929] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.443154  5867 log.cc:1199] T 49d7b189f495402dbbaadba00a5cebb8 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/49d7b189f495402dbbaadba00a5cebb8
I20260709 12:09:36.451653  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 49d7b189f495402dbbaadba00a5cebb8 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:36.452071  5867 tablet_replica.cc:333] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:09:36.452960  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fb0f431b68a4f78a03a58597b9cc66a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.454361  4770 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.464370  5867 raft_consensus.cc:2243] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.465283  5867 raft_consensus.cc:2272] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.485143  5867 ts_tablet_manager.cc:1916] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.491675  4772 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:36.495817  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ae020fc77f442c9f248fa0f3e45fe4 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52362
I20260709 12:09:36.505713  5868 tablet_replica.cc:333] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:09:36.506518  5868 raft_consensus.cc:2243] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.507274  5868 raft_consensus.cc:2272] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.513248  5867 ts_tablet_manager.cc:1929] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.513734  5867 log.cc:1199] T cd5508a3d98b403c8be99338c7e12502 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/cd5508a3d98b403c8be99338c7e12502
I20260709 12:09:36.514927  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fb0f431b68a4f78a03a58597b9cc66a with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55706
I20260709 12:09:36.514933  5868 ts_tablet_manager.cc:1916] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.519373  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet cd5508a3d98b403c8be99338c7e12502 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:36.526521  5869 tablet_replica.cc:333] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:09:36.527594  5869 raft_consensus.cc:2243] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.528236  5869 raft_consensus.cc:2272] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.531894  5868 ts_tablet_manager.cc:1929] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.532394  5868 log.cc:1199] T b0ae020fc77f442c9f248fa0f3e45fe4 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/b0ae020fc77f442c9f248fa0f3e45fe4
I20260709 12:09:36.532016  5869 ts_tablet_manager.cc:1916] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.534300  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet b0ae020fc77f442c9f248fa0f3e45fe4 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:36.548105  5869 ts_tablet_manager.cc:1929] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:09:36.548523  5869 log.cc:1199] T 1fb0f431b68a4f78a03a58597b9cc66a P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/1fb0f431b68a4f78a03a58597b9cc66a
I20260709 12:09:36.550191  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 1fb0f431b68a4f78a03a58597b9cc66a (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:37.590629  5022 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:09:37.604025  4990 consensus_peers.cc:597] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 968e3c47814549fe8cf64abe52c00d29. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.605417  4947 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.605873  4871 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.607306  5805 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:37.608325  5849 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.617899  5805 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.621547  4947 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.623174  4871 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.639598  4774 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.640650  4870 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:37.654593  5022 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:37.655926  4841 consensus_peers.cc:597] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3271fdf9e70240dc96def0f272e84933. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.656215  4944 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.657524  5836 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.659190  5836 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.668047  5821 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.676162  4944 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.694187  4870 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:37.695690  5022 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:09:37.708153  4841 consensus_peers.cc:597] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3ea9d9171fa428195bc085a20e92e3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.710295  5025 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.711529  4944 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.711958  5877 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.715464  5877 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.736534  5821 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.738636  4774 catalog_manager.cc:5697] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.743530  4947 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.751732  5020 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:37.755827  5022 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.780192  4772 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:09:37.801970  4990 consensus_peers.cc:597] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f8b0320f7e94e2688e2a1d2005746ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:37.803966  4871 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.805181  4944 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:37.805341  5872 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.806520  5849 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:37.833397  5805 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.836714  4944 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.838474  4870 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:37.855065  4774 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.141358  5891 ts_tablet_manager.cc:933] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:38.143448  5891 tablet_copy_client.cc:323] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:38.147229  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 968e3c47814549fe8cf64abe52c00d29 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:38.147746  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 968e3c47814549fe8cf64abe52c00d29 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-968e3c47814549fe8cf64abe52c00d29
I20260709 12:09:38.155215  5034 tablet_copy_source_session.cc:215] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.159168  5891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968e3c47814549fe8cf64abe52c00d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.174016  5891 tablet_copy_client.cc:806] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.175169  5891 tablet_copy_client.cc:670] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.179365  5891 tablet_copy_client.cc:538] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.181349  5893 ts_tablet_manager.cc:933] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:38.186642  5893 tablet_copy_client.cc:323] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:38.187464  5891 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:38.188145  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 1f8b0320f7e94e2688e2a1d2005746ef from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:38.188719  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 1f8b0320f7e94e2688e2a1d2005746ef from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-1f8b0320f7e94e2688e2a1d2005746ef
I20260709 12:09:38.199273  5034 tablet_copy_source_session.cc:215] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.202515  5893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f8b0320f7e94e2688e2a1d2005746ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.214366  5891 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.215761  5891 tablet_bootstrap.cc:492] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:38.216436  5891 ts_tablet_manager.cc:1403] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.029s	user 0.024s	sys 0.004s
I20260709 12:09:38.219449  5891 raft_consensus.cc:359] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:38.220247  5891 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:38.220932  5891 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:38.231704  5893 tablet_copy_client.cc:806] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.232723  5893 tablet_copy_client.cc:670] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.231756  5891 ts_tablet_manager.cc:1434] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 12:09:38.241068  5893 tablet_copy_client.cc:538] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.245831  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-968e3c47814549fe8cf64abe52c00d29 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:38.246287  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-968e3c47814549fe8cf64abe52c00d29 on tablet 968e3c47814549fe8cf64abe52c00d29 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:38.251402  5891 ts_tablet_manager.cc:933] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:09:38.253427  5898 ts_tablet_manager.cc:933] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:09:38.258051  5893 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:38.261986  5891 tablet_copy_client.cc:323] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:09:38.262571  5898 tablet_copy_client.cc:323] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:09:38.263648  4886 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet c3ea9d9171fa428195bc085a20e92e3a from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:09:38.264190  4886 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet c3ea9d9171fa428195bc085a20e92e3a from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-c3ea9d9171fa428195bc085a20e92e3a
I20260709 12:09:38.265066  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 3271fdf9e70240dc96def0f272e84933 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:09:38.265473  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 3271fdf9e70240dc96def0f272e84933 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-3271fdf9e70240dc96def0f272e84933
I20260709 12:09:38.270632  4885 tablet_copy_source_session.cc:215] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.271260  4886 tablet_copy_source_session.cc:215] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.275300  5898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3271fdf9e70240dc96def0f272e84933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.290973  5898 tablet_copy_client.cc:806] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.291518  5898 tablet_copy_client.cc:670] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.293980  5891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ea9d9171fa428195bc085a20e92e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.294970  5898 tablet_copy_client.cc:538] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.302992  5898 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:38.335265  5898 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.336205  5898 tablet_bootstrap.cc:492] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:38.336917  5898 ts_tablet_manager.cc:1403] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.005s
I20260709 12:09:38.339890  5893 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.340157  5898 raft_consensus.cc:359] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:38.340770  5893 tablet_bootstrap.cc:492] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:38.341069  5898 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:38.341135  5891 tablet_copy_client.cc:806] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.341599  5893 ts_tablet_manager.cc:1403] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.084s	user 0.036s	sys 0.028s
I20260709 12:09:38.341892  5891 tablet_copy_client.cc:670] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.341853  5898 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:38.344377  5898 ts_tablet_manager.cc:1434] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:38.344949  5893 raft_consensus.cc:359] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:38.345851  5893 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:38.346495  5893 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:38.348474  5891 tablet_copy_client.cc:538] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.348760  5893 ts_tablet_manager.cc:1434] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:38.349038  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-3271fdf9e70240dc96def0f272e84933 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:09:38.349499  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-3271fdf9e70240dc96def0f272e84933 on tablet 3271fdf9e70240dc96def0f272e84933 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:38.351327  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-1f8b0320f7e94e2688e2a1d2005746ef received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:38.351711  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-1f8b0320f7e94e2688e2a1d2005746ef on tablet 1f8b0320f7e94e2688e2a1d2005746ef with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:38.363047  5891 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:38.381839  5891 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.382447  5891 tablet_bootstrap.cc:492] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:38.382892  5891 ts_tablet_manager.cc:1403] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:09:38.384974  5891 raft_consensus.cc:359] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:38.385506  5891 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:38.386086  5891 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:38.387847  5891 ts_tablet_manager.cc:1434] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:09:38.389325  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-c3ea9d9171fa428195bc085a20e92e3a received from {username='slave'} at 127.0.0.1:57560
I20260709 12:09:38.389717  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-c3ea9d9171fa428195bc085a20e92e3a on tablet c3ea9d9171fa428195bc085a20e92e3a with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:38.629858  5603 raft_consensus.cc:1217] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.685405  5603 raft_consensus.cc:1217] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.726227  5603 raft_consensus.cc:1217] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:38.768136  5603 raft_consensus.cc:1217] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.020839  5877 raft_consensus.cc:1064] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:39.023047  5877 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:39.029471  5604 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.030063  4947 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.031033  5020 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.031353  5821 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.032145  5909 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.040897  5877 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:39.051887  5821 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.054925  5604 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.072199  4947 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.083556  4773 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.105202  5906 raft_consensus.cc:1064] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:39.107806  5906 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:39.136463  4947 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.138854  5849 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.147984  5603 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.150321  5872 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.260687  5849 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.262506  5872 raft_consensus.cc:1064] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:39.267349  5872 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:39.275255  4951 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.279289  5604 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.278539  5605 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.280884  5872 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.294005  4942 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.298067  4770 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:39.313474  5906 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:39.328621  5919 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.330056  4944 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.357484  5020 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.369191  5914 raft_consensus.cc:1064] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:39.372351  5914 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:39.376195  4870 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.383530  4872 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.384723  5605 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.385918  4951 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.387487  5914 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.392997  5603 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.394443  5914 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.415311  5020 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:39.423882  5605 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.420356  4772 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.425441  5918 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.432538  5849 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.435599  5604 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.444060  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 968e3c47814549fe8cf64abe52c00d29 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.448614  4951 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.450088  5872 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:09:39.454687  4759 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 968e3c47814549fe8cf64abe52c00d29 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:09:39.454923  4951 raft_consensus.cc:2955] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.456319  4770 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.459554  5022 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.464375  5872 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.467207  5915 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.471045  4944 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.480484  5603 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.489976  4772 catalog_manager.cc:5697] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.497593  4871 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:39.502341  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 968e3c47814549fe8cf64abe52c00d29 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39302
I20260709 12:09:39.502971  4951 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.504884  5603 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.506161  5915 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.506932  5913 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.509788  5934 tablet_replica.cc:333] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:09:39.510852  5934 raft_consensus.cc:2243] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.511547  5934 raft_consensus.cc:2272] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.513525  5914 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.514976  4951 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.520998  5604 raft_consensus.cc:2955] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.533042  5934 ts_tablet_manager.cc:1916] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.532984  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c3ea9d9171fa428195bc085a20e92e3a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.537434  4871 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.550077  4770 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.551465  5915 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.566820  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet c3ea9d9171fa428195bc085a20e92e3a with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55706
I20260709 12:09:39.593066  5937 tablet_replica.cc:333] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:09:39.594122  5937 raft_consensus.cc:2243] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.594794  5937 raft_consensus.cc:2272] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.595554  5934 ts_tablet_manager.cc:1929] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:09:39.595968  5934 log.cc:1199] T 968e3c47814549fe8cf64abe52c00d29 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/968e3c47814549fe8cf64abe52c00d29
I20260709 12:09:39.598668  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 968e3c47814549fe8cf64abe52c00d29 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:39.598989  5022 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.607846  5937 ts_tablet_manager.cc:1916] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.622509  5937 ts_tablet_manager.cc:1929] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.622867  5937 log.cc:1199] T c3ea9d9171fa428195bc085a20e92e3a P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/c3ea9d9171fa428195bc085a20e92e3a
I20260709 12:09:39.624272  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet c3ea9d9171fa428195bc085a20e92e3a (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:39.880151  5022 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:39.884604  5604 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.886193  5872 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.886792  4867 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.888314  5872 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:09:39.895932  5919 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.907621  5604 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.910082  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f8b0320f7e94e2688e2a1d2005746ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.917182  4867 raft_consensus.cc:2955] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.926591  4772 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.937553  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f8b0320f7e94e2688e2a1d2005746ef with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52362
I20260709 12:09:39.940331  5939 tablet_replica.cc:333] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:09:39.941370  5939 raft_consensus.cc:2243] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.942095  5939 raft_consensus.cc:2272] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.945662  5939 ts_tablet_manager.cc:1916] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.960597  5939 ts_tablet_manager.cc:1929] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.961001  5939 log.cc:1199] T 1f8b0320f7e94e2688e2a1d2005746ef P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/1f8b0320f7e94e2688e2a1d2005746ef
I20260709 12:09:39.962577  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 1f8b0320f7e94e2688e2a1d2005746ef (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:39.982367  4871 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:39.988270  5022 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.988487  5604 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.989270  5909 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.990142  5915 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.995826  5909 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:39.997565  5022 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:40.000039  5604 raft_consensus.cc:2955] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:40.004087  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3271fdf9e70240dc96def0f272e84933 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.010753  4774 catalog_manager.cc:5697] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:40.020277  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 3271fdf9e70240dc96def0f272e84933 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52362
I20260709 12:09:40.021157  5939 tablet_replica.cc:333] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:09:40.022230  5939 raft_consensus.cc:2243] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.022861  5939 raft_consensus.cc:2272] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.026558  5939 ts_tablet_manager.cc:1916] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.046216  5939 ts_tablet_manager.cc:1929] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.046525  5939 log.cc:1199] T 3271fdf9e70240dc96def0f272e84933 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/3271fdf9e70240dc96def0f272e84933
I20260709 12:09:40.047564  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 3271fdf9e70240dc96def0f272e84933 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
W20260709 12:09:40.317286  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080003eae0 after lost signal to thread 3728
W20260709 12:09:40.318050  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800091ca0 after lost signal to thread 4808
W20260709 12:09:40.318928  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800267880 after lost signal to thread 4900
W20260709 12:09:40.319670  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080010b3a0 after lost signal to thread 4975
W20260709 12:09:40.320377  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800234360 after lost signal to thread 5049
W20260709 12:09:40.321121  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3680 after lost signal to thread 5630
I20260709 12:09:41.110821  4951 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.117714  5020 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.120877  5943 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.121673  4871 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:41.121830  4916 consensus_peers.cc:597] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d62e31abaf34e25ad480865e4285e64. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.122948  5907 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.140451  5907 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.142148  4871 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.143975  5020 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.159631  4772 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.174500  5020 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:09:41.195410  4990 consensus_peers.cc:597] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83dd0599104f4ef0a0f49401f0f0687c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.197717  4951 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.201262  5872 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.203331  4871 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.204469  5872 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.215802  5941 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.216892  4951 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.219906  4871 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.232146  5022 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.239187  4774 catalog_manager.cc:5697] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:09:41.260548  4990 consensus_peers.cc:597] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 184edf8541a448c78939e0c2fd55ae1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.261144  4951 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.262699  5941 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.263491  4871 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.265054  5941 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.278496  5872 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.280017  4944 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.292016  4871 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.295888  4770 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.300937  4944 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.327768  5022 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.328318  4871 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.329457  5943 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:41.330415  4916 consensus_peers.cc:597] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e66df43bc3234fd5b769c5dc5afc1096. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.330961  5933 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.337065  5943 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.338646  5022 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.342163  4870 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:41.354630  4774 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:41.604995  5960 ts_tablet_manager.cc:933] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:41.606652  5960 tablet_copy_client.cc:323] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:41.607848  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 83dd0599104f4ef0a0f49401f0f0687c from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:41.608251  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 83dd0599104f4ef0a0f49401f0f0687c from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-83dd0599104f4ef0a0f49401f0f0687c
I20260709 12:09:41.616851  5034 tablet_copy_source_session.cc:215] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.619544  5960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dd0599104f4ef0a0f49401f0f0687c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.631163  5960 tablet_copy_client.cc:806] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.631641  5960 tablet_copy_client.cc:670] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.634569  5960 tablet_copy_client.cc:538] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.640003  5960 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:41.668111  5960 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.668934  5960 tablet_bootstrap.cc:492] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:41.669529  5960 ts_tablet_manager.cc:1403] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.004s
I20260709 12:09:41.672607  5960 raft_consensus.cc:359] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.673453  5960 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:41.674062  5960 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.689147  5960 ts_tablet_manager.cc:1434] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 12:09:41.693001  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-83dd0599104f4ef0a0f49401f0f0687c received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:41.693380  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-83dd0599104f4ef0a0f49401f0f0687c on tablet 83dd0599104f4ef0a0f49401f0f0687c with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:41.729164  5960 ts_tablet_manager.cc:933] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:41.730511  5960 tablet_copy_client.cc:323] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:09:41.731869  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet 7d62e31abaf34e25ad480865e4285e64 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:09:41.732267  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet 7d62e31abaf34e25ad480865e4285e64 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-7d62e31abaf34e25ad480865e4285e64
I20260709 12:09:41.737426  4961 tablet_copy_source_session.cc:215] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.740192  5960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d62e31abaf34e25ad480865e4285e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.763347  5960 tablet_copy_client.cc:806] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.763826  5960 tablet_copy_client.cc:670] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.770112  5960 tablet_copy_client.cc:538] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.777781  5960 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:41.803299  5960 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.804386  5960 tablet_bootstrap.cc:492] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:41.805022  5960 ts_tablet_manager.cc:1403] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 12:09:41.808167  5960 raft_consensus.cc:359] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.809008  5960 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:41.809505  5960 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.813443  5960 ts_tablet_manager.cc:1434] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:41.816316  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-7d62e31abaf34e25ad480865e4285e64 received from {username='slave'} at 127.0.0.1:43248
I20260709 12:09:41.816720  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-7d62e31abaf34e25ad480865e4285e64 on tablet 7d62e31abaf34e25ad480865e4285e64 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:41.850941  5960 ts_tablet_manager.cc:933] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:41.856855  5960 tablet_copy_client.cc:323] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:09:41.858089  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet e66df43bc3234fd5b769c5dc5afc1096 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:09:41.858548  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet e66df43bc3234fd5b769c5dc5afc1096 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-e66df43bc3234fd5b769c5dc5afc1096
I20260709 12:09:41.864209  4961 tablet_copy_source_session.cc:215] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.872015  5967 ts_tablet_manager.cc:933] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:41.883371  5960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66df43bc3234fd5b769c5dc5afc1096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.889534  5967 tablet_copy_client.cc:323] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:41.890913  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 184edf8541a448c78939e0c2fd55ae1f from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:41.891397  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 184edf8541a448c78939e0c2fd55ae1f from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-184edf8541a448c78939e0c2fd55ae1f
I20260709 12:09:41.899647  5034 tablet_copy_source_session.cc:215] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.904456  5967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184edf8541a448c78939e0c2fd55ae1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.923943  5967 tablet_copy_client.cc:806] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.924412  5967 tablet_copy_client.cc:670] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.927654  5967 tablet_copy_client.cc:538] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.929229  5960 tablet_copy_client.cc:806] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.929772  5960 tablet_copy_client.cc:670] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.937165  5967 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:41.938664  5960 tablet_copy_client.cc:538] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.947023  5960 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:41.973238  5967 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.975061  5967 tablet_bootstrap.cc:492] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:41.975653  5967 ts_tablet_manager.cc:1403] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.005s
I20260709 12:09:41.978447  5967 raft_consensus.cc:359] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.979205  5967 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:41.979803  5967 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:41.982391  5967 ts_tablet_manager.cc:1434] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:09:41.985021  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-184edf8541a448c78939e0c2fd55ae1f received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:41.985419  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-184edf8541a448c78939e0c2fd55ae1f on tablet 184edf8541a448c78939e0c2fd55ae1f with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:42.038707  5960 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.039510  5960 tablet_bootstrap.cc:492] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:42.040917  5960 ts_tablet_manager.cc:1403] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.011s
I20260709 12:09:42.043592  5960 raft_consensus.cc:359] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:42.044307  5960 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:42.044891  5960 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:42.059446  5960 ts_tablet_manager.cc:1434] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:09:42.069254  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-e66df43bc3234fd5b769c5dc5afc1096 received from {username='slave'} at 127.0.0.1:43248
I20260709 12:09:42.069672  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-e66df43bc3234fd5b769c5dc5afc1096 on tablet e66df43bc3234fd5b769c5dc5afc1096 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:42.197027  5604 raft_consensus.cc:1217] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.282073  5604 raft_consensus.cc:1217] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.294926  5604 raft_consensus.cc:1217] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.437214  5604 raft_consensus.cc:1217] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.695039  5943 raft_consensus.cc:1064] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:42.697570  5943 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:42.714771  5604 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.718086  5022 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.719699  5974 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.721763  5974 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.729035  4871 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.730630  5907 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.737439  5941 raft_consensus.cc:1064] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:42.739751  5941 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:42.750453  5907 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.758615  5604 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.763917  5603 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.766888  4944 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.768844  5872 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.775460  5973 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.796020  4774 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:42.797835  4871 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.816926  5972 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.820281  4951 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.830928  5974 raft_consensus.cc:1064] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:42.831900  5022 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.833353  5974 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:42.849068  4871 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.849553  5604 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.849561  5020 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.851383  5907 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.852772  4870 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.852989  5907 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.854739  5907 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.867842  5603 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.873781  5872 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.889981  5943 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.896522  5020 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.901286  5604 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.907351  4871 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.909894  4867 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.960076  4773 catalog_manager.cc:5697] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.961584  4773 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.977721  4944 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:42.978196  4951 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:42.983234  5020 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:42.983850  4871 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.985282  5943 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.987731  5603 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.989502  5603 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.991140  4867 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.992416  5943 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.996140  5603 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.995486  5980 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:42.996579  4942 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.997589  5974 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.999308  5974 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:42.997649  5872 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.003333  4875 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.005456  5973 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.006731  5604 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.013921  5907 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.017076  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e66df43bc3234fd5b769c5dc5afc1096 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.017202  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83dd0599104f4ef0a0f49401f0f0687c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.026083  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d62e31abaf34e25ad480865e4285e64 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.024842  4875 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.035163  4772 catalog_manager.cc:5697] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:43.038475  4774 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.047269  5941 raft_consensus.cc:1064] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:43.051617  5941 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:43.054196  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet e66df43bc3234fd5b769c5dc5afc1096 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55706
I20260709 12:09:43.067866  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 83dd0599104f4ef0a0f49401f0f0687c with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39302
I20260709 12:09:43.068751  4770 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:43.078764  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 79717.8us
I20260709 12:09:43.081354  5872 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.089000  5603 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.089794  4871 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.087162  5604 raft_consensus.cc:2955] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.090561  5606 raft_consensus.cc:2955] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.094374  5972 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.096130  5972 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.106019  5008 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d62e31abaf34e25ad480865e4285e64 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55706
I20260709 12:09:43.122664  5996 tablet_replica.cc:333] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:09:43.125512  5996 raft_consensus.cc:2243] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.127197  5996 raft_consensus.cc:2272] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.133226  5872 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.134999  5996 ts_tablet_manager.cc:1916] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.149590  5603 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.163519  5996 ts_tablet_manager.cc:1929] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.168983  4871 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.169772  4770 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:43.172055  5996 log.cc:1199] T 83dd0599104f4ef0a0f49401f0f0687c P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/83dd0599104f4ef0a0f49401f0f0687c
I20260709 12:09:43.181377  5994 tablet_replica.cc:333] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:09:43.182335  5994 raft_consensus.cc:2243] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.183018  5994 raft_consensus.cc:2272] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.183682  4951 raft_consensus.cc:2955] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.187734  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 83dd0599104f4ef0a0f49401f0f0687c (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:43.190357  4944 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.193493  5994 ts_tablet_manager.cc:1916] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.224596  5020 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:43.235294  4871 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.235674  5606 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.237172  5973 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.238127  5983 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.245599  5872 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.246265  4872 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.254701  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 184edf8541a448c78939e0c2fd55ae1f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.260164  4770 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:43.267398  5603 raft_consensus.cc:2955] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:43.275687  5994 ts_tablet_manager.cc:1929] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.276114  5994 log.cc:1199] T e66df43bc3234fd5b769c5dc5afc1096 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/e66df43bc3234fd5b769c5dc5afc1096
I20260709 12:09:43.277595  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet e66df43bc3234fd5b769c5dc5afc1096 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:43.277777  5994 tablet_replica.cc:333] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:09:43.278797  5994 raft_consensus.cc:2243] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.279394  5994 raft_consensus.cc:2272] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.284437  5994 ts_tablet_manager.cc:1916] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.312633  5994 ts_tablet_manager.cc:1929] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.313151  5994 log.cc:1199] T 7d62e31abaf34e25ad480865e4285e64 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/7d62e31abaf34e25ad480865e4285e64
I20260709 12:09:43.314374  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 184edf8541a448c78939e0c2fd55ae1f with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52362
I20260709 12:09:43.315152  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 7d62e31abaf34e25ad480865e4285e64 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:43.332149  6001 tablet_replica.cc:333] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:09:43.333329  6001 raft_consensus.cc:2243] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.334861  6001 raft_consensus.cc:2272] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.338577  6001 ts_tablet_manager.cc:1916] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.353353  6001 ts_tablet_manager.cc:1929] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:09:43.353700  6001 log.cc:1199] T 184edf8541a448c78939e0c2fd55ae1f P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/184edf8541a448c78939e0c2fd55ae1f
I20260709 12:09:43.355294  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 184edf8541a448c78939e0c2fd55ae1f (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:44.379719  4944 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:44.387115  5022 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.388490  5980 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.389971  4872 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:44.387877  4916 consensus_peers.cc:597] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 811353fb6b174f3e96608844f05794de. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.391986  5974 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.397027  5980 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.398578  5022 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.401711  4872 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.426406  4772 catalog_manager.cc:5697] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.429865  5020 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:44.442976  4944 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.444139  4872 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.445255  5973 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:44.445998  4990 consensus_peers.cc:597] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3805e1c03edc45ed8a91427825b04e2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.446758  5973 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.470980  5973 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.473819  4872 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.484324  4951 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.504077  5020 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:44.520605  4774 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:44.550945  4990 consensus_peers.cc:597] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bdc8c4ad3594326a9fe9ab6fdc2974d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.553449  4871 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.554718  6012 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:44.554555  4951 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.556418  5973 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.567003  5872 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.568365  4871 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.568766  4951 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.586328  4872 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:44.586679  4772 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:09:44.628463  4841 consensus_peers.cc:597] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36177f71106c42f98afc1b375e5f6838. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.628692  5020 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.630132  5999 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.630259  4942 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.632434  5999 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.639086  5999 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.640823  5020 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.647828  4942 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.670856  4770 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 2, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 1 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:09:44.850564  6021 ts_tablet_manager.cc:933] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:44.852555  6021 tablet_copy_client.cc:323] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:44.854050  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 3805e1c03edc45ed8a91427825b04e2e from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:44.854576  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 3805e1c03edc45ed8a91427825b04e2e from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-3805e1c03edc45ed8a91427825b04e2e
I20260709 12:09:44.862282  5034 tablet_copy_source_session.cc:215] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.866892  6021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3805e1c03edc45ed8a91427825b04e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.881448  6021 tablet_copy_client.cc:806] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.881963  6021 tablet_copy_client.cc:670] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:44.885306  6021 tablet_copy_client.cc:538] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:44.896448  6021 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:44.926541  6021 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:44.927436  6021 tablet_bootstrap.cc:492] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:44.928095  6021 ts_tablet_manager.cc:1403] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.008s
I20260709 12:09:44.931443  6021 raft_consensus.cc:359] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:44.932272  6021 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:44.932902  6021 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:44.936872  6021 ts_tablet_manager.cc:1434] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:09:44.940133  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-3805e1c03edc45ed8a91427825b04e2e received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:44.940518  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-3805e1c03edc45ed8a91427825b04e2e on tablet 3805e1c03edc45ed8a91427825b04e2e with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:44.951570  6025 ts_tablet_manager.cc:933] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:44.953212  6025 tablet_copy_client.cc:323] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:09:44.954599  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet 811353fb6b174f3e96608844f05794de from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:09:44.955114  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet 811353fb6b174f3e96608844f05794de from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-811353fb6b174f3e96608844f05794de
I20260709 12:09:44.970709  4961 tablet_copy_source_session.cc:215] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:44.981592  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811353fb6b174f3e96608844f05794de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:44.996877  6025 tablet_copy_client.cc:806] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:44.997414  6025 tablet_copy_client.cc:670] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.002965  6025 tablet_copy_client.cc:538] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.013933  6025 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:45.035493  6025 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.036351  6025 tablet_bootstrap.cc:492] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:45.037001  6025 ts_tablet_manager.cc:1403] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 12:09:45.039716  6025 raft_consensus.cc:359] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:45.040552  6025 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:45.041234  6025 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:45.051369  6025 ts_tablet_manager.cc:1434] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 12:09:45.061733  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-811353fb6b174f3e96608844f05794de received from {username='slave'} at 127.0.0.1:43248
I20260709 12:09:45.062129  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-811353fb6b174f3e96608844f05794de on tablet 811353fb6b174f3e96608844f05794de with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:45.095168  6025 ts_tablet_manager.cc:933] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:45.101603  6025 tablet_copy_client.cc:323] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:09:45.103116  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:09:45.103629  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-7bdc8c4ad3594326a9fe9ab6fdc2974d
I20260709 12:09:45.114248  5034 tablet_copy_source_session.cc:215] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.117499  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.131538  6025 tablet_copy_client.cc:806] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.132074  6025 tablet_copy_client.cc:670] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.135787  6025 tablet_copy_client.cc:538] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.143464  6025 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:45.167238  6025 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.168154  6025 tablet_bootstrap.cc:492] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:45.168905  6025 ts_tablet_manager.cc:1403] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 12:09:45.171603  6025 raft_consensus.cc:359] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:45.172758  6025 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:45.173426  6025 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:45.176035  6025 ts_tablet_manager.cc:1434] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:45.180657  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-7bdc8c4ad3594326a9fe9ab6fdc2974d received from {username='slave'} at 127.0.0.1:54512
I20260709 12:09:45.181042  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-7bdc8c4ad3594326a9fe9ab6fdc2974d on tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:45.201404  6025 ts_tablet_manager.cc:933] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:09:45.206583  6025 tablet_copy_client.cc:323] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:09:45.207763  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 36177f71106c42f98afc1b375e5f6838 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:09:45.208159  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 36177f71106c42f98afc1b375e5f6838 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-36177f71106c42f98afc1b375e5f6838
I20260709 12:09:45.212684  4885 tablet_copy_source_session.cc:215] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.215201  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36177f71106c42f98afc1b375e5f6838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.230571  6025 tablet_copy_client.cc:806] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.231052  6025 tablet_copy_client.cc:670] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.233814  6025 tablet_copy_client.cc:538] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.238399  6025 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:09:45.253118  6025 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.254042  6025 tablet_bootstrap.cc:492] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:09:45.256790  6025 ts_tablet_manager.cc:1403] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:09:45.260289  6025 raft_consensus.cc:359] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:45.276957  6025 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:09:45.277544  6025 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:45.278995  6025 ts_tablet_manager.cc:1434] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.000s
I20260709 12:09:45.280553  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-36177f71106c42f98afc1b375e5f6838 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:09:45.280951  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-36177f71106c42f98afc1b375e5f6838 on tablet 36177f71106c42f98afc1b375e5f6838 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:09:45.300905  5606 raft_consensus.cc:1217] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.349833  5606 raft_consensus.cc:1217] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.646032  5603 raft_consensus.cc:1217] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.759266  5872 raft_consensus.cc:1064] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:45.761138  5872 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:45.767350  4944 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.768010  5603 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.768010  4872 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.769547  6018 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.770434  5941 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.772603  5872 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:45.794093  5941 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:45.795960  4872 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:45.807791  5603 raft_consensus.cc:1217] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.809917  5606 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:45.816250  4772 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:45.881392  6041 raft_consensus.cc:1064] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:45.884789  6041 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:45.946421  5020 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.960270  5606 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.966091  4872 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:45.964720  6041 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.976639  4942 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:45.993309  6041 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:45.994436  6042 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:46.049048  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 64500.6us
I20260709 12:09:46.110561  6018 raft_consensus.cc:1064] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:46.114745  6018 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:46.127051  4942 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.131830  5872 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.139143  5603 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:46.143141  5606 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.133451  5993 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:46.144613  5872 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:09:46.498139  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:47.434165  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800323880 after lost signal to thread 3728
I20260709 12:09:47.440155  6056 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.445708  6056 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.446278  6059 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.448715  6058 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.451793  6060 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.451499  6058 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:47.452366  6056 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.452489  6060 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.452982  6056 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.453665  6056 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.454059  6058 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.454659  6058 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.454778  6060 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.450811  6059 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.455375  6060 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.455665  6056 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.455996  6060 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.456861  6059 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.455281  6058 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.458001  6060 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.458714  6058 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.466879  6062 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.467521  6062 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.468144  6063 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.468765  6063 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.470212  6062 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:47.471613  6063 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.473240  6059 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.473892  6056 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.473779  6059 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.474458  6056 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.475528  6058 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.475680  6059 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.475991  6058 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.476293  6056 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.477244  6064 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.477692  6058 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.477777  6064 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.478277  6058 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.478906  6058 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.478902  6056 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.481053  6058 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.481081  6056 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.482192  6064 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.486856  6061 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.486887  6056 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.487536  6061 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.491007  6061 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.494982  6065 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.495565  6065 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.498127  6065 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.500339  6065 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.500878  6065 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.504364  6065 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.505069  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.505745  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.506722  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.508046  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.508306  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.508651  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.508332  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.509303  4872 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:47.509426  4873 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:47.510407  6058 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.510670  6059 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.510902  6058 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.511235  6059 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.511967  4917 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:47.512794  6058 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.513204  6059 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.513374  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.513765  6059 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.513969  4876 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:47.514112  6059 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.514122  4867 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:47.512768  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:47.514566  6059 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.516074  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:47.516780  6058 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.517043  6056 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.517166  6058 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.517683  6058 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.518193  4872 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:47.517505  6056 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.522377  6056 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.522867  6059 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.524830  6059 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.524881  6058 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.501715  6047 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.526160  6047 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.527484  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:47.527974  4867 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.508716  4870 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:47.529680  6047 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.508057  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.531694  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.532167  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:47.532290  4876 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:47.532649  4873 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.530846  4868 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:47.533902  6048 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.533408  4917 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:47.535181  6048 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.536414  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:47.539665  6057 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.540145  6048 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:47.540516  4873 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:47.527808  6058 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.535509  6056 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.539669  4917 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:47.541258  6060 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.547494  6066 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.547060  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:47.548538  6067 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.548857  4867 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:47.549690  6059 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.540264  6057 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.549430  6067 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.546635  6060 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.551400  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:47.551699  6060 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.552220  4917 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:47.552106  6064 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:47.553293  6064 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.553690  6064 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.557178  6067 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.550998  6059 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.558583  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:47.557709  6056 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.559409  6056 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.559908  6059 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.555842  6066 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.568003  5024 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.568485  6066 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.568918  6058 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.573238  4870 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:47.572888  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:47.576359  4867 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.581084  4870 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:47.585686  6062 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.586261  6062 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.603816  6066 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.604394  6066 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.608596  6058 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:47.610239  6058 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.652688  5974 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.653285  5974 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:47.662786  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:47.665560  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.673839  6041 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.674412  6041 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.685619  6024 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.686173  6024 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:47.624439  6061 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.691679  6040 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.691530  6061 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:47.692216  6040 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.704555  5971 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.706668  5999 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.713449  6034 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.777648  6034 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.720592  6067 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.779593  6067 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:47.755267  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08002e9360 after lost signal to thread 4808
I20260709 12:09:47.765159  6042 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.782117  6042 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:47.771898  5606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.595s	user 0.010s	sys 0.003s
W20260709 12:09:47.788516  5606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.628s	user 0.012s	sys 0.004s
I20260709 12:09:47.795344  5606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 303) took 1642 ms. Trace:
I20260709 12:09:47.795771  5606 rpcz_store.cc:276] 0709 12:09:46.153240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:46.153390 (+   150us) service_pool.cc:224] Handling call
0709 12:09:46.153935 (+   545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:46.154399 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:46.154431 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:46.159642 (+  5211us) log.cc:844] Serialized 556 byte log entry
0709 12:09:47.795007 (+1635365us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:47.795046 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:47.795110 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:47.795149 (+    39us) raft_consensus.cc:1685] finished
0709 12:09:47.795161 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:47.795272 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1628691,"threads_started":1,"wal-append.queue_time_us":803876}
I20260709 12:09:47.867353  6033 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.868034  6033 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.898584  5941 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:47.899149  5941 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.901165  5941 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:47.954996  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:47.956864  5941 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.973692  6066 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.974730  6041 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.977542  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.977870  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.979270  6033 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:47.979331  6071 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.980123  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.979874  6064 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.980530  6060 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.698380  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:47.980954  6042 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.982071  6040 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.982776  6065 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.982519  5971 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.983371  6057 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:47.984233  6047 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.007956  6047 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:47.985574  5993 consensus_meta.cc:287] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 1.839s	user 0.043s	sys 0.027s
I20260709 12:09:48.008400  6034 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:47.973747  6062 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:47.984898  5872 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.957392  5941 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.985455  6063 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:47.985562  5999 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:47.986266  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080008b0a0 after lost signal to thread 4900
W20260709 12:09:47.987278  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 404349us
I20260709 12:09:48.007630  5971 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.011078  5872 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.011142  6063 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.012233  5971 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.012909  5872 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:48.013001  6063 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:47.619002  6056 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:47.998723  4867 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:47.993283  6073 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:48.005813  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.005929  6040 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:47.974881  5974 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.012738  5971 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:47.999995  4869 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.002929  6066 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:48.016462  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080003ed40 after lost signal to thread 4975
I20260709 12:09:48.017376  4874 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.005910  6065 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.020879  6057 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.021183  6047 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.000226  6067 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.021600  6073 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.008989  6068 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.027698  6047 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.028903  6047 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.020781  5019 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:48.024783  6061 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:48.026242  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae700 after lost signal to thread 5049
I20260709 12:09:48.029846  6063 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:48.000730  6071 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.020135  6024 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:48.036065  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003271c0 after lost signal to thread 5630
W20260709 12:09:48.036567  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800306aa0 after lost signal to thread 6045
I20260709 12:09:48.038033  5941 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:48.038702  6065 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.039074  6060 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.039179  6047 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.030336  6057 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.020730  6085 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.042872  6060 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.027529  6056 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.042577  6041 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.048506  6074 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.031446  5971 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.043855  6024 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:48.047889  6057 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.025291  6062 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:09:48.030170  6067 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.048861  6085 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.049201  6060 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.031370  6072 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.051740  6041 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.051462  6076 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:48.040043  5974 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.029356  6073 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:48.028302  6066 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.052241  5999 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.060338  6060 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.061115  6041 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.031068  6040 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.040153  6042 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.054394  6057 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.052242  6068 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:48.065459  6059 consensus_meta.cc:287] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.000s
I20260709 12:09:48.068236  6085 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.068737  6085 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.069195  6085 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.070904  6085 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.070696  6059 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.071381  6085 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.071446  6064 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.062999  6073 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.071899  6085 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.054116  6067 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:48.072785  6059 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.066629  6042 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.074316  6067 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.072407  6073 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.074847  6076 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.059275  6024 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.082270  6076 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.062486  5974 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.089177  5872 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.089990  5872 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:48.089514  6068 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.095824  6071 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.082971  6073 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.063745  6074 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.067139  6072 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.107143  6060 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.107666  6060 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.080235  6057 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.117360  6090 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.118049  6090 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.118830  5971 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:48.120208  5999 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.119153  6081 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.128407  5999 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.132895  6068 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.113054  6062 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.133435  6068 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.133544  6062 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:48.134696  6071 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.135331  6068 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:48.135205  6071 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.135654  6062 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:48.113335  6076 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.113574  6064 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.132010  5872 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.138700  5971 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.139191  6066 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.135798  6068 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:48.139870  6076 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.140208  6068 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.140733  5971 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.141932  6076 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.123591  6042 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.142544  6042 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.143131  6024 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.143039  6042 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.143783  6065 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.125519  6073 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.142586  6085 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.146409  6064 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.146660  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.147270  5605 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:48.136243  6081 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.144948  6042 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.144301  6065 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:48.149902  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.151539  5872 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.152665  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.155215  5605 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:48.142522  6068 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:48.161860  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.162464  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.162609  6068 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.163599  6060 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.163230  6068 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.164618  5999 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.154594  6040 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.171150  6064 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.172277  6074 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.173422  6057 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.174523  5974 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.182734  5999 raft_consensus.cc:1064] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:09:48.170234  6071 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.168197  6072 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.165125  6073 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.163199  5602 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:48.193691  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:48.194418  6065 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.194568  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:48.194901  6066 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:48.195262  6066 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.195601  6066 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.195799  6067 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:48.197299  6067 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.198113  6067 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.208433  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.208590  6090 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.211297  4772 catalog_manager.cc:5697] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:48.216670  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:48.218667  5999 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.220588  6090 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:48.235020  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.235585  5606 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:48.225517  6088 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.233528  6090 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:48.243852  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.268610  6090 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:48.294473  6089 log.cc:927] Time spent T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:09:48.308112  5993 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.242132  6087 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:48.296290  6073 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.271741  6081 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.322896  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.304733  6072 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.311970  6058 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.308389  6042 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.310423  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.312106  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.331609  6092 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.331822  6042 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.329702  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.326956  6058 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:48.320644  6076 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.310384  6096 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.339748  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.318882  5993 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.339972  6042 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.342947  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.332177  6092 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.345741  6058 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.342895  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.359364  5022 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.346598  6064 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.343605  5974 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.342224  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.363838  4942 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.357141  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.363444  5974 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.365564  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.338654  6041 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.362310  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.268311  6088 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.364666  4951 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.344259  6056 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.336671  6068 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.373189  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.335932  6072 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.363430  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.377100  5603 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:48.378749  5974 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.380584  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:48.381356  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.375365  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.361526  6064 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.385054  5993 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.387137  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.388216  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.351533  6076 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.370635  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.397140  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.393646  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.392711  5603 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.396574  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.324555  6087 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.372026  6096 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.399928  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.402901  4942 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.376277  6041 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.380295  6067 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.400503  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.401053  6097 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.404330  4948 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.404903  4990 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:48.404892  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.419375  6067 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:48.419588  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 48931us
I20260709 12:09:48.417129  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.425145  6079 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:48.425529  6079 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:48.397142  6092 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.425863  6079 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.406773  5604 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:48.427430  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.427837  4948 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.420535  4947 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.395556  6056 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.430195  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.430457  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:48.435678  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.436735  5020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:48.438589  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.440364  5020 raft_consensus.cc:606] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:48.440579  4947 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.440047  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.443850  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.446259  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.446610  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.412103  5568 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:48.449469  4947 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.418529  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.441733  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.451848  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:48.455437  6098 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:09:48.447484  6063 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:09:48.456771  5020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:48.457296  5020 raft_consensus.cc:606] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:48.453253  6088 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.442111  6090 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.459997  6068 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:48.462407  4951 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.445137  6066 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.463441  6072 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.430913  6097 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:48.465092  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 282605us
I20260709 12:09:48.461995  6068 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:09:48.459317  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 59555.9us
I20260709 12:09:48.470811  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.473670  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.474834  5020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:48.475144  4947 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.475338  5020 raft_consensus.cc:606] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:48.475941  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.475479  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.477959  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.478135  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.478590  4945 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:48.465782  6076 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.480688  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.475070  6056 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.473434  6068 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.485219  6064 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.466295  6096 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.520053  5020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:48.520855  5020 raft_consensus.cc:606] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:48.522435  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:48.523187  6056 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:48.523651  6056 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:48.524489  6056 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.527992  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.528587  5020 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:48.529518  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.529692  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.530133  5019 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:48.531385  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.531874  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.532577  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.532936  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.533907  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.534346  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.535008  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.531414  5020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:48.537111  5020 raft_consensus.cc:606] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
W20260709 12:09:48.538535  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.505553  6066 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.540166  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:48.540640  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.549331  4942 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.550701  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.551985  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.552786  4872 raft_consensus.cc:2393] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:48.485426  6041 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.557274  6090 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.557287  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.551380  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.580418  4874 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:48.598305  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.581277  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.600862  4872 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:48.601217  4869 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.579335  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.603701  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.587518  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.606802  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.552611  6064 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:48.553198  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.613502  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.616087  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.616508  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.617033  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.617131  4871 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.618091  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.618278  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.618655  4873 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:48.619309  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.620328  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.619352  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.625119  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.625358  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.626130  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.626565  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.627104  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.627707  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.557355  6069 consensus_queue.cc:1059] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:09:48.630553  6069 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.630880  6069 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:48.631621  6069 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.632627  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.636663  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.637573  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.638496  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.638733  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.639664  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.639900  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.640774  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.641119  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.641834  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.642349  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.642881  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.601521  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.580938  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:48.557518  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.675783  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.706301  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.632681  6069 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.675926  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.715509  4942 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:48.711010  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.710840  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.719133  4869 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.624645  6064 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.725649  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.726265  4873 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.705155  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.662006  5021 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:48.707518  6097 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.733156  4869 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.733937  4942 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.723788  6064 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.740057  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.726200  5020 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:48.712285  6079 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.745755  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:48.735139  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.748425  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:48.748973  4874 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.749109  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.749564  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:48.751091  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.751219  4871 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.749670  4875 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.754098  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.755625  5602 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.749814  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.752333  6068 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:48.759831  6068 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.761585  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.763713  5022 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.762120  4870 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.771517  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:48.772374  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.780934  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.781571  4942 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:48.798951  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:48.800567  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:48.801535  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.763543  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.806227  6079 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:48.822163  4871 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:48.823089  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.823112  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.826124  5024 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.808632  4874 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:48.833935  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.869652  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.870296  4951 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:48.870483  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.871117  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.871771  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:48.872457  5024 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:48.872560  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.873685  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.874068  6064 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.874991  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.876103  6064 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.876358  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.877245  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:48.877662  4948 raft_consensus.cc:1240] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:48.878607  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.879693  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.880185  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.880681  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.881266  4947 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:48.881387  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.881778  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.881937  4942 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:48.882323  4869 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
W20260709 12:09:48.882447  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47405.9us
I20260709 12:09:48.883220  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.885097  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:48.876665  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:48.887709  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:09:48.887931  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:48.888304  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:48.888932  6087 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:48.890112  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:48.900619  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 73818.9us
I20260709 12:09:48.901347  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:48.902272  5872 consensus_queue.cc:1059] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.905268  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:48.858147  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:48.909001  6056 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.909298  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.913630  4869 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.909968  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:48.904876  6072 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.914847  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.915544  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.916589  6092 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.918576  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.919246  4950 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:48.919754  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.919994  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.922211  6034 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.835745  6066 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:09:48.923499  6064 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.925417  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.928092  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.928278  6079 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.928634  6079 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:48.929392  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.929486  6079 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:48.930716  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.931787  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.931986  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.933807  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.933990  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.935241  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.940301  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.942147  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.949754  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.950423  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:48.967113  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 51340.3us
I20260709 12:09:48.969262  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.970095  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.971607  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:48.974169  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:48.977545  4988 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:48.985867  6069 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:48.973165  6041 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:09:48.986291  6069 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:48.986701  6069 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.986662  4988 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:48.988301  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.988734  4874 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.969077  6092 consensus_queue.cc:1059] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:09:48.990089  6092 raft_consensus.cc:3055] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.976953  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:48.991303  5872 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.985942  6062 raft_consensus.cc:3055] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.983777  4943 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:48.992554  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.994678  4869 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.993811  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.993863  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.994364  6062 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:48.995283  4870 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.995676  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.994366  4916 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:48.996083  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.996433  4875 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:48.983157  6107 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.997705  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.998642  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:48.999158  4873 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:49.006245  4916 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.007020  6041 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.007601  6041 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:48.990973  6092 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:49.005023  6109 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:49.008924  6092 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.010226  6092 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.007529  4916 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.013258  6056 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:48.995811  6062 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.013866  6056 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.014329  6056 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.014681  6079 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.019042  6097 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:49.019546  6097 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.040494  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:49.024251  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.024578  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.078714  4873 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:49.024633  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.027904  4875 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:49.075139  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 76474us
I20260709 12:09:49.034181  4876 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.029450  4872 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.022188  4916 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:49.095240  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 73114.1us
I20260709 12:09:49.095975  4916 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.097265  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.097963  6041 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.034341  4868 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.100142  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:49.013240  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:49.022450  6097 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:49.100922  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:49.023769  6062 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.104167  5601 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:49.038477  4943 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.100983  4870 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.107914  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.107185  6064 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.076200  6066 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:48.977078  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.020751  6069 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.127107  6069 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:49.126762  4774 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:49.127909  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.110689  6072 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:49.129561  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 141790us
I20260709 12:09:49.133657  4774 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.134938  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:49.135133  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.110569  6090 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.137120  6087 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.137560  6087 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.137934  6087 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:49.138839  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 167566us
I20260709 12:09:49.147894  4945 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:49.140429  4774 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.143113  6097 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.146248  6056 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.123595  6066 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:49.151650  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.137374  6090 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.154639  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.141186  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55706 (request call id 77) took 1578 ms. Trace:
I20260709 12:09:49.154343  5567 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.150763  6079 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:09:49.155224  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.162146  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.163194  4874 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.162426  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.162864  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.169211  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:49.160969  4871 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:49.165879  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.167884  6079 consensus_queue.cc:1243] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:09:49.164500  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:49.160648  6097 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.212177  6063 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.213502  6097 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.213384  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.209677  6062 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.215315  6062 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.216077  6062 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.217201  4988 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:49.217971  6112 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.162479  6109 rpcz_store.cc:276] 0709 12:09:47.562405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:47.565927 (+  3522us) service_pool.cc:224] Handling call
0709 12:09:47.578719 (+ 12792us) log.cc:844] Serialized 494 byte log entry
0709 12:09:48.007500 (+428781us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b18002971c0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:09:48.029823 (+ 22323us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5400405720. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a863142 00007f2a5a843eaa 00007f2a5a84ad53 00007f2a5a84acd9 00007f2a5a84ac69 00007f2a5a84ac31 00007f2a5a849dfd 0000000000388634 0000000000388479 00007f2a577fd475
0709 12:09:49.129454 (+1099631us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13992,"raft.run_cpu_time_us":2655,"raft.run_wall_time_us":94957,"spinlock_wait_cycles":13396608,"thread_start_us":394209,"threads_started":1,"wal-append.queue_time_us":386896,"wal-append.run_cpu_time_us":1484,"wal-append.run_wall_time_us":1001517}
I20260709 12:09:49.218312  6112 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:49.218724  6112 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.213527  6063 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.221320  6063 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.222019  6063 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.223449  6063 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.225351  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3805e1c03edc45ed8a91427825b04e2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.225725  6112 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.217034  5606 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.229511  4872 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.160939  6114 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.169382  6056 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:49.232666  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 76867us
I20260709 12:09:49.233719  4867 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.217133  6062 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.164649  6068 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.236012  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:49.157735  6090 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:49.159893  6066 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.168190  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.245038  4839 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.218577  6087 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.247912  4839 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.248653  4988 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:49.228902  6079 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:09:49.249100  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.231424  6107 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:49.249825  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:49.249780  4840 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.251729  6119 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.252174  6119 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:49.252525  6119 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.254318  5872 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.254709  5872 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:49.255043  5872 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.237722  6068 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.290601  4773 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.234187  6092 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:09:49.297267  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:49.251137  6066 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.231402  6114 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:49.299926  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 50211.3us
W20260709 12:09:49.247071  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 82655.8us
I20260709 12:09:49.302413  5872 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.265403  6112 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:49.283273  6068 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.305843  5872 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:49.293622  6097 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.253726  6034 consensus_queue.cc:1059] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:09:49.303115  6121 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.266310  6079 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.313122  6121 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:49.317458  6121 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.319042  5567 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.320118  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.307197  6090 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.328907  6120 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.333386  6121 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:49.335911  6121 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:49.342059  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.356134  6127 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.357707  6127 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.358942  5567 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.359110  6127 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.331140  6090 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:49.331257  6120 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.351871  6068 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.395030  5567 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.389483  6090 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:49.397619  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 97767.6us
I20260709 12:09:49.389374  6120 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.398365  4988 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:49.405224  6114 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.403134  6109 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.417538  6079 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:49.418677  6068 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.401189  5601 raft_consensus.cc:1240] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:49.419831  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 115475us
I20260709 12:09:49.400282  6087 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.422504  4840 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.424312  6087 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.424775  6087 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:49.425315  6114 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.425745  6087 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.427138  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:49.428258  6066 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.431524  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:09:49.431878  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.432868  5872 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.420087  6109 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:49.432444  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.434468  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.435184  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.420760  6128 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:49.437757  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 186596us
I20260709 12:09:49.438437  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.438643  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.440479  6097 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.441076  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.441618  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.435371  6115 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.448794  4945 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:49.439474  6066 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.450260  4917 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.451243  6041 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.451442  6127 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.438202  6112 raft_consensus.cc:3055] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.442808  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.452957  4839 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.435781  6109 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.454687  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:49.443506  6117 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.444380  6056 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:49.453181  6112 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.445834  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.457296  6112 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.445940  5606 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:49.447053  6069 raft_consensus.cc:993] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:09:49.433352  6114 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.453198  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.460438  5872 consensus_queue.cc:1059] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.464651  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.467657  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.468125  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.468714  5570 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.469844  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.455757  4839 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.460961  6112 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.458667  6097 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.481917  5872 raft_consensus.cc:3055] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.462854  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.462950  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.461637  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.481889  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.483860  4917 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.484409  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.464402  5016 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.484848  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.465191  6128 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.485891  5872 raft_consensus.cc:740] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.472636  4839 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.478153  6133 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.471782  6114 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:49.478899  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.470705  6068 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.439551  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:49.481528  6069 raft_consensus.cc:1081] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:09:49.478842  6122 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.481594  6127 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.487819  4839 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.490563  6064 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.493096  6087 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:49.495163  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 100945us
I20260709 12:09:49.481038  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.506291  5872 consensus_queue.cc:260] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.471442  6092 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:49.491775  6119 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.491542  6116 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.490114  6114 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.491607  6066 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.491801  6072 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.511237  4839 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.528891  5872 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.529603  4839 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.508442  6136 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:09:49.489950  6133 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.530678  6133 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.519680  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:49.520038  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.531690  6127 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.532038  6072 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.541299  6072 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.507033  5019 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:49.517521  6097 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.542196  6119 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:49.529961  6116 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.542639  6121 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:09:49.547140  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 55036.5us
I20260709 12:09:49.556349  4917 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.517204  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.563040  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:49.564899  5604 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.553548  6116 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.575598  6119 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.553016  6115 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.554888  6122 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.550730  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 3805e1c03edc45ed8a91427825b04e2e with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52362
I20260709 12:09:49.593083  6133 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.585728  6090 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.558609  6139 raft_consensus.cc:993] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:09:49.578778  6041 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:49.579632  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 70350us
I20260709 12:09:49.560173  6066 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:49.558322  6121 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:49.595003  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 65469.8us
I20260709 12:09:49.588528  6097 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:09:49.558514  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:49.599814  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 50254.9us
I20260709 12:09:49.600508  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.602087  6127 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.602707  6127 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.603006  6127 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.603209  5599 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:49.560905  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.611188  4839 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:49.611512  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 52163.1us
I20260709 12:09:49.597856  6041 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.600512  6066 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.617527  4839 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.619118  5604 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.613019  6064 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.620319  6130 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.615762  6041 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.609740  6127 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.612303  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.630066  6068 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.633008  4839 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.636924  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 811353fb6b174f3e96608844f05794de with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.626895  6123 raft_consensus.cc:1081] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:09:49.638252  6117 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.638614  6117 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:49.639400  6117 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.640504  6117 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.644294  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.644850  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:49.645363  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.645834  4917 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.654150  6134 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.656762  6134 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.657143  6134 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.624521  6109 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:49.659686  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.661849  6097 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.661923  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.662533  5570 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.663100  6130 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:49.663956  5601 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.665025  6115 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.665743  4839 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.680049  6116 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.651439  6041 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.656360  6064 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.686379  5024 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.694614  6064 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.684777  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.695196  6087 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.695488  6115 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:49.688546  6142 log.cc:927] Time spent T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:09:49.642153  6143 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:09:49.706846  6121 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:49.698877  6119 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.712245  6121 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.714977  6121 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.715293  6121 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.716032  6121 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.717202  6121 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.718039  6041 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.703329  6090 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.687873  6130 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.720774  6123 raft_consensus.cc:3055] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.734984  6114 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.736742  6109 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:49.739012  6066 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.739099  6123 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.740374  6128 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.740839  6123 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.741966  6123 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.744176  6120 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.746500  6120 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.747056  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.747076  5605 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.749763  6127 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.751796  6127 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.754021  6130 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.754248  6109 consensus_queue.cc:1059] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.755198  6109 raft_consensus.cc:3055] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.755498  6109 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.756253  6109 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.762761  6109 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.763934  6116 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.767148  6134 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.776553  6114 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.776576  4773 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 2, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.777271  6133 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.778664  6134 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.778957  4773 catalog_manager.cc:5697] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 1 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:49.765460  6072 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.791616  5605 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:49.788051  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 230105us
W20260709 12:09:49.793409  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.794962  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:49.797266  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 151486us
I20260709 12:09:49.797966  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.798116  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.798858  5020 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.799125  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:49.798841  4917 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.800495  4870 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.801357  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:49.802457  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:49.802770  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:49.802959  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.804229  4840 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.806340  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:49.806911  4868 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.808127  5019 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.808799  6114 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.806931  6149 tablet_replica.cc:333] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:09:49.810061  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.809778  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:49.812644  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.804093  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:49.814097  5024 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:49.817268  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.819914  6072 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.822710  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.822640  4871 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:49.824724  4840 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:49.809831  6130 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.833642  6129 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.834040  6129 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.834362  6129 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.813871  6117 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:49.827685  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 162108us
I20260709 12:09:49.835894  5605 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.836388  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.836623  4917 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.837239  6152 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.837466  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.810401  6146 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.838510  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.804472  6111 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:09:49.840633  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.827762  6109 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.833292  6130 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:49.828080  6066 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.829046  6121 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.845364  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.818742  6056 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.839376  6122 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.835608  6097 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:09:49.850106  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.850638  6097 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.850986  6097 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:49.850036  6112 raft_consensus.cc:993] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:09:49.851703  6112 raft_consensus.cc:1081] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:09:49.846114  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:49.852600  5024 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.843622  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.847643  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.841663  6115 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.849586  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.851789  6097 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.858599  4915 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:49.853860  4917 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.854413  6144 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.859539  4915 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.862221  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.863075  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.863864  6133 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.864004  6092 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.862455  6134 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.864885  6134 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:49.865180  5018 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.865687  6134 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.866808  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:49.867352  5019 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:49.868264  6151 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.875715  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:49.876209  4948 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.876819  6141 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:09:49.878298  5568 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.878597  5016 raft_consensus.cc:1240] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.879149  6127 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.879484  5568 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.880174  6127 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.843067  6152 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:49.870455  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.842073  6123 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.861459  6149 raft_consensus.cc:2243] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:49.868688  6151 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.869592  4839 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.869936  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.885468  6140 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:09:49.854035  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.888128  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.828399  6150 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:09:49.862516  6064 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.897883  6064 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:49.898247  6064 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.899169  6069 consensus_queue.cc:1059] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:49.900141  6069 raft_consensus.cc:3055] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.900465  6069 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.901163  6069 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.891536  6041 raft_consensus.cc:2706] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Received election callback for term 2 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:09:49.864375  6133 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:49.902314  6069 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.902707  6133 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:49.862306  6072 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:09:49.906908  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:49.864372  6092 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:49.873500  6116 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:09:49.893293  4943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52392
I20260709 12:09:49.908239  4943 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.908588  4943 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.891287  6114 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.907629  6068 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:49.909817  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:49.910483  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:49.907589  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.912652  4947 raft_consensus.cc:2393] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:49.893620  6151 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.889447  6141 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:09:49.893504  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.917879  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:49.918121  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 64160.3us
W20260709 12:09:49.920377  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:49.921794  4868 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:49.925328  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:49.926499  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.929611  4839 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.924683  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:49.927440  6121 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:09:49.934024  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:49.935304  4991 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.927660  6114 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:49.922520  6123 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.939822  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:49.941401  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.943293  4991 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.935067  6149 raft_consensus.cc:2272] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:49.938609  6117 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.944315  6140 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:09:49.969951  6147 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.942196  6114 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.970372  6147 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.973778  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.975026  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:49.975781  5872 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.976904  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:49.945616  6146 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:49.945447  6107 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.944459  6109 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.925606  5568 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.946168  6150 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.984169  6064 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.984830  4943 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:49.986091  6064 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.986697  4943 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:49.987854  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 68339us
I20260709 12:09:49.988543  6145 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.988723  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.989730  6114 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:49.990032  5568 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:49.982378  6125 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:49.992969  5599 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.981330  6146 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:49.993503  6146 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:49.993862  6128 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.007802  6129 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.009574  6079 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.942088  6092 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:50.010618  6150 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.011025  6150 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.980289  6143 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:09:50.012615  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 126087us
I20260709 12:09:49.996835  5019 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:49.998430  6127 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.011233  6092 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.003047  6120 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.020742  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:50.021131  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:50.021728  5018 raft_consensus.cc:3055] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.022109  5018 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:49.935236  6152 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.022873  5018 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.021071  6130 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:50.035099  5018 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:09:50.042851  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.050899  5599 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.011843  6150 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:50.058982  6068 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:50.059432  6068 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.062829  6056 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:50.054988  6109 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:09:50.078740  6150 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.075232  6056 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.077966  6129 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.089584  6097 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.077529  5599 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.098407  5016 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.101022  6153 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.101383  6153 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:50.102097  6153 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.103161  6153 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.105589  4943 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.107031  6127 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.108086  6147 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:50.109262  6147 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:50.125243  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 271405us
I20260709 12:09:50.125988  4917 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.135643  6136 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.136890  6107 consensus_queue.cc:1059] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:09:50.139859  6146 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.140793  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:09:50.150194  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 207516us
I20260709 12:09:50.153154  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:09:50.169778  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 229100us
I20260709 12:09:50.170435  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.186571  5024 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.188447  5020 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.189577  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.190582  4839 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.192536  4839 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.193851  4871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:09:50.194396  4871 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.194711  4867 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:09:50.194912  4871 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.195215  4867 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.195533  4867 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.196967  4917 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.183848  6144 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.198566  4874 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:50.200870  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:50.204084  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.182945  6129 consensus_queue.cc:1059] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:09:50.211124  4917 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.212416  4875 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260709 12:09:50.210348  4867 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.216002  4868 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.216337  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.210413  4871 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.170671  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.201758  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:50.200866  6158 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.232112  4917 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:50.233121  4871 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.270644  4867 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.207650  6146 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:50.309492  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 77440.5us
I20260709 12:09:50.323933  4917 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:09:50.320915  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 88774.8us
I20260709 12:09:50.324887  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:50.212954  6090 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:50.212997  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:50.225840  6111 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.225307  6136 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:50.373852  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 44249.6us
I20260709 12:09:50.320469  6041 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.215569  6056 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.372282  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:50.465116  6151 consensus_meta.cc:287] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.001s
W20260709 12:09:50.382491  6118 log.cc:927] Time spent T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:09:50.398837  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:50.380858  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 160804us
I20260709 12:09:50.212289  5025 raft_consensus.cc:2955] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:09:50.592555  6069 consensus_meta.cc:287] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.690s	user 0.017s	sys 0.017s
I20260709 12:09:50.515504  5018 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:50.326020  6141 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.365005  6064 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.517026  6114 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.375491  6157 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.597306  6056 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:50.509859  6125 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.509444  6160 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.376366  6115 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 12:09:50.372368  6162 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:09:50.597676  6097 consensus_meta.cc:287] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.508s	user 0.001s	sys 0.014s
W20260709 12:09:50.609163  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 416677us
I20260709 12:09:50.513442  6134 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:50.584895  6136 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:50.584471  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:09:50.627976  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 43595.4us
W20260709 12:09:50.619747  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 398901us
I20260709 12:09:50.625108  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.626760  4872 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:09:50.585213  6111 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:50.615320  6064 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:50.621450  4943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.016s	sys 0.041s
I20260709 12:09:50.646804  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.619565  6056 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.608035  6151 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.616189  6146 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:50.668701  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.623548  6157 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:50.658320  4943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.016s	sys 0.041s
I20260709 12:09:50.645579  6136 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.678249  6092 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.718827  6092 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:50.719180  6092 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.675829  6145 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:50.721040  6145 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:50.721386  6145 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.676028  6157 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:50.728248  6165 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
I20260709 12:09:50.730590  6151 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:50.732110  6068 consensus_meta.cc:287] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.668s	user 0.004s	sys 0.003s
I20260709 12:09:50.732511  6068 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:50.732931  6157 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.734766  6157 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.735181  6066 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:50.634644  6134 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:50.677991  6116 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:09:50.707361  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 811353fb6b174f3e96608844f05794de with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39302
I20260709 12:09:50.660490  6141 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:09:50.708454  6150 raft_consensus.cc:3055] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:09:50.708695  6153 consensus_meta.cc:287] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.011s
I20260709 12:09:50.708784  6146 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:50.709878  6164 log.cc:927] Time spent T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:09:50.712240  4874 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:50.713539  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 65468.9us
I20260709 12:09:50.650238  5023 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:50.680794  4867 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.658598  6064 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.710489  6072 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:09:50.658957  6152 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.715286  5568 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:50.756759  6068 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.760174  6146 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:50.735404  6147 consensus_meta.cc:287] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.004s
I20260709 12:09:50.762022  6149 ts_tablet_manager.cc:1916] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:50.762416  6134 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.743589  6150 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:50.763610  6150 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:50.764616  6150 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.742365  6161 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:50.681308  4871 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:50.707389  6167 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:09:50.627247  6160 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:50.676403  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 351599us
W20260709 12:09:50.741629  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:50.706964  6111 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:50.673831  6173 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.744391  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:50.749125  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 74177.3us
I20260709 12:09:50.679757  6171 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:50.772994  5019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4699787549416cb829da40d250e0cf"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:50.737057  6066 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.778831  5019 raft_consensus.cc:606] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
W20260709 12:09:50.793393  6169 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:09:50.793695  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:50.794262  5023 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.794552  5023 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:50.795284  5023 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.796155  5023 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.798588  6145 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.800043  4870 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.800153  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.801474  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.802003  4871 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.802659  4873 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.803529  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.803848  4840 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:50.804179  4873 raft_consensus.cc:2393] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:50.804777  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.805444  4869 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.805893  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.806075  6145 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.807006  4870 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.807194  4876 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.808574  5016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:50.809010  6090 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.809180  5016 raft_consensus.cc:606] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:50.809512  6090 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:50.810369  6090 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.813243  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.813772  4872 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.817922  5016 raft_consensus.cc:1240] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.818815  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.819737  5019 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.781492  6129 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.821357  6129 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:50.822130  6129 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.823082  6129 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.774547  6153 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:50.774365  6160 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.765381  6161 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:50.786463  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 108341us
I20260709 12:09:50.787031  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:50.787487  6068 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.788242  6092 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.843042  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.789942  6133 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:50.780635  6171 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:50.831902  6168 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:09:50.826459  4871 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:50.826820  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:50.828557  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:50.848097  4917 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.830683  4872 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
W20260709 12:09:50.831105  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 50870.5us
I20260709 12:09:50.831856  5019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:50.854240  5019 raft_consensus.cc:606] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:50.835824  5022 raft_consensus.cc:3055] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.839628  5020 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.840097  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:50.846819  5604 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.856519  5022 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:50.857405  5024 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:50.807360  4869 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.841576  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.859208  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:50.860937  5017 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.861768  6115 consensus_queue.cc:1059] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.818257  6066 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.865095  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:50.863615  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.866324  6041 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.866876  6172 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.867728  4868 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:50.867508  4770 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:50.840924  6157 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:50.876492  4991 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:50.849251  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:50.864743  6151 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.863551  6122 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:50.840651  6141 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:09:50.870059  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:50.842758  6145 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:09:50.840970  6153 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.885520  5872 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.886638  6180 tablet_replica.cc:333] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:09:50.886780  6122 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.881438  6069 consensus_queue.cc:1059] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:09:50.891886  5601 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:50.894380  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 71421us
I20260709 12:09:50.900797  5019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:50.904233  5019 raft_consensus.cc:606] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:50.865016  6178 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:09:50.905539  5019 raft_consensus.cc:614] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:50.863070  6133 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:50.894582  6152 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.872377  6172 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.904857  6072 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:50.878944  6157 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.926332  6180 raft_consensus.cc:2243] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:50.929744  6161 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:50.930724  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:50.906540  6056 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.916958  6136 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:50.939779  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 98280.2us
I20260709 12:09:50.932366  6092 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.942113  6152 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:50.941883  6175 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:50.944769  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:50.945531  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:50.946626  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:50.948079  4945 raft_consensus.cc:2393] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:50.950879  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:50.951555  4942 raft_consensus.cc:2393] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:50.952385  6140 raft_consensus.cc:3055] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.952761  6140 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:50.953519  6140 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.954995  4915 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
W20260709 12:09:50.961934  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 98388.2us
I20260709 12:09:50.962549  4917 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.959522  6145 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.965131  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:50.962976  5022 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:50.948916  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 83988.4us
I20260709 12:09:50.968042  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:50.965809  4946 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.969657  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:50.971755  6133 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.942643  6152 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:50.981880  6133 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.973503  6141 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.983513  6141 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:50.961236  6180 raft_consensus.cc:2272] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:50.972258  6064 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:50.976939  6157 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.977303  5023 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:50.977698  5022 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.978037  6136 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.978837  6111 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.983127  6152 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:50.992390  6064 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.993270  4915 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:50.965443  6182 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:09:50.984369  6172 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:50.975723  6056 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:51.003101  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:51.002120  6134 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.984856  6140 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.004618  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:50.974349  6160 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.005904  6150 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.007817  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.017483  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.018905  4915 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:51.014150  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 72384.6us
I20260709 12:09:51.020908  6157 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.023847  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:51.025933  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:51.010773  6145 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:51.027853  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.027963  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.029100  5019 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:51.017472  6172 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.017307  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:51.029963  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.019488  6064 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.035874  4946 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.038686  5022 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.032491  5024 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:51.009835  6185 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:09:51.031905  6175 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.019060  5021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:51.034036  6161 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.030915  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.034773  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:51.039800  6175 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:51.040267  5872 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:09:51.012877  6150 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.044078  6161 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.044760  6175 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:50.984552  6141 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.041296  5021 raft_consensus.cc:606] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:51.046048  6180 ts_tablet_manager.cc:1916] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.053558  4942 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.049337  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:51.034148  6172 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.058552  6130 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.052611  5021 raft_consensus.cc:614] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:51.059340  6134 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.075242  5016 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.080251  4942 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.083510  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:51.085135  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:51.085647  6150 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:51.086787  4942 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.076619  6134 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:51.088881  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.088987  6161 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.090296  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:51.078747  6153 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:51.084292  4943 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.082502  6141 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.099896  6122 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:51.100351  4947 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.100715  4946 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.097641  5601 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.100788  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.087409  6064 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:09:51.101500  6149 ts_tablet_manager.cc:1929] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:51.101995  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.096192  6179 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.123317  6179 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:51.103600  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:51.072091  6145 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.105615  4840 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:51.101053  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:51.111043  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.111774  6171 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:51.111363  4942 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.097831  6134 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.114524  6160 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.119385  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:51.124272  6172 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.128561  4870 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:51.124790  4871 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:51.127203  4840 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:51.112342  5599 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.114122  6143 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.140579  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:51.151567  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.151950  5600 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.152665  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.126498  6185 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:51.154706  6154 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.155537  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:51.129488  6149 log.cc:1199] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/3805e1c03edc45ed8a91427825b04e2e
I20260709 12:09:51.158854  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:51.162530  4871 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:51.162878  4991 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:51.163762  4991 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:51.138145  6153 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.153239  5016 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.150707  6143 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:51.179463  4942 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.180371  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:51.150489  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:51.165292  6130 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.154832  6185 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:51.177289  6090 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:51.161988  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 46366.7us
I20260709 12:09:51.165477  6171 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.186767  6192 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.157718  6111 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:09:51.200127  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:51.178120  6153 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:51.194938  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.195474  4946 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.195657  4945 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.183192  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.191576  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.202935  4951 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.155200  6154 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:51.183310  6129 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.209793  4947 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.201540  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:51.210994  4950 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:51.202211  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.124130  6179 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.213191  4942 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.211504  4948 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:51.194147  6090 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.214818  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.197839  6130 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:51.217922  4839 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.214721  6177 consensus_queue.cc:1059] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:09:51.214886  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.212978  6150 consensus_queue.cc:1059] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:09:51.227265  5601 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:51.225551  4873 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:51.228694  4945 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.212224  6129 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.209302  6097 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.216869  6090 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.232187  4839 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.216089  5018 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.227274  6176 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.247617  4839 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.224460  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.238655  6129 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.205957  6171 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.252195  6185 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:51.253329  6149 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52362 (request call id 71) took 1736 ms. Trace:
I20260709 12:09:51.253703  6149 rpcz_store.cc:276] 0709 12:09:49.542845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:49.549256 (+  6411us) service_pool.cc:224] Handling call
0709 12:09:49.806577 (+257321us) ts_tablet_manager.cc:1151] Deleting tablet 3805e1c03edc45ed8a91427825b04e2e
0709 12:09:49.806669 (+    92us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:09:50.929599 (+1122930us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:51.101364 (+171765us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:51.253098 (+151734us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c61a2 00007f2a60707889 00007f2a5f838d88 00007f2a5f901c8e 00007f2a5f904c59 00007f2a5f92da7e 00007f2a5f92da49 00007f2a5f92da05 00007f2a5f91ec66
0709 12:09:51.253256 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18285,"spinlock_wait_cycles":15918336,"tablet-delete.queue_time_us":213027,"thread_start_us":186664,"threads_started":1}
I20260709 12:09:51.263515  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.244396  6147 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.269006  4839 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.271567  4839 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.272557  4839 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:51.274245  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:51.246953  6114 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.265703  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 3805e1c03edc45ed8a91427825b04e2e (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:09:51.250473  6179 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.227942  6130 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.281839  6172 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.275733  6192 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.285593  6192 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:51.278017  6173 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.276554  6140 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.279544  6097 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.247434  6153 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.282426  6146 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.299180  4840 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.276278  6147 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.262063  6143 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.277036  6133 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:09:51.288069  6192 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.296557  6144 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:51.339583  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:51.359489  4951 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.449653  5603 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:51.371783  4916 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.450731  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:51.453013  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 81306.5us
I20260709 12:09:51.457057  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.461697  4951 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:51.462563  6160 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.312990  6068 raft_consensus.cc:697] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:51.463069  6146 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.368521  6072 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:51.463922  6068 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.387768  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.464512  6072 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.465396  5017 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.369158  6090 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.354671  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.467481  4947 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:51.468413  6090 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.468484  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:51.463002  6063 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.469211  6072 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.469345  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:51.469624  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:51.470196  5603 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.475184  6090 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.475642  6090 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.476040  6090 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.471263  6063 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.478792  6063 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.482035  6146 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.338249  6148 raft_consensus.cc:993] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:09:51.482542  6146 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.484540  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:51.393772  6125 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.369889  6133 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.386569  5021 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.319687  6122 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.480454  6129 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.342757  6147 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.395641  6111 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:51.488391  6173 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.357180  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:51.416213  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.352165  6143 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.414638  6154 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:51.448021  6134 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.486995  6125 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:51.423257  6171 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.496555  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:51.497161  6146 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.507364  5601 raft_consensus.cc:2393] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:51.494105  6173 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:51.490432  6139 raft_consensus.cc:1081] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:09:51.498309  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.510828  4947 raft_consensus.cc:1803] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.3
I20260709 12:09:51.511296  4947 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.500015  5603 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:51.501289  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:51.513047  5605 raft_consensus.cc:2410] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:09:51.514004  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:51.514843  5600 raft_consensus.cc:2393] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:51.515004  6171 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:51.502091  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:51.517805  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.517382  6171 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:51.519133  5021 raft_consensus.cc:2410] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:09:51.504148  5018 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.513902  6173 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.533016  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.471469  6144 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.491370  6133 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.495026  6111 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.534484  5017 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.510877  6154 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:09:51.535440  6146 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:51.564043  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:09:51.564852  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.018s	sys 0.019s
W20260709 12:09:51.572147  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.018s	sys 0.019s
W20260709 12:09:51.572690  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 610167us
I20260709 12:09:51.573323  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.574282  6141 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.574733  6141 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:51.574781  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:51.575502  6157 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.575616  6141 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.519451  6171 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.562722  6134 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:51.578025  5601 raft_consensus.cc:2393] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
W20260709 12:09:51.577852  6041 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.006s	sys 0.033s
I20260709 12:09:51.577912  6185 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:51.552487  6192 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.578123  6114 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:51.597040  5019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.024s
W20260709 12:09:51.598138  5024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.016s	sys 0.028s
W20260709 12:09:51.597608  6041 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.008s	sys 0.033s
W20260709 12:09:51.608242  5019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.008s	sys 0.024s
W20260709 12:09:51.608500  5024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.016s	sys 0.028s
W20260709 12:09:51.607862  5025 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.016s	sys 0.015s
I20260709 12:09:51.617916  6134 consensus_queue.cc:1059] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.614864  6157 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:51.597311  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:51.552733  6125 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:51.631181  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.629112  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:51.630000  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:51.641320  5872 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:51.641564  5025 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.017s	sys 0.015s
W20260709 12:09:51.602844  6188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.018s	sys 0.013s
I20260709 12:09:51.627796  6133 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:51.645417  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:09:51.641516  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 440386us
I20260709 12:09:51.628782  6144 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:51.642930  5023 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.012s	sys 0.037s
I20260709 12:09:51.996932  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:52.001950  5023 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.017s	sys 0.062s
W20260709 12:09:51.770040  5016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.020s	sys 0.009s
W20260709 12:09:52.002961  5016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.030s	sys 0.015s
I20260709 12:09:51.617538  6114 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:51.770208  5022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.000s	sys 0.030s
W20260709 12:09:52.003769  5022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.006s	sys 0.042s
I20260709 12:09:52.004402  6213 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:51.778244  4991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.015s
I20260709 12:09:51.646904  4948 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
W20260709 12:09:51.778395  6177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.014s
I20260709 12:09:51.744203  6139 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:09:51.778499  6116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.006s	sys 0.012s
I20260709 12:09:51.640295  6129 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:51.769049  4870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.024s	sys 0.006s
I20260709 12:09:51.991091  6151 raft_consensus.cc:2764] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Leader election decision vote started in defunct term 2: won
I20260709 12:09:51.689699  5018 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.749007  5017 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:51.716877  6090 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
W20260709 12:09:52.011171  4991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.004s	sys 0.021s
I20260709 12:09:52.011286  6133 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.751729  6180 ts_tablet_manager.cc:1929] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:51.689168  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:09:52.009065  6188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.018s	sys 0.025s
I20260709 12:09:51.856490  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:51.702282  6146 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:51.827286  4950 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.008s	sys 0.029s
W20260709 12:09:52.028296  4950 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.010s	sys 0.031s
I20260709 12:09:52.007463  4873 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:51.699846  6148 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.029692  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:52.006453  5872 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:09:52.015430  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 370071us
I20260709 12:09:52.032775  5872 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:52.017266  4870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.027s	sys 0.007s
I20260709 12:09:51.624770  6173 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:51.643711  6175 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:51.703218  6111 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:52.009505  6130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.013s
I20260709 12:09:52.006793  6125 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.000109  6068 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:51.640900  5599 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:51.673309  6157 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.008534  6192 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:51.709816  6193 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.023021  6211 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:09:52.054649  6193 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.055485  6211 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.055845  6211 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:51.986080  6190 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.026575  5019 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:52.056638  6211 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.058113  6211 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.026647  4947 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.016788  6066 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.018510  6145 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:51.642575  6063 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:52.042263  6130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.013s	sys 0.013s
W20260709 12:09:52.015930  6177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.006s	sys 0.019s
I20260709 12:09:52.045323  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.036489  6146 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.046943  6068 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.026242  6133 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.049918  6207 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.031147  6180 log.cc:1199] T 811353fb6b174f3e96608844f05794de P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/811353fb6b174f3e96608844f05794de
I20260709 12:09:52.025627  6143 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.053288  6230 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.027218  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:52.082623  4948 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.028648  6153 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:52.090739  6222 log.cc:927] Time spent T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:09:52.032033  5601 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.093212  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 716) took 1043 ms. Trace:
I20260709 12:09:52.093595  5023 rpcz_store.cc:276] 0709 12:09:51.049843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.051617 (+  1774us) service_pool.cc:224] Handling call
0709 12:09:51.101877 (+ 50260us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5eee 000000000036eb39 00007f2a5f8391e0 00007f2a5f9020c4 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:09:51.102039 (+   162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:51.102233 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:52.002376 (+900143us) log.cc:844] Serialized 14 byte log entry
0709 12:09:52.081957 (+ 79581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:52.092908 (+ 10951us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:52.092962 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.093041 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.093155 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":620411,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":5106,"spinlock_wait_cycles":24074496,"thread_start_us":965796,"threads_started":2}
I20260709 12:09:52.096292  4948 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:52.060787  4871 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3.
I20260709 12:09:52.096652  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.090572  6153 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.004972  6114 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.019961  6139 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.098196  6180 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39302 (request call id 71) took 1466 ms. Trace:
I20260709 12:09:52.063084  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.053881  6111 consensus_queue.cc:1059] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:09:52.039723  6116 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:52.098933  6139 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.099972  6116 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:52.100378  6139 raft_consensus.cc:3055] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.100680  6139 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:52.100831  6116 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.059690  6213 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.101378  6146 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.056684  6193 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.072568  6160 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.059059  6066 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.057811  6190 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.061302  6145 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:52.040231  6148 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.025815  6154 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.082908  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 715) took 1033 ms. Trace:
I20260709 12:09:52.105846  6146 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.129204  6145 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.070358  6207 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:52.106076  6114 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.130214  6114 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.118763  6133 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.130440  6207 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:52.117440  6206 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:09:52.101778  6213 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.132071  6114 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.101985  6143 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.121234  6175 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.134131  6175 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.109549  4947 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.140416  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.141000  4951 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:52.137482  6179 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.142333  6207 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.142234  6179 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.142897  5601 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:52.143848  6193 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.144901  5567 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:52.145083  6173 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.145766  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:52.146605  5605 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:52.100672  6130 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.148367  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:52.152052  6133 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.152455  6133 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.152842  6133 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.133467  6160 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.155208  6160 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.129535  6146 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.125337  6150 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.157209  6150 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.159130  6150 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.128908  6147 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.159893  6147 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.159530  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:52.161793  5599 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:52.126660  6068 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.120966  6079 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.082192  6230 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.090023  4946 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.099050  6153 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.166869  4949 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:52.133061  6213 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.155702  6235 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.167014  6230 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.167968  6079 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:52.168321  6235 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:52.169445  6148 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.117311  6116 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.134140  6157 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.122565  6107 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.126195  6063 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.129607  5025 rpcz_store.cc:276] 0709 12:09:51.049540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:51.049642 (+   102us) service_pool.cc:224] Handling call
0709 12:09:51.049878 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:51.050042 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:52.012863 (+962821us) log.cc:844] Serialized 14 byte log entry
0709 12:09:52.082593 (+ 69730us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:52.082647 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:52.082688 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.082751 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:52.082854 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1213,"prepare.queue_time_us":672448,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":18817,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":1017844,"threads_started":2,"wal-append.queue_time_us":160316}
I20260709 12:09:52.087940  5872 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.133566  4840 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:52.132974  6154 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.161906  6147 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.183137  5872 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.166770  6133 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.187783  6066 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.190990  6230 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.193135  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:52.191754  6079 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.194214  6154 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.194556  6079 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.197332  6230 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.198203  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:52.198802  4950 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.184137  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:52.201296  5599 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.202008  6079 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.203399  6079 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.098583  6180 rpcz_store.cc:276] 0709 12:09:50.663174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.707074 (+ 43900us) service_pool.cc:224] Handling call
0709 12:09:50.869124 (+162050us) ts_tablet_manager.cc:1151] Deleting tablet 811353fb6b174f3e96608844f05794de
0709 12:09:50.869179 (+    55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:09:51.353084 (+483905us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:51.751595 (+398511us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:52.098120 (+346525us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2439,"tablet-delete.queue_time_us":126828,"thread_start_us":76984,"threads_started":1}
W20260709 12:09:52.232863  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 213211us
W20260709 12:09:52.234314  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 100817us
I20260709 12:09:52.101447  6139 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:52.247313  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.169332  6235 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.258026  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.258602  5019 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:52.205418  6146 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.175364  6130 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.253175  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:52.261866  5603 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:52.252897  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:52.245504  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:52.252974  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.198148  6179 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.254264  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:52.260936  5019 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.262317  5605 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.266131  5872 consensus_queue.cc:1059] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.264528  5025 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:52.183073  6107 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.253279  6154 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:52.269623  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:52.281827  4871 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:52.282310  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.282694  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:52.282853  5019 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:52.283751  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:52.270237  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:52.275372  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:52.284618  4873 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.271124  4868 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c4699787549416cb829da40d250e0cf"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:09:52.285732  4868 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.286069  4868 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.286693  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:52.287711  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:52.288206  4875 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:52.260257  6147 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:09:52.277797  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:52.289853  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:52.290091  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 152399us
I20260709 12:09:52.290644  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:52.291270  4870 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:52.272792  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:52.293488  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:52.294337  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:52.294708  4874 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:52.277689  5570 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3.
I20260709 12:09:52.277887  6079 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.265443  6090 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.224581  6190 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.278759  5872 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.261978  6063 consensus_queue.cc:1059] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:09:52.279796  6133 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.280179  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.269542  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:52.262391  6143 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.280758  6230 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.262619  5018 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:52.277184  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:52.294288  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.294850  4948 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.265215  6139 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.280305  6107 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.343854  4950 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:52.378391  5601 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:52.373467  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.305500  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.383343  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 194) took 1598 ms. Trace:
I20260709 12:09:52.315410  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.303385  5872 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:52.317255  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:52.384588  4867 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.384742  5872 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.340575  5605 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:52.386229  5023 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
W20260709 12:09:52.378847  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 45503.3us
I20260709 12:09:52.387439  5600 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:52.387794  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:52.388612  4990 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:52.389611  4945 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:52.389424  6234 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.391810  6211 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.392333  6211 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:52.392977  6147 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.388608  6129 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:09:52.393366  6147 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.393720  6147 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:52.362039  6237 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:09:52.347546  6130 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.394451  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:52.395442  5025 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.371285  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.396338  4951 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:52.361420  6150 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.396842  6211 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.399010  4917 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:52.400022  6116 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.313907  6063 raft_consensus.cc:3055] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.400079  4772 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 2, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.401250  4917 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:52.381175  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:52.402354  6116 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.402648  5019 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.396955  6150 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:52.403239  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:52.404119  6116 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:52.404543  6116 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:52.308279  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.301290  5570 leader_election.cc:403] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:09:52.405616  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 128135us
I20260709 12:09:52.405031  6116 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:52.313967  6232 log.cc:927] Time spent T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:09:52.291333  6154 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.406451  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.406819  6154 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.407094  5021 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:52.410223  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.410776  5021 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:52.401237  6063 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:52.413472  5599 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:52.412685  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:52.414489  6068 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.414839  6068 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.415164  6068 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.417831  6063 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.314134  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 811353fb6b174f3e96608844f05794de (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
W20260709 12:09:52.421553  4761 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 115620us
I20260709 12:09:52.423767  6068 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.424127  6147 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.425695  6234 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.285457  6177 consensus_queue.cc:1059] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 12:09:52.426995  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:52.377743  6146 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.427575  5599 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.428084  6146 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.429850  6179 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.430315  6179 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.426306  6068 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.421053  6063 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.432224  6179 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.405447  4943 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.437274  4870 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.438153  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:52.439189  6179 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.362869  4868 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.427425  6116 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.440773  4949 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:52.441598  4942 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:52.442763  5570 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:52.347752  4873 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:52.444028  4943 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:52.445151  5602 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:52.445592  4917 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:52.340040  6175 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.446686  6179 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.404155  6150 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.448154  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:52.448776  4917 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:52.449081  6238 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.427343  6177 raft_consensus.cc:3055] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.449443  6238 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.448271  6150 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.449735  6177 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:52.449919  6179 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:52.450647  6177 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.451752  6177 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.452625  6233 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.452961  6238 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.453306  4917 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:52.454006  4917 leader_election.cc:403] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:52.399021  4773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 217) took 1680 ms. Trace:
I20260709 12:09:52.346653  6145 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:52.466734  4868 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.454726  4773 rpcz_store.cc:276] 0709 12:09:50.718367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.718509 (+   142us) service_pool.cc:224] Handling call
0709 12:09:50.790299 (+ 71790us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5400240090. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c60b2 00007f2a6073f759 00007f2a606d7a76 00007f2a606a8d58 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc
0709 12:09:52.398965 (+1608666us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64779,"reported_tablets":1,"spinlock_wait_cycles":44099328}
I20260709 12:09:52.442889  5019 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:52.444161  4873 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:52.457907  4948 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:52.462529  5872 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.426169  4770 rpcz_store.cc:276] 0709 12:09:50.785351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.785461 (+   110us) service_pool.cc:224] Handling call
0709 12:09:52.383266 (+1597805us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:50.951903 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:50.952426 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:50.952454 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:09:50.952470 (+    16us) tablet.cc:662] Decoding operations
0709 12:09:50.952767 (+   297us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:50.952830 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:50.952859 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:50.953036 (+   177us) tablet.cc:701] Row locks acquired
0709 12:09:50.953052 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:09:50.953173 (+   121us) write_op.cc:270] Start()
0709 12:09:50.953265 (+    92us) write_op.cc:276] Timestamp: P: 1783598990953137 usec, L: 0
0709 12:09:50.953284 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:09:50.953857 (+   573us) log.cc:844] Serialized 594 byte log entry
0709 12:09:52.067185 (+1113328us) op_driver.cc:464] REPLICATION: finished
0709 12:09:52.286764 (+219579us) write_op.cc:301] APPLY: starting
0709 12:09:52.286842 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:52.286938 (+    96us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:52.287037 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:52.287228 (+   191us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:52.287364 (+   136us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:52.287403 (+    39us) write_op.cc:312] APPLY: finished
0709 12:09:52.287579 (+   176us) log.cc:844] Serialized 22 byte log entry
0709 12:09:52.287738 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:52.287806 (+    68us) write_op.cc:454] Released schema lock
0709 12:09:52.287844 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:52.359866 (+ 72022us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e732a 00007f2a5a86cf14 00007f2a5a86cec3 00007f2a5a86ce38 00007f2a5a86cdf3 00007f2a5a86c0dc 00007f2a5a895e16 00007f2a5a87dcbb 00007f2a5a86839d 00007f2a5a86bd75
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":215460,"apply.run_cpu_time_us":1404,"apply.run_wall_time_us":1404,"num_ops":1,"prepare.queue_time_us":81717,"prepare.run_cpu_time_us":45542,"prepare.run_wall_time_us":1084619,"raft.queue_time_us":235273,"raft.run_cpu_time_us":11483,"raft.run_wall_time_us":350393,"replication_time_us":1098968,"spinlock_wait_cycles":62459264,"thread_start_us":1301679,"threads_started":4,"wal-append.queue_time_us":819436}]]}
I20260709 12:09:52.426182  6234 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.428366  5025 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:52.471285  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:52.462277  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.466375  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:52.480362  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:52.481057  4868 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.481292  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:52.481986  6130 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:52.482615  6130 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:52.482740  6066 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.453538  6179 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:52.487287  6179 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.491179  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:52.491943  5019 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3.
I20260709 12:09:52.492851  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.484910  4840 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:52.494203  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.494762  5020 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:52.495967  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:52.496487  5020 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.467443  6133 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3.
I20260709 12:09:52.499286  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:52.506578  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:52.453178  6233 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.479578  6134 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:52.479624  6160 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:52.505117  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:52.467368  6147 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:52.484562  6173 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:52.568398  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 80005.5us
I20260709 12:09:52.515482  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:52.528918  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.569916  5024 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:52.547111  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.566063  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:52.520577  4867 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:52.571260  4947 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.570631  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.498759  6079 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.573537  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.577804  4948 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:52.579916  5020 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
W20260709 12:09:52.580964  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 80333.9us
I20260709 12:09:52.520269  4840 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:52.588083  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 67883.8us
I20260709 12:09:52.588687  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:52.499192  6125 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.499063  6148 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.593518  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.499313  6143 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.621939  4867 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.622745  4915 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:52.626106  4868 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
W20260709 12:09:52.678623  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 73317.5us
I20260709 12:09:52.628105  4947 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:52.513512  6153 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:52.505190  6240 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.488445  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:52.568006  6066 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:52.565699  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:52.510751  6175 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.510556  6241 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.566110  6141 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.568044  6173 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.628544  6144 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.638041  6148 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.628746  6122 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.622615  6211 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.672354  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.673333  4873 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:52.622648  6213 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.566497  6134 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.676092  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:52.676913  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:52.677500  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 108119us
I20260709 12:09:52.677800  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.679670  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:52.719901  4839 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:52.720685  4950 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:52.720793  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:52.687579  6041 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:52.688093  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.673894  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.676651  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.724275  4942 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:52.697016  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:52.655820  6116 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.634954  6079 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.634011  6125 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.634402  6143 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.663303  6256 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.695191  6090 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.684147  6072 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:52.696128  6153 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.723904  5568 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3.
W20260709 12:09:52.714812  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 235001us
W20260709 12:09:52.726420  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:52.700325  6066 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.697769  5599 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:52.714900  6173 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.730347  4947 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:52.734040  4944 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:52.714562  6063 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.718820  6190 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:52.719642  6130 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:52.714306  6183 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:52.780642  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 87351.4us
I20260709 12:09:52.844534  6063 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.699779  6240 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.715292  6141 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.752933  6116 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.734964  6147 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.879273  4772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 119) took 2085 ms. Trace:
I20260709 12:09:52.753072  6175 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:52.723083  6213 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.722689  6211 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.819386  6066 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.781059  6153 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:52.915093  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 90052.9us
I20260709 12:09:52.916851  4988 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:52.723666  6241 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.819789  6068 raft_consensus.cc:2764] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:09:52.729849  6041 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:52.851267  6146 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.848701  6230 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:52.775424  6256 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.059725  6115 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:53.141722  6041 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:53.141454  6115 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.142524  6256 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:53.143258  6041 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.909864  6079 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:53.060580  6235 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:53.061920  6171 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:52.878592  6064 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:53.157197  6171 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:53.157316  6064 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:53.159193  6171 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:53.159518  6064 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:52.921767  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 211028us
W20260709 12:09:52.985715  6258 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:09:52.781997  6090 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:52.818941  6072 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.093320  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:53.183327  5020 raft_consensus.cc:2368] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:53.060184  6129 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:52.909049  6206 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:09:53.184288  6171 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.204154  6171 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:53.195900  6150 consensus_meta.cc:287] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.746s	user 0.004s	sys 0.002s
I20260709 12:09:53.205367  5017 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:53.168063  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:53.192667  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:53.206434  5600 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:53.206730  5020 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:53.207886  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.208645  5020 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:53.121206  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:53.121402  6107 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:53.122212  6252 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
W20260709 12:09:53.123392  6251 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 12:09:53.228140  6129 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.230039  6129 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.230209  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.230814  5016 raft_consensus.cc:2376] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3. Re-sending same reply.
I20260709 12:09:53.231700  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:53.232244  5016 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.237298  5016 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:53.237542  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.037499  6157 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.090993  4772 rpcz_store.cc:276] 0709 12:09:50.793477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.793755 (+   278us) service_pool.cc:224] Handling call
0709 12:09:52.879206 (+2085451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:52.403294 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:52.403772 (+   478us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:52.403805 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:09:52.403821 (+    16us) tablet.cc:662] Decoding operations
0709 12:09:52.404140 (+   319us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:52.404194 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:52.404219 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:52.404388 (+   169us) tablet.cc:701] Row locks acquired
0709 12:09:52.404406 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:09:52.404529 (+   123us) write_op.cc:270] Start()
0709 12:09:52.404633 (+   104us) write_op.cc:276] Timestamp: P: 1783598992404491 usec, L: 0
0709 12:09:52.404650 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:09:52.405195 (+   545us) log.cc:844] Serialized 532 byte log entry
0709 12:09:52.406845 (+  1650us) op_driver.cc:464] REPLICATION: finished
0709 12:09:52.409700 (+  2855us) write_op.cc:301] APPLY: starting
0709 12:09:52.409769 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:52.409862 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:52.409938 (+    76us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:52.410130 (+   192us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:52.410259 (+   129us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:52.410298 (+    39us) write_op.cc:312] APPLY: finished
0709 12:09:52.410464 (+   166us) log.cc:844] Serialized 22 byte log entry
0709 12:09:52.411211 (+   747us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:52.411284 (+    73us) write_op.cc:454] Released schema lock
0709 12:09:52.411318 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:52.411590 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:52.411615 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":47274,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":2650,"apply.run_cpu_time_us":1278,"apply.run_wall_time_us":1868,"num_ops":1,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":2134,"prepare.run_wall_time_us":2134,"replication_time_us":2091}]]}
I20260709 12:09:53.140866  6230 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:52.914296  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:53.154613  4948 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.907091  6145 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.143496  6115 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.062794  6234 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.160971  5568 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:53.165081  6260 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:53.160755  6177 consensus_meta.cc:287] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.709s	user 0.006s	sys 0.003s
I20260709 12:09:53.162004  6241 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:53.176110  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:53.173326  6041 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.181317  6125 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:52.920101  6179 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.164927  6211 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:53.168579  6148 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:52.913277  6248 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:09:53.113261  6175 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.224506  6240 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:53.200425  6139 consensus_meta.cc:287] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.811s	user 0.006s	sys 0.000s
I20260709 12:09:53.125948  6063 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:53.207816  6238 consensus_meta.cc:287] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.754s	user 0.000s	sys 0.007s
I20260709 12:09:53.191157  6146 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:53.163440  6154 consensus_meta.cc:287] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.756s	user 0.007s	sys 0.000s
I20260709 12:09:53.461614  6154 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.461763  6066 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.462778  4869 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:53.463618  6154 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.463796  6066 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.238318  5018 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:09:53.278101  4873 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.050s	sys 0.063s
W20260709 12:09:53.464668  4873 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.051s	sys 0.063s
I20260709 12:09:53.280628  6129 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:53.288738  4839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.014s	sys 0.011s
W20260709 12:09:53.293104  4842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.002s	sys 0.000s
W20260709 12:09:53.490406  4842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.003s	sys 0.000s
W20260709 12:09:53.490338  4839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.022s	sys 0.023s
I20260709 12:09:53.295872  6261 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.112588  6147 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.295939  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:53.361706  4948 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:53.236477  6153 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.577811  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.202553  6090 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.262642  6114 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.109364  6233 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:52.906200  6183 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.276557  6157 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.379841  6171 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.587023  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:53.377977  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 217096us
I20260709 12:09:53.378981  6229 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:53.391225  4949 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.265365  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.597682  5020 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:53.597843  4867 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:53.598151  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 731) took 1013 ms. Trace:
W20260709 12:09:53.465821  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 549017us
I20260709 12:09:53.599203  4988 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:53.491331  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 771454us
I20260709 12:09:53.603416  4839 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:09:53.472369  6122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.003s	sys 0.032s
W20260709 12:09:53.561256  5019 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.005s	sys 0.014s
I20260709 12:09:53.570665  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:53.571274  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:53.572969  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 277106us
I20260709 12:09:53.577299  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:53.416621  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:09:53.473194  6173 consensus_meta.cc:287] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.002s
I20260709 12:09:53.583588  6145 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.376787  6260 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.580554  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 725) took 1063 ms. Trace:
I20260709 12:09:53.472589  6143 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:53.581161  6267 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:53.615218  5024 rpcz_store.cc:276] 0709 12:09:52.516963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.574117 (+ 57154us) service_pool.cc:224] Handling call
0709 12:09:53.577657 (+1003540us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:09:53.580500 (+  2843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5916416}
W20260709 12:09:53.583854  4875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.015s	sys 0.012s
W20260709 12:09:53.584473  4916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.009s
I20260709 12:09:53.607259  4868 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
W20260709 12:09:53.559616  4915 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.883s (SENT) [suppressed 4 similar messages]
W20260709 12:09:53.621695  4875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.015s	sys 0.012s
I20260709 12:09:53.598449  5020 rpcz_store.cc:276] 0709 12:09:52.584927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.265132 (+680205us) service_pool.cc:224] Handling call
0709 12:09:53.598099 (+332967us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:53.586109  6190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.052s	sys 0.068s
W20260709 12:09:53.578827  4947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.008s	sys 0.016s
I20260709 12:09:53.466470  6146 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:53.606972  5019 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.005s	sys 0.014s
I20260709 12:09:53.490002  6129 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:53.581609  4951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.002s	sys 0.013s
I20260709 12:09:53.583343  6141 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.582321  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:53.607988  4914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.018s	sys 0.022s
I20260709 12:09:53.607508  4871 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
W20260709 12:09:53.628084  4951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.002s	sys 0.013s
I20260709 12:09:53.489853  6179 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:53.622318  4916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.010s	sys 0.009s
W20260709 12:09:53.623358  4947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.009s	sys 0.016s
I20260709 12:09:53.464789  6238 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:53.606906  6122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.003s	sys 0.032s
I20260709 12:09:53.613921  6063 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:53.628679  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:53.629220  4914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.019s	sys 0.022s
I20260709 12:09:53.623083  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:53.627628  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 747) took 1338 ms. Trace:
I20260709 12:09:53.643416  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:53.646538  6262 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:09:53.624034  6190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.052s	sys 0.068s
I20260709 12:09:53.647938  6072 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.584589  6114 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.607362  6171 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:53.661693  5020 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:53.631553  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.608778  6229 raft_consensus.cc:697] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:53.616281  6213 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:53.674485  5022 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:53.660696  4875 rpcz_store.cc:276] 0709 12:09:52.284594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.523128 (+238534us) service_pool.cc:224] Handling call
0709 12:09:52.523408 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.523599 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:52.595357 (+ 71758us) log.cc:844] Serialized 14 byte log entry
0709 12:09:53.622709 (+1027352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.622755 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:53.622792 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.622851 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.622950 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157208,"prepare.queue_time_us":71606,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":16711,"raft.queue_time_us":337786,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":23739,"thread_start_us":869747,"threads_started":2,"wal-append.queue_time_us":783453}
I20260709 12:09:53.633695  6133 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:09:53.655376  6116 consensus_meta.cc:287] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.002s
I20260709 12:09:53.609277  6139 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.688539  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:53.693524  5020 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.688081  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:53.695708  5024 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.683153  5018 raft_consensus.cc:2368] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:53.662045  6063 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:53.730624  4868 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:53.650135  5016 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.665165  6190 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:53.732177  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:53.630064  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 228706us
I20260709 12:09:53.654871  6122 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:53.651144  6179 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.616389  6173 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:53.743315  5020 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
W20260709 12:09:53.745656  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 125379us
I20260709 12:09:53.755990  5016 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.731467  6116 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:53.742681  6207 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.630281  6267 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.735180  6063 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.756592  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.773166  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:53.768337  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.730342  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 765) took 1237 ms. Trace:
I20260709 12:09:53.756603  6261 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.780671  4871 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:53.731496  6139 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.738790  6273 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:53.787657  5020 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:53.793195  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.794363  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:09:53.786502  6272 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:09:53.757228  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 63459.8us
I20260709 12:09:53.789346  4991 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:53.746009  6175 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:53.767341  5024 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:53.798377  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 69) took 1123 ms. Trace:
I20260709 12:09:53.798748  5024 rpcz_store.cc:276] 0709 12:09:52.675301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.687801 (+1012500us) service_pool.cc:224] Handling call
0709 12:09:53.798324 (+110523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:53.799585  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:53.768059  6183 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.786736  6171 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:53.792037  4875 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:53.782579  6145 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:53.779107  4840 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:53.803180  4950 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:53.789453  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.795094  6261 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.785506  6207 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.835049  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:53.773871  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 68) took 1276 ms. Trace:
I20260709 12:09:53.795795  6147 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:53.794652  6270 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:53.836613  6145 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.837218  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:53.837047  6270 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.838044  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:53.839207  6270 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.794795  6153 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.840031  6064 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.840508  6064 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.841264  6183 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:53.841646  6183 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:53.841988  6183 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.843732  6160 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:53.846736  6146 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.848716  6238 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:53.849291  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 1870) took 1368 ms. Trace:
I20260709 12:09:53.756429  6275 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:53.808712  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 249118us
I20260709 12:09:53.809127  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52376 (request call id 824) took 1291 ms. Trace:
I20260709 12:09:53.810299  4840 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:53.811582  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:53.807016  6213 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:53.844271  6160 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:53.796981  6273 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:53.864226  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:53.810223  6139 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:53.856678  4948 rpcz_store.cc:276] 0709 12:09:52.512116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.623254 (+111138us) service_pool.cc:224] Handling call
0709 12:09:53.802906 (+1179652us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54002765d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:53.803007 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001064704}
I20260709 12:09:53.814828  6190 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:53.902815  6183 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.881274  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:53.896369  6116 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:53.905359  6116 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.907280  6116 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:53.908113  5017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 763) took 1454 ms (client timeout 1632 ms). Trace:
W20260709 12:09:53.908519  5017 rpcz_store.cc:269] 0709 12:09:52.454018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.466525 (+ 12507us) service_pool.cc:224] Handling call
0709 12:09:53.907929 (+1441404us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001414d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:53.908034 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133902720}
W20260709 12:09:53.909260  6271 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:09:53.909724  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.910326  5017 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:53.910825  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 737) took 1306 ms. Trace:
I20260709 12:09:53.813695  6268 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:53.812662  6171 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:53.788901  5023 rpcz_store.cc:276] 0709 12:09:52.454687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.466627 (+ 11940us) service_pool.cc:224] Handling call
0709 12:09:53.597627 (+1131000us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:09:53.616551 (+ 18924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.644598 (+ 28047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.651768 (+  7170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.654731 (+  2963us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:53.666541 (+ 11810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.674033 (+  7492us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.688928 (+ 14895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3028736}
I20260709 12:09:53.841001  6283 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:53.836325  5019 rpcz_store.cc:276] 0709 12:09:52.497605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.497965 (+   360us) service_pool.cc:224] Handling call
0709 12:09:52.498211 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:52.498382 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:09:53.624399 (+1126017us) log.cc:844] Serialized 14 byte log entry
0709 12:09:53.773576 (+149177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.773626 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:53.773665 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.773724 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.773823 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":230456,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1867,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4618,"thread_start_us":1217758,"threads_started":2,"wal-append.queue_time_us":180904}
W20260709 12:09:53.857318  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47090.3us
I20260709 12:09:53.836714  6285 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:53.897264  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:53.899513  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 1877) took 1216 ms. Trace:
I20260709 12:09:53.901237  6211 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:53.902177  6160 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:53.884956  6146 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.849676  4944 rpcz_store.cc:276] 0709 12:09:52.481135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.640481 (+159346us) service_pool.cc:224] Handling call
0709 12:09:53.849149 (+1208668us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b54001a2f54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:53.849240 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32614144}
I20260709 12:09:53.917563  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:53.912504  4951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 821) took 1402 ms. Trace:
I20260709 12:09:53.915454  4947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 822) took 1404 ms. Trace:
I20260709 12:09:53.919047  5024 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:53.914112  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 1865) took 1610 ms. Trace:
I20260709 12:09:53.945617  4840 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:53.919539  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 1873) took 1437 ms. Trace:
W20260709 12:09:53.920746  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 1.43645e+06us
I20260709 12:09:53.807723  6266 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:53.948701  4948 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:53.915158  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:53.998741  5020 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
W20260709 12:09:53.921325  5022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 63) took 1428 ms (client timeout 1561 ms). Trace:
I20260709 12:09:53.999526  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:53.949765  4942 rpcz_store.cc:276] 0709 12:09:52.682893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.918607 (+235714us) service_pool.cc:224] Handling call
0709 12:09:52.918839 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.144438 (+225599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.144479 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.144519 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:53.144547 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.899304 (+754757us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540032d054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:09:53.899343 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.899463 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518466944}
I20260709 12:09:53.912212  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:53.854820  6157 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.896627  6141 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.996419  4950 rpcz_store.cc:276] 0709 12:09:52.304150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.725958 (+421808us) service_pool.cc:224] Handling call
0709 12:09:53.803016 (+1077058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.811633 (+  8617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.913947 (+102314us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002765d0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:53.914056 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476395904}
I20260709 12:09:53.996353  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:53.827667  5018 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
W20260709 12:09:53.995353  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49814.8us
I20260709 12:09:53.995553  4951 rpcz_store.cc:276] 0709 12:09:52.511008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.728224 (+217216us) service_pool.cc:224] Handling call
0709 12:09:52.728508 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.728705 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.728727 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.916687 (+187960us) log.cc:844] Serialized 26 byte log entry
0709 12:09:53.629026 (+712339us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:53.629064 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.629123 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:53.912262 (+283139us) raft_consensus.cc:1685] finished
0709 12:09:53.912280 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.912428 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":711934,"threads_started":1,"wal-append.queue_time_us":768335}
I20260709 12:09:53.801241  6229 consensus_queue.cc:237] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.001080  4868 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:09:53.888356  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 76365.2us
I20260709 12:09:54.004385  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.004158  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:53.915974  6268 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:54.003480  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:53.998376  4947 rpcz_store.cc:276] 0709 12:09:52.511388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.847954 (+336566us) service_pool.cc:224] Handling call
0709 12:09:52.849820 (+  1866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.850133 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.850159 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.916963 (+ 66804us) log.cc:844] Serialized 26 byte log entry
0709 12:09:53.643106 (+726143us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:53.643249 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.643312 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:53.915263 (+271951us) raft_consensus.cc:1685] finished
0709 12:09:53.915284 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.915399 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":292964,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"thread_start_us":725815,"threads_started":1,"wal-append.queue_time_us":744133}
I20260709 12:09:54.006691  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.029961  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.030607  4942 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:53.914979  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:53.955323  6260 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.008489  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:53.905375  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 722) took 1389 ms. Trace:
I20260709 12:09:54.035341  5600 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:54.011137  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.035907  6261 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.036196  4948 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:53.989876  6211 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.036764  6267 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.037081  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:53.999441  5022 rpcz_store.cc:269] 0709 12:09:52.492484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.492607 (+   123us) service_pool.cc:224] Handling call
0709 12:09:53.921140 (+1428533us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003cda54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:53.921272 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2715517184}
I20260709 12:09:54.002481  6154 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:53.803912  6122 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:53.913946  6280 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:53.951869  6116 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.995723  4945 rpcz_store.cc:276] 0709 12:09:52.481907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.728664 (+246757us) service_pool.cc:224] Handling call
0709 12:09:52.913550 (+184886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.608501 (+694951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.608530 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.608568 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:53.608595 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.919333 (+310738us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54001a2a54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:09:53.919375 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.919485 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1597830912}
I20260709 12:09:54.033492  6268 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.027184  4944 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:53.911124  5017 rpcz_store.cc:276] 0709 12:09:52.604267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.909458 (+1305191us) service_pool.cc:224] Handling call
0709 12:09:53.910772 (+  1314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:53.954424  6139 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:53.988729  6147 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:54.006287  6266 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:53.950977  6283 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:53.921428  6213 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:54.031872  4950 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.004186  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.060248  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.060412  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.060948  4950 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:54.061484  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:53.913264  6134 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.066993  6157 raft_consensus.cc:476] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 12:09:54.068219  6211 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.034360  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:53.949648  6133 raft_consensus.cc:697] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:53.914770  6179 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.003254  6114 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:53.886346  6275 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.045734  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:54.051400  6280 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.070398  4948 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:53.989684  6183 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.071437  6280 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.042997  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.069445  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:53.946276  6233 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:54.071496  6133 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.008196  6146 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:54.075826  6146 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.037971  6276 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.049204  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.049840  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:53.960480  5016 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.083139  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:54.044073  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.054559  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.042637  6265 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:54.047302  6154 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.058291  6236 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:54.063992  6171 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.064177  6266 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:54.058319  6287 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:54.057962  6139 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.065510  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:54.100188  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 112519us
I20260709 12:09:54.066007  6213 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.069360  6273 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.071220  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.112924  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.113487  4948 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.114218  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.115113  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:54.115574  4948 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.046404  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.117231  5022 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:54.117959  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.118487  5022 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:54.119225  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.119711  5022 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:54.071727  4951 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:54.121281  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.122025  4951 raft_consensus.cc:2410] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:54.122695  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.123185  4951 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.073233  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.125000  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.125960  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.074196  6233 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.130116  6233 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.047493  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:54.131547  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.132246  4875 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:54.132920  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.133569  4875 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:54.134217  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:54.135179  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.136107  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.074728  4942 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:54.047456  6173 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:53.955652  6285 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.123867  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.139099  6285 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:54.083273  4945 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:54.139211  4951 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.024762  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.140596  4868 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.141446  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.141970  4868 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.142042  6173 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.142730  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.142563  6173 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.143332  4868 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.026645  6141 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.146339  6141 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:54.082072  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.052778  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:54.120417  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.148089  5022 raft_consensus.cc:2410] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:54.085666  4944 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.059226  6283 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.094192  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.149721  6173 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:54.150467  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 723) took 1634 ms. Trace:
I20260709 12:09:54.150816  5019 rpcz_store.cc:276] 0709 12:09:52.516431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.149774 (+1633343us) service_pool.cc:224] Handling call
0709 12:09:54.150034 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.150185 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.150207 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.150243 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.150270 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.150317 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.150420 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.152312  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 724) took 1635 ms. Trace:
I20260709 12:09:54.035408  5021 rpcz_store.cc:276] 0709 12:09:52.516103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.518909 (+  2806us) service_pool.cc:224] Handling call
0709 12:09:52.700442 (+181533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.154901 (+454459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.160129 (+  5228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.160178 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:53.160212 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:53.905165 (+744953us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b540016bf54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:09:53.905208 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:53.905321 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958442240}
I20260709 12:09:54.071468  6275 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.083041  6183 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.100548  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:54.149219  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.153860  5021 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:54.154100  5022 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.152593  5019 rpcz_store.cc:276] 0709 12:09:52.516667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.151656 (+1634989us) service_pool.cc:224] Handling call
0709 12:09:54.151903 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.152049 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.152071 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.152105 (+    34us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.152132 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.152178 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.152266 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.154459  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 727) took 1637 ms. Trace:
I20260709 12:09:54.155576  5021 rpcz_store.cc:276] 0709 12:09:52.517417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.153423 (+1636006us) service_pool.cc:224] Handling call
0709 12:09:54.153683 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.154224 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.154396 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.156091  5022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 728) took 1638 ms. Trace:
I20260709 12:09:54.157083  6183 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.159126  6183 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.163339  5018 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.163476  6211 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:54.165956  6211 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.164378  6238 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:54.166481  5018 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:54.167179  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 734) took 1581 ms. Trace:
I20260709 12:09:54.167495  5018 rpcz_store.cc:276] 0709 12:09:52.585672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.166017 (+1580345us) service_pool.cc:224] Handling call
0709 12:09:54.166303 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.166948 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.167130 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.168077  6211 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.156638  5022 rpcz_store.cc:276] 0709 12:09:52.517647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.155043 (+1637396us) service_pool.cc:224] Handling call
0709 12:09:54.155438 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.155673 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.155697 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.155755 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.155811 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.155894 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.156026 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.168774  6238 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.170116  5022 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.170622  5022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 736) took 1566 ms. Trace:
I20260709 12:09:54.170912  6238 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:54.165470  6283 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.165551  4991 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:54.172461  4943 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.172869  6238 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:54.174674  6283 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.175231  5018 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:54.175886  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 735) took 1572 ms. Trace:
I20260709 12:09:54.176266  5018 rpcz_store.cc:276] 0709 12:09:52.603799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.168269 (+1564470us) service_pool.cc:224] Handling call
0709 12:09:54.168542 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.175640 (+  7098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.175838 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.170909  5022 rpcz_store.cc:276] 0709 12:09:52.604049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.169608 (+1565559us) service_pool.cc:224] Handling call
0709 12:09:54.169838 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.170424 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.170576 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.182705  4948 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:54.052592  6116 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.190130  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:54.086717  6265 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:54.086687  6286 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:54.196709  6286 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.092381  5023 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.087056  6276 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:54.092835  6154 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.092549  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 767) took 1410 ms. Trace:
I20260709 12:09:54.057806  6147 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.196141  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:54.219571  5602 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:54.197815  6265 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.198464  6207 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.208753  5016 rpcz_store.cc:276] 0709 12:09:52.675670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.231468 (+555798us) service_pool.cc:224] Handling call
0709 12:09:53.649773 (+418305us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4c0010bf80. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a58bb6a20 00007f2a58bc7a29 00007f2a58b8d644 00007f2a58bb4f2d 00007f2a58bb4b93 00007f2a5a8e518b 00007f2a5a8e5cb5 00007f2a5a8e0f30 00007f2a5a8e27de 00007f2a5a8ee27c 00007f2a5f8afb17
0709 12:09:54.086519 (+436746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38864640}
I20260709 12:09:54.192827  6273 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.198710  6238 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:54.209519  5017 raft_consensus.cc:2368] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:54.100016  6236 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.209721  6290 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:54.112284  6287 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:54.281852  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 91797.3us
W20260709 12:09:54.285180  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:54.297547  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 197056us
I20260709 12:09:54.313877  4991 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:54.315793  5605 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
W20260709 12:09:54.282536  6279 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:09:54.316921  4839 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:54.281354  5601 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:09:54.294052  6250 log.cc:927] Time spent T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 1.576s	user 0.010s	sys 0.006s
W20260709 12:09:54.296051  4949 consensus_meta.cc:287] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.002s
W20260709 12:09:54.312914  6063 consensus_meta.cc:287] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.504s	user 0.004s	sys 0.004s
I20260709 12:09:54.249786  6273 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.376346  6063 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.242120  6147 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:54.278060  6289 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:54.328665  4916 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:54.328186  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.322613  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.415374  4950 raft_consensus.cc:1803] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.3
I20260709 12:09:54.415570  4871 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.415835  4950 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.321494  5025 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.416642  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 62) took 1925 ms. Trace:
I20260709 12:09:54.416977  5025 rpcz_store.cc:276] 0709 12:09:52.490874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.505009 (+ 14135us) service_pool.cc:224] Handling call
0709 12:09:54.321036 (+1816027us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:09:54.321205 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.416398 (+ 95193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.416590 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240908160}
W20260709 12:09:54.378278  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 61413.8us
I20260709 12:09:54.379282  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.418870  4872 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:54.419687  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.420662  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.421168  4872 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:54.346961  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:54.264838  6041 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.324414  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:54.459162  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 130565us
I20260709 12:09:54.489640  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.314749  6183 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:54.343466  6230 consensus_meta.cc:287] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.982s	user 0.007s	sys 0.000s
I20260709 12:09:54.489216  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.497792  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:54.497502  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 184321us
I20260709 12:09:54.499763  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.349678  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:54.348598  6260 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.319339  6207 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:54.501230  5600 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:54.501418  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.496148  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.501274  6260 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:54.502328  4872 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.503181  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:54.504266  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.504789  4872 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:54.505285  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:54.505587  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.373781  6173 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.346773  6287 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.348443  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 733) took 1763 ms. Trace:
I20260709 12:09:54.506237  4872 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:54.348008  6286 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.512533  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.483616  4991 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:54.408005  6267 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:54.509389  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.493722  6066 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.373871  4949 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
W20260709 12:09:54.514717  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 96184.9us
I20260709 12:09:54.380225  6291 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:54.516104  4871 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:54.514135  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:54.513549  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.493563  6179 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.518894  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:54.490901  6157 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:54.524148  4947 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:54.496248  6183 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:54.524394  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.343191  6268 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.298370  6290 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.531360  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:54.532187  4917 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:54.535004  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.562794  4948 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:54.564998  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.565683  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:54.514566  6266 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:09:54.494729  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 214023us
I20260709 12:09:54.510624  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 740) took 1773 ms. Trace:
I20260709 12:09:54.536563  4871 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:54.516881  6233 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:09:54.593866  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 62573.8us
I20260709 12:09:54.517956  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.613648  5017 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.613665  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:54.614424  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.614584  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:54.614979  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:54.615438  5017 raft_consensus.cc:2410] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 4 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:09:54.615706  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:54.617133  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 95638.3us
I20260709 12:09:54.565549  5025 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:54.618700  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 776) took 1046 ms. Trace:
I20260709 12:09:54.619041  5025 rpcz_store.cc:276] 0709 12:09:53.572082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.618001 (+1045919us) service_pool.cc:224] Handling call
0709 12:09:54.618280 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.618430 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.618454 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.618491 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.618520 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.618566 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.618649 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.620987  6211 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.621376  6211 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.621698  6211 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.492202  6276 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.489310  6289 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.628137  6289 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.629146  4990 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:54.519517  6267 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.630600  4872 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:54.631572  6267 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:54.632000  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.632589  4872 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:54.633498  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.522706  6207 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.521075  6066 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.681351  6207 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.681455  6066 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.681749  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 755) took 1119 ms. Trace:
I20260709 12:09:54.682219  6207 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.682174  4873 rpcz_store.cc:276] 0709 12:09:53.562509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.571058 (+  8549us) service_pool.cc:224] Handling call
0709 12:09:54.681571 (+1110513us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54002fbf54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:54.681691 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197503872}
I20260709 12:09:54.683488  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.684072  4873 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:54.620570  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 777) took 1042 ms. Trace:
I20260709 12:09:54.520795  6287 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.686086  5025 rpcz_store.cc:276] 0709 12:09:53.577780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.619851 (+1042071us) service_pool.cc:224] Handling call
0709 12:09:54.620135 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.620302 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.620326 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.620363 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:54.620391 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.620437 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.620521 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.686594  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:54.686841  6287 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.688220  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.689630  6287 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.689452  4873 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:54.537806  5600 raft_consensus.cc:2368] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:54.598862  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 731) took 2318 ms. Trace:
I20260709 12:09:54.599596  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:54.530267  6139 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.511246  6230 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.691354  6139 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.690478  4876 rpcz_store.cc:276] 0709 12:09:52.274277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.301032 (+ 26755us) service_pool.cc:224] Handling call
0709 12:09:52.301300 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:52.371215 (+ 69915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:52.371243 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:52.382713 (+ 11470us) log.cc:844] Serialized 26 byte log entry
0709 12:09:52.479470 (+ 96757us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:52.480306 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:52.480372 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:54.085888 (+1605516us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:09:54.563506 (+477618us) raft_consensus.cc:1685] finished
0709 12:09:54.563529 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.592884 (+ 29355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30294,"raft.queue_time_us":69361,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"spinlock_wait_cycles":8190336,"thread_start_us":88895,"threads_started":1,"wal-append.queue_time_us":203698}
I20260709 12:09:54.600898  4916 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:54.602777  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.691677  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.643455  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 759) took 1080 ms. Trace:
I20260709 12:09:54.646293  4868 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:54.693375  6230 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.693679  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1879) took 1115 ms. Trace:
I20260709 12:09:54.694024  4868 rpcz_store.cc:276] 0709 12:09:53.578192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.143922 (+565730us) service_pool.cc:224] Handling call
0709 12:09:54.646134 (+502212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.692989 (+ 46855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.693523 (+   534us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400336dd0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:54.693630 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154352000}
I20260709 12:09:54.691718  6139 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:54.647324  4946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 1878) took 1964 ms. Trace:
I20260709 12:09:54.649241  6064 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.694496  5570 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:54.696707  6230 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.695305  4867 rpcz_store.cc:276] 0709 12:09:53.563308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.563392 (+    84us) service_pool.cc:224] Handling call
0709 12:09:54.643270 (+1079878us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400336dd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:54.643367 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23482752}
I20260709 12:09:54.653868  5024 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:54.690246  6287 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:54.660923  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 778) took 1080 ms. Trace:
I20260709 12:09:54.639698  5019 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:54.676007  4869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 1874) took 2404 ms (client timeout 1898 ms). Trace:
I20260709 12:09:54.676518  4874 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:54.677032  6068 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:54.698455  6068 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.698845  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.699934  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.700217  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:54.695680  4946 rpcz_store.cc:276] 0709 12:09:52.683428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.225524 (+542096us) service_pool.cc:224] Handling call
0709 12:09:53.225820 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:53.454287 (+228467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:53.461247 (+  6960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:53.465977 (+  4730us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:53.466019 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.647088 (+1181069us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400209ed4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:09:54.647138 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.647266 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433334016}
I20260709 12:09:54.694044  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.695076  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:54.701889  4869 rpcz_store.cc:269] 0709 12:09:52.271144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.272595 (+  1451us) service_pool.cc:224] Handling call
0709 12:09:54.675787 (+2403192us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540031b5d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:54.675924 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2689437568}
I20260709 12:09:54.702473  4868 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:54.701489  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 742) took 2425 ms. Trace:
I20260709 12:09:54.703104  4874 rpcz_store.cc:276] 0709 12:09:52.276434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.302122 (+ 25688us) service_pool.cc:224] Handling call
0709 12:09:54.676353 (+2374231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.700688 (+ 24335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.701340 (+   652us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b540031b5d0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:54.701440 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5459675520}
I20260709 12:09:54.703518  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.678426  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 739) took 1942 ms. Trace:
I20260709 12:09:54.703714  6066 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.697953  5020 rpcz_store.cc:276] 0709 12:09:53.580972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.648505 (+1067533us) service_pool.cc:224] Handling call
0709 12:09:54.648769 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.660608 (+ 11839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.660633 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.660672 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.660701 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.660751 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.660860 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.705833  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.706233  4873 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:54.700449  4867 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:54.705010  5023 rpcz_store.cc:276] 0709 12:09:52.736523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.240202 (+1503679us) service_pool.cc:224] Handling call
0709 12:09:54.677707 (+437505us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:09:54.677910 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.678086 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.678114 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.678160 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.678192 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.678251 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.678372 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4943104}
I20260709 12:09:54.707247  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.707554  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.704759  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.708600  4873 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:54.692395  4871 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
I20260709 12:09:54.706423  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 732) took 2121 ms. Trace:
I20260709 12:09:54.697928  6287 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:54.709476  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.709640  6287 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.642215  6129 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:53.952740  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.695592  6139 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.704902  4868 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:54.708191  4867 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:54.712788  5570 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:54.697144  6230 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.718348  6230 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.704188  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:54.709381  5019 rpcz_store.cc:276] 0709 12:09:52.585214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.155112 (+1569898us) service_pool.cc:224] Handling call
0709 12:09:54.639363 (+484251us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5e9c 00007f2a577c5a5b 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:09:54.639525 (+   162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.706206 (+ 66681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.706373 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5432448}
I20260709 12:09:54.700495  6068 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.721374  6068 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:54.721995  6068 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:54.722023  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1891) took 1140 ms. Trace:
I20260709 12:09:54.722303  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1889) took 1141 ms. Trace:
I20260709 12:09:54.726912  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1887) took 1146 ms. Trace:
I20260709 12:09:54.723186  4868 rpcz_store.cc:276] 0709 12:09:53.581527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.715589 (+1134062us) service_pool.cc:224] Handling call
0709 12:09:54.716742 (+  1153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.721149 (+  4407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.721255 (+   106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.721380 (+   125us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.721420 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.721639 (+   219us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.721896 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.728067  4869 rpcz_store.cc:276] 0709 12:09:53.580447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.710222 (+1129775us) service_pool.cc:224] Handling call
0709 12:09:54.720358 (+ 10136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.726171 (+  5813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.726196 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.726232 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:54.726258 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.726305 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.726764 (+   459us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b54001761d0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:54.726852 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22729472}
I20260709 12:09:54.723248  4867 rpcz_store.cc:276] 0709 12:09:53.580941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.715665 (+1134724us) service_pool.cc:224] Handling call
0709 12:09:54.720981 (+  5316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.721449 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.721473 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.721593 (+   120us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:54.721705 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.721844 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.722102 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849792}
I20260709 12:09:54.726608  6139 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.734489  6066 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.681979  4774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 211) took 3913 ms. Trace:
I20260709 12:09:54.746505  6139 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.747017  4774 rpcz_store.cc:276] 0709 12:09:50.768518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:50.768634 (+   116us) service_pool.cc:224] Handling call
0709 12:09:54.681888 (+3913254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377374,"reported_tablets":5}
I20260709 12:09:54.747879  6139 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.748730  6139 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.752032  6207 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.740108  4988 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:54.754076  6139 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:54.754649  4988 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:54.756115  6139 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:54.758939  6139 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:54.763348  6211 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.734835  4772 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.766121  4772 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.763533  6139 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.767627  4772 catalog_manager.cc:5697] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:09:54.770359  4772 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.562635  6183 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.795513  6211 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.538405  6157 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.535429  6179 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:54.561359  6238 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.538628  6213 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.516274  6173 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:54.806488  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 188518us
I20260709 12:09:54.838840  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:54.592105  6122 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:09:54.811088  6296 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.304s	user 0.000s	sys 0.000s
I20260709 12:09:54.810657  6287 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.826561  6283 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.826169  6280 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.812894  6236 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:54.813052  6312 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:54.813299  6273 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:54.534919  4949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 1867) took 2230 ms (client timeout 1977 ms). Trace:
I20260709 12:09:54.561007  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:09:54.803722  6292 net_util.cc:396] Time spent resolve address for 127.3.163.65: real 0.207s	user 0.000s	sys 0.000s
W20260709 12:09:54.817904  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 303902us
I20260709 12:09:54.596484  6278 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:54.819289  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 219747us
I20260709 12:09:54.872612  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:54.873946  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:54.599814  6147 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:54.819773  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 218940us
I20260709 12:09:54.879495  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.880209  4947 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:54.880954  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.881213  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.881486  4947 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.882148  4942 raft_consensus.cc:2410] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:54.882658  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.884380  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.885489  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:54.886015  4944 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:54.865949  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 236873us
I20260709 12:09:54.803484  6275 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:54.808949  6130 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.893247  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.893838  4950 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.820150  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:54.533936  6291 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:54.798005  6207 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.599681  6266 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:54.840381  6171 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.001s
I20260709 12:09:54.824723  6064 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.826364  6145 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.812551  6063 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:54.808387  6233 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.836407  6179 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.838023  6238 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.870672  4872 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:54.889384  6275 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.882275  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.888399  4990 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:54.872097  4841 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:54.835060  6321 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.891754  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.826740  4772 catalog_manager.cc:5697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:09:54.894101  4945 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.860448  6122 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.895876  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:54.894587  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:54.601831  5016 rpcz_store.cc:276] 0709 12:09:52.736771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.250343 (+1513572us) service_pool.cc:224] Handling call
0709 12:09:54.296215 (+ 45872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.324845 (+ 28630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.350526 (+ 25681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.374227 (+ 23701us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.380750 (+  6523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.489051 (+108301us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.507899 (+ 18848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:54.997567  4942 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:54.934130  6238 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.873122  6213 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:54.943783  6090 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:54.889781  6278 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:09:54.822311  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 88854.1us
I20260709 12:09:54.889580  6147 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:54.892741  6141 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:54.936316  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 181729us
W20260709 12:09:54.938409  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 92813.2us
I20260709 12:09:55.055922  4870 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
W20260709 12:09:54.939047  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 67027.8us
I20260709 12:09:54.895936  6130 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.918467  6145 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:54.899425  6171 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.001s	sys 0.001s
I20260709 12:09:54.973672  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:54.973814  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 85502.3us
I20260709 12:09:55.083212  4947 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
W20260709 12:09:55.055346  6301 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.459s	user 0.000s	sys 0.001s
I20260709 12:09:54.870065  6280 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:54.895619  6041 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.991111  4945 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:55.092252  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:54.866344  6294 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:54.990449  4772 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 3, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:54.932420  6273 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:54.997913  4950 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:54.871415  6312 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:54.888329  6144 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.130s	user 0.006s	sys 0.011s
I20260709 12:09:55.104466  5024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:36232
W20260709 12:09:54.866534  4949 rpcz_store.cc:269] 0709 12:09:52.304828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.148069 (+843241us) service_pool.cc:224] Handling call
0709 12:09:54.530062 (+1381993us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:55.027143  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:54.921598  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 107437us
I20260709 12:09:54.988719  6321 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:54.941069  6275 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:55.004678  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 114320us
I20260709 12:09:55.112026  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:54.871985  6293 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:09:55.030958  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 143161us
I20260709 12:09:55.056660  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:09:55.113380  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 56796.7us
I20260709 12:09:55.078706  6147 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:54.895853  6274 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 12:09:54.868736  6283 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.086472  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:55.087216  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:55.116194  4841 leader_election.cc:400] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:55.116488  4841 leader_election.cc:403] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:54.996305  6315 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:55.091765  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:55.117408  5604 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
W20260709 12:09:55.104822  6144 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.370s	user 0.006s	sys 0.012s
I20260709 12:09:55.093382  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:09:55.094763  6302 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:09:55.078902  6141 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.079015  6278 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.095618  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:55.030810  6213 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:55.030689  6290 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.097787  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:55.099107  4772 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 3, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:55.090502  6265 consensus_meta.cc:287] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.858s	user 0.008s	sys 0.000s
I20260709 12:09:55.082448  6145 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:55.103399  6300 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.502s	user 0.001s	sys 0.000s
I20260709 12:09:55.097486  4945 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.106936  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:55.178452  4945 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.178761  5019 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:55.092927  6041 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:55.099699  6294 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.087347  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:55.092527  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:54.514955  5021 rpcz_store.cc:276] 0709 12:09:52.585451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.156313 (+1570862us) service_pool.cc:224] Handling call
0709 12:09:54.156584 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.156776 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:54.157311 (+   535us) log.cc:844] Serialized 14 byte log entry
0709 12:09:54.348087 (+190776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.348148 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:54.348199 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.348271 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:54.348387 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1615,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":9279,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3255,"thread_start_us":139797,"threads_started":1,"wal-append.queue_time_us":192360}
I20260709 12:09:55.097867  6273 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:55.119076  5020 raft_consensus.cc:2376] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2. Re-sending same reply.
I20260709 12:09:55.127175  4944 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:55.128139  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.123075  6283 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.141791  6287 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:55.140983  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 45446.5us
I20260709 12:09:55.208967  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.210136  4988 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.111483  6211 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.140338  4772 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:09:55.177767  5024 raft_consensus.cc:606] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:09:55.212992  5024 raft_consensus.cc:614] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:55.094085  6064 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:55.112494  6321 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:55.177358  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 65391.2us
I20260709 12:09:55.121416  6114 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:55.180855  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 73983us
I20260709 12:09:55.119344  6144 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:55.191258  4945 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.177649  6265 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:55.191758  6311 log.cc:927] Time spent T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 12:09:55.141207  6173 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.138768  6213 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.137387  6141 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.138821  6274 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:55.196604  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 68512.7us
I20260709 12:09:55.141678  5599 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:55.177547  6207 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.111320  5023 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.140484  6268 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.119879  6291 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.178658  6139 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.183813  6041 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.183678  6315 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.142903  6133 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:55.188453  6294 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.181304  6157 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:55.195317  6306 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:09:55.197156  6273 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.196965  6266 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:55.393798  6230 consensus_meta.cc:287] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.001s
I20260709 12:09:55.206221  6066 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.414871  6066 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:55.415273  6066 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.121680  6308 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.211683  6063 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:55.417980  6308 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:55.418399  6308 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.116425  6293 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.220335  6211 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.305508  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 762) took 1024 ms. Trace:
W20260709 12:09:55.340435  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 227318us
I20260709 12:09:55.309911  6147 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:55.286535  6336 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:09:55.306536  4876 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:55.271065  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:55.345510  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:55.227481  6313 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:09:55.221556  6233 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:55.227494  6320 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:09:55.303961  6324 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:55.228478  6283 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.308029  6280 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.306615  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:55.383710  6207 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:55.222714  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:55.369520  6331 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.405457  6114 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:55.393107  6139 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:55.393122  6315 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.406213  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 768) took 2729 ms. Trace:
I20260709 12:09:55.411012  6319 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:09:55.399796  6133 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.414112  6145 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.344256  6179 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.286509  6238 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.415993  6273 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.469278  6116 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.389281  6274 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:55.426621  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:55.241699  5022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 769) took 2564 ms. Trace:
I20260709 12:09:55.463953  6280 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.479494  5022 rpcz_store.cc:276] 0709 12:09:52.677773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.178779 (+1501006us) service_pool.cc:224] Handling call
0709 12:09:54.179179 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.179871 (+   692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.179918 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.180522 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.319611 (+139089us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.320117 (+   506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.320193 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.241446 (+921253us) raft_consensus.cc:1685] finished
0709 12:09:55.241464 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.241643 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":138594,"threads_started":1,"wal-append.queue_time_us":329400}
I20260709 12:09:55.427831  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:55.479573  4942 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:55.481351  4945 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:55.428454  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:55.482914  4947 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:55.425161  4871 rpcz_store.cc:276] 0709 12:09:54.281380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.717492 (+436112us) service_pool.cc:224] Handling call
0709 12:09:54.717773 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.820674 (+102901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.820706 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.821141 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:09:55.093920 (+272779us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:55.094259 (+   339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.094436 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.305262 (+210826us) raft_consensus.cc:1685] finished
0709 12:09:55.305285 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.305438 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102557,"raft.queue_time_us":102664,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8663,"thread_start_us":252495,"threads_started":1,"wal-append.queue_time_us":409625}
I20260709 12:09:55.484090  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:55.430557  4943 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:55.431341  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:55.438941  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 93504.6us
I20260709 12:09:55.486388  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:55.487480  4840 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:55.441465  6265 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.388667  6064 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:55.493189  6183 consensus_meta.cc:287] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.004s
I20260709 12:09:55.493541  6147 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:55.461686  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 239033us
I20260709 12:09:55.464709  6315 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.494849  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:55.495893  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:55.440186  6266 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.501127  6266 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.313078  6144 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.441962  6283 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.464291  6331 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:55.396950  6278 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.421630  6230 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.443804  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:55.462003  6207 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.470250  6273 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.427714  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:55.480579  6154 consensus_meta.cc:287] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 1.258s	user 0.010s	sys 0.000s
I20260709 12:09:55.478863  6274 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.485137  5601 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:55.488945  4950 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:55.490130  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.504356  6283 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.490610  6233 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:55.502343  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:55.503087  6116 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.494115  6147 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:55.511096  6139 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:55.481789  6280 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:55.514333  6238 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:55.517508  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 769) took 1233 ms. Trace:
I20260709 12:09:55.515684  6308 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.492683  6275 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.496930  6114 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:55.503623  6266 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.492671  6294 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.464777  5018 rpcz_store.cc:276] 0709 12:09:52.676689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.178039 (+1501350us) service_pool.cc:224] Handling call
0709 12:09:54.178342 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.272745 (+ 94403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.272997 (+   252us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.373721 (+100724us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.595595 (+221874us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:54.595675 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.595788 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.405972 (+810184us) raft_consensus.cc:1685] finished
0709 12:09:55.405998 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.406156 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8320,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6997,"thread_start_us":156367,"threads_started":1,"wal-append.queue_time_us":540493}
I20260709 12:09:55.507947  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 770) took 2036 ms. Trace:
I20260709 12:09:55.526597  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.506346  6331 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.512092  6157 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.525101  4839 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:09:55.572799  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 47770.3us
I20260709 12:09:55.537463  6173 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.574214  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:55.493573  6183 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.542048  4874 rpcz_store.cc:276] 0709 12:09:54.283782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.724550 (+440768us) service_pool.cc:224] Handling call
0709 12:09:54.724799 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.725004 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.725028 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.725419 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.822762 (+ 97343us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.822797 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.822860 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.517282 (+694422us) raft_consensus.cc:1685] finished
0709 12:09:55.517300 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.517451 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":97040,"threads_started":1,"wal-append.queue_time_us":207241}
I20260709 12:09:55.543269  6339 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:55.536109  6116 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:55.542135  6297 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.909s	user 0.006s	sys 0.008s
W20260709 12:09:55.570511  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 43990us
I20260709 12:09:55.541828  6280 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.542008  6273 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:09:55.576892  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:55.577099  4839 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:55.575037  6157 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.593824  6267 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.594108  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:55.595129  4948 raft_consensus.cc:2393] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:55.569201  6211 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.527699  6154 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.590291  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.575677  6233 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:55.595145  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:55.572574  6114 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.599078  4840 leader_election.cc:400] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:55.589184  6116 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.594287  6157 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.575800  6173 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:55.601044  4874 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:55.607090  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:55.608035  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:55.595930  6130 consensus_meta.cc:287] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.507s	user 0.016s	sys 0.003s
I20260709 12:09:55.601704  6090 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.589093  6319 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.602967  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:55.604161  6145 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:55.593837  6322 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.536s	user 0.000s	sys 0.005s
I20260709 12:09:55.603489  6278 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.595000  6265 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:55.599303  6339 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.590955  6326 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:55.626498  6326 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.626951  6326 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:55.580437  6268 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:09:55.612412  4875 raft_consensus.cc:2393] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:55.615746  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.571406  6283 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.616623  6090 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:55.620699  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 786) took 1089 ms. Trace:
I20260709 12:09:55.608222  6173 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.607093  6233 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:55.619678  6309 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:55.637840  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:55.626401  6339 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.640241  4840 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.609540  6130 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.637197  4872 rpcz_store.cc:276] 0709 12:09:54.531600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.633278 (+101678us) service_pool.cc:224] Handling call
0709 12:09:55.620555 (+987277us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400407ed4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:55.620648 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544216960}
I20260709 12:09:55.618709  6319 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.644492  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 783) took 1283 ms. Trace:
I20260709 12:09:55.644860  4867 rpcz_store.cc:276] 0709 12:09:54.360878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.744003 (+383125us) service_pool.cc:224] Handling call
0709 12:09:54.744264 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.937448 (+193184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.937479 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.937519 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:54.937547 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.644293 (+706746us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54001b2954. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:09:55.644328 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.644438 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443888768}
I20260709 12:09:55.636996  6265 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.638561  6090 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.654219  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 775) took 1369 ms. Trace:
I20260709 12:09:55.654585  4876 rpcz_store.cc:276] 0709 12:09:54.285122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.705638 (+420516us) service_pool.cc:224] Handling call
0709 12:09:55.654075 (+948437us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540031b0d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:55.654162 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380224384}
I20260709 12:09:55.642221  6267 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:55.569875  5017 rpcz_store.cc:276] 0709 12:09:53.467487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.616017 (+1148530us) service_pool.cc:224] Handling call
0709 12:09:54.616338 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:54.616554 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.616582 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:54.617063 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:09:54.731924 (+114861us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.731966 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:54.732035 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:55.489081 (+757046us) raft_consensus.cc:1685] finished
0709 12:09:55.489103 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.504049 (+ 14946us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":114493,"threads_started":1,"wal-append.queue_time_us":195599}
I20260709 12:09:55.644644  6309 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.658818  4874 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:55.643147  6308 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.638955  6213 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.643369  6321 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.653577  6265 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:55.659871  6309 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:55.660661  6275 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.657896  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:55.667006  6265 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.674680  6294 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.671609  6309 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.671926  6183 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.671211  6230 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.676893  6260 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.682951  5598 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:55.680230  6319 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.690415  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 1899) took 1403 ms. Trace:
I20260709 12:09:55.690793  4870 rpcz_store.cc:276] 0709 12:09:54.287034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.615470 (+328436us) service_pool.cc:224] Handling call
0709 12:09:55.690244 (+1074774us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002b75d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:55.690356 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010936192}
I20260709 12:09:55.682039  6154 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.672272  6233 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:55.713567  4875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 1882) took 2134 ms (client timeout 2408 ms). Trace:
W20260709 12:09:55.723869  4875 rpcz_store.cc:269] 0709 12:09:53.578939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.135914 (+556975us) service_pool.cc:224] Handling call
0709 12:09:55.713381 (+1577467us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54002b5cd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:55.713511 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3390205696}
W20260709 12:09:55.711985  4915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.002s	sys 0.013s
W20260709 12:09:55.727139  4915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.002s	sys 0.013s
W20260709 12:09:55.727629  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 640304us
I20260709 12:09:55.728353  4915 leader_election.cc:400] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:55.728626  4915 leader_election.cc:403] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:55.709254  6283 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.725646  6321 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:55.732084  6339 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:55.740832  4772 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.015s	sys 0.018s
W20260709 12:09:55.742372  4772 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.015s	sys 0.018s
W20260709 12:09:55.743610  6171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.008s	sys 0.007s
W20260709 12:09:55.743944  6171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.008s	sys 0.007s
I20260709 12:09:55.746248  6066 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.748258  6066 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.748320  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 785) took 1387 ms. Trace:
I20260709 12:09:55.738931  6130 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.748692  4869 rpcz_store.cc:276] 0709 12:09:54.361381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.745943 (+384562us) service_pool.cc:224] Handling call
0709 12:09:54.746163 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:54.991127 (+244964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:54.991156 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:54.991195 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:54.991224 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.748131 (+756907us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400335ed4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:09:55.748167 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:55.748272 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562998016}
I20260709 12:09:55.752702  4871 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.756256  6133 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:55.762023  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:09:55.773399  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45185.2us
I20260709 12:09:55.774091  4871 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:55.774111  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:55.774744  4988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.016s	sys 0.026s
W20260709 12:09:55.779624  4988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.017s	sys 0.026s
I20260709 12:09:55.777971  6314 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.777778  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:55.772485  6090 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.799325  6090 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.779316  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:55.775017  6334 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:55.800191  6275 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:55.777153  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 237921us
I20260709 12:09:55.801301  5604 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:55.801829  6343 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.802855  6278 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:55.803210  6278 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:55.803975  6278 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.806768  6207 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.806936  6331 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.808192  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:55.800585  6275 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:55.808753  5016 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.777971  6283 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:55.815403  6211 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.816351  6324 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.810015  6350 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.817978  6334 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:55.816601  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 606501us
I20260709 12:09:55.780676  6213 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:55.783500  6133 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:55.802865  6314 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.808701  6207 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:55.823539  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 181795us
I20260709 12:09:55.808740  6331 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.817392  6260 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.811474  6275 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.811756  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:55.810070  5017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:36232
W20260709 12:09:55.838985  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:55.827968  4988 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:55.781311  6157 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.777434  6041 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.844430  6041 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.845043  4949 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:55.832966  6314 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:55.825373  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:55.846719  5600 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:55.846576  6314 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.847693  6314 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.849994  4988 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.854383  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.855165  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:55.856841  6347 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:55.856460  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:55.857718  6207 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:55.861451  6090 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:55.861842  6090 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:55.862205  6090 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.863407  6179 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.864187  6173 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.865003  6157 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.865272  6213 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.866348  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:55.867017  5605 raft_consensus.cc:2393] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:55.851794  6114 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:55.868496  4988 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.831596  6350 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:55.871488  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:55.875275  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:55.836294  6133 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.867677  6347 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:55.850538  6183 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:55.852393  6332 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:55.867817  6116 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.963815  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:55.968657  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:55.947675  6122 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.957736  6334 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:55.973441  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:55.858016  6141 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.868405  6312 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:55.849529  6274 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:09:55.906188  6349 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:55.907473  6280 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.909330  6357 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:09:55.964744  4946 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.917305  6265 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.959798  6309 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.959892  6293 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.906818  4988 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:55.953768  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:09:55.906613  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 46322.4us
I20260709 12:09:55.947786  6230 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:56.000512  4944 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:55.983573  4841 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:55.973722  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.006433  4945 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.947726  6133 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:55.959272  6321 raft_consensus.cc:3055] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.980319  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:56.013334  6351 log.cc:927] Time spent T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:09:56.013756  6114 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.014715  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.014957  6276 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.015461  4946 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:56.016309  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:55.980365  6264 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:55.981092  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:55.946053  6289 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:55.970054  6347 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:55.917105  6339 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:56.009351  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 102604us
I20260709 12:09:55.985237  6090 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:55.988597  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.013226  4943 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:55.969255  6183 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:55.970486  6332 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.019588  4945 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:56.021811  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.034072  4948 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:55.994129  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:56.026129  4988 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:55.988459  6334 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.014673  6321 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:55.959791  6295 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:09:56.034916  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.017196  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 273) took 1500 ms. Trace:
I20260709 12:09:56.018643  6349 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:56.037263  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:56.033818  6312 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.023684  6293 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:56.059103  6211 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:56.059569  6211 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:56.059274  6347 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.060019  6211 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.060199  6090 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.061309  6116 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.061653  6309 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.019011  6230 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.042400  6213 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:56.067736  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.025633  6289 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.068565  6326 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.070400  6289 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.030472  6130 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:09:56.065200  6312 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.073169  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.082791  5022 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:56.081282  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:56.046757  5602 rpcz_store.cc:276] 0709 12:09:54.516944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.519897 (+  2953us) service_pool.cc:224] Handling call
0709 12:09:54.664246 (+144349us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b5800157898. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:09:54.664437 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:55.009272 (+344835us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:09:55.389862 (+380590us) log.cc:844] Serialized 14 byte log entry
0709 12:09:55.796050 (+406188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:55.810327 (+ 14277us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:55.811431 (+  1104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.993754 (+182323us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400483854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:09:55.994487 (+   733us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:56.007391 (+ 12904us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3202,"prepare.queue_time_us":393815,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":37985,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":15527,"spinlock_wait_cycles":700933632,"thread_start_us":606463,"threads_started":2,"wal-append.queue_time_us":349869}
I20260709 12:09:56.083518  5603 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:56.056859  6207 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.072160  6213 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:56.076766  6350 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:56.076038  6230 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:56.076112  6173 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.098074  6312 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:56.065465  6293 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.100523  6276 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:56.100962  6315 consensus_meta.cc:287] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.004s
I20260709 12:09:56.101874  6280 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:56.102459  6266 consensus_meta.cc:287] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
I20260709 12:09:56.102854  6266 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.107637  6141 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.108913  6321 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.110176  6321 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.112867  6275 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.113770  6334 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.114856  6275 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.095736  6213 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.087193  6207 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.117314  6133 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:56.117717  6133 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:56.118677  6265 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.070427  6326 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:56.142824  6266 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.135051  6293 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.135515  6278 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.143213  6332 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.177585  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 50) took 1482 ms. Trace:
I20260709 12:09:56.178462  4873 rpcz_store.cc:276] 0709 12:09:54.694853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.709255 (+ 14402us) service_pool.cc:224] Handling call
0709 12:09:56.176956 (+1467701us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400337cd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:56.177266 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2594756992}
I20260709 12:09:56.185552  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 787) took 1653 ms. Trace:
I20260709 12:09:56.186260  4868 rpcz_store.cc:276] 0709 12:09:54.531769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.869454 (+337685us) service_pool.cc:224] Handling call
0709 12:09:55.690360 (+820906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:55.690531 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:55.690557 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:55.690599 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:55.690628 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:55.690682 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:56.185118 (+494436us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54002b75d0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:56.185307 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887257856}
I20260709 12:09:56.205834  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:56.208015  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.208833  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.237509  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.238565  5025 raft_consensus.cc:2393] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:56.238725  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.238669  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.239655  4942 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.240000  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:56.239863  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.240284  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.209935  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.241310  4943 raft_consensus.cc:2368] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:56.241521  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.241983  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.242347  5025 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:56.242581  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.242986  4944 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:56.243254  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.243530  4943 raft_consensus.cc:2368] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4.
I20260709 12:09:56.243919  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.039883  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.244541  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.245798  4945 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:56.246471  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.246680  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.247254  4943 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:56.210992  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.211661  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.212195  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.226768  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:56.229025  4991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.007s	sys 0.018s
I20260709 12:09:56.232142  5016 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:56.233124  5017 raft_consensus.cc:606] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:09:56.233779  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.233788  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.233729  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.234270  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.235373  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.236574  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.250218  4946 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:56.250989  4947 raft_consensus.cc:2368] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:56.251621  6063 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.265707  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 797) took 1210 ms. Trace:
I20260709 12:09:56.255662  4944 raft_consensus.cc:2368] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3.
I20260709 12:09:56.259352  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.136163  6315 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:56.263453  4991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.007s	sys 0.018s
I20260709 12:09:56.268901  6116 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:09:56.269486  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.269785  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.270826  4947 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:56.272308  4947 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:56.266117  6063 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.275445  6063 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:56.275621  4946 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:56.276948  5021 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:56.273497  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.264959  5017 raft_consensus.cc:614] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:56.263098  6133 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.283797  6133 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.284395  5018 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:56.276224  5022 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:56.284734  6315 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:56.278891  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 108268us
I20260709 12:09:56.285701  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.286216  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.286556  5022 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:56.289247  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.292141  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.293244  4950 raft_consensus.cc:2393] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:56.293358  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:56.294246  4951 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:56.291536  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.266189  5016 rpcz_store.cc:276] 0709 12:09:55.055510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.079632 (+ 24122us) service_pool.cc:224] Handling call
0709 12:09:55.808058 (+728426us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:09:56.265618 (+457560us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4806528}
I20260709 12:09:56.298630  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.299176  5024 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:56.299757  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.300978  4950 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.301767  6116 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:56.301791  6344 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:56.302294  6324 raft_consensus.cc:2764] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:09:56.303411  6207 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:56.312737  4945 raft_consensus.cc:2368] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:56.307797  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.311794  6344 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:56.316011  5019 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:56.334080  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.336062  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:56.337096  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 131598us
I20260709 12:09:56.338125  5021 raft_consensus.cc:2368] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:56.339027  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.339573  5021 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.340662  5025 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:56.343968  5020 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
W20260709 12:09:56.344064  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 225437us
I20260709 12:09:56.345016  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:56.347021  4988 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:55716 dropped due to backpressure: service queue is full with 50 items
I20260709 12:09:56.335700  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.351189  5019 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:56.310120  6116 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:56.333680  6344 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.358718  4942 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
W20260709 12:09:56.358172  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 51162.2us
W20260709 12:09:56.357213  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.08614e+06us
I20260709 12:09:56.362550  6116 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.363225  6173 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:56.364010  6173 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.355242  6063 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:56.366010  6063 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.366438  6173 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.359825  5020 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:56.369339  5024 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:56.371441  6211 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.372068  6183 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:56.373500  6116 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.368336  6276 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:56.374797  6276 raft_consensus.cc:697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:56.365500  6171 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:56.377641  6171 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.378762  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:56.380056  6171 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.382449  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:56.384582  6289 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:56.385092  6289 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:56.385352  6130 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:56.386152  6130 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.389194  6274 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:56.389225  5022 raft_consensus.cc:2368] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:56.376924  5017 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:56.393122  6312 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:56.397775  6274 raft_consensus.cc:3055] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:56.398134  6274 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:56.399145  6274 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:56.400259  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:56.401437  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:56.401449  4839 leader_election.cc:400] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:56.428597  4839 leader_election.cc:403] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:09:56.430785  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 62009.8us
I20260709 12:09:56.400746  6274 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.347295  4988 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:55716 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 759)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 87)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 84)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 80)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 79)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 82)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 88)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 758)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 85)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 773)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 81)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 83)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 86)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 804)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 763)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 822)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 777)
I20260709 12:09:56.431856  6063 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:56.405805  6324 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.376209  6276 consensus_queue.cc:237] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.438985  5602 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:56.388739  6130 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.403028  6349 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:56.406349  6213 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:56.399150  5568 leader_election.cc:336] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.561s (SENT)
W20260709 12:09:56.483028  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 102258us
I20260709 12:09:56.453572  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.486171  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.487273  5024 raft_consensus.cc:2368] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:56.427320  6289 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:56.454797  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:56.445034  6171 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.451270  6211 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:56.450248  4774 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 3, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 3 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.454336  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.512253  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.513120  5018 raft_consensus.cc:2368] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:56.513831  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:56.514019  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.494089  4874 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:56.514638  5018 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.515875  6289 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.517297  5598 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:56.518272  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.518471  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.518791  4948 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.518972  4942 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:56.519924  5025 raft_consensus.cc:2368] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:56.497188  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:56.520961  6213 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:56.521381  4944 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:56.521581  6289 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:56.523088  6349 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.494330  6280 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:56.450560  6063 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:56.498726  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.498827  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:09:56.500516  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 101550us
I20260709 12:09:56.454830  6230 consensus_queue.cc:1059] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:09:56.488713  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 55674.3us
I20260709 12:09:56.494272  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:56.497510  6293 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:09:56.493561  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.451324  5023 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:56.497476  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.498246  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:56.548251  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:56.548213  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:56.551513  5021 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:09:56.552747  6230 raft_consensus.cc:3055] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:56.553233  5019 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:56.553725  6211 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:56.554180  6349 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:56.549124  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:56.524355  6344 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:56.548556  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 54415.5us
I20260709 12:09:56.541778  6280 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:56.566744  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.569593  4944 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:56.566767  5017 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:56.571849  4839 leader_election.cc:400] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:56.572054  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.572562  4839 leader_election.cc:403] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:56.562286  6230 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:56.583216  5020 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:56.583279  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:56.580713  6063 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.588307  5024 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:56.588212  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:56.589248  4942 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:56.572227  6280 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.593264  4868 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:56.595196  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:56.588150  6063 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:56.583644  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.603533  6063 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:56.599617  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:56.606056  6063 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.606457  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:56.607093  4868 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.608140  6063 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:56.572438  6213 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:09:56.597029  4949 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:56.614323  4871 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:56.614660  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:56.580096  6324 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:56.559466  4989 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:55722 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 80)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 79)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 82)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 754)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 88)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 758)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 783)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 85)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 773)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 81)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 83)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 86)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 804)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 763)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 822)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 785)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 786)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 787)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 788)
W20260709 12:09:56.710063  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 248727us
I20260709 12:09:56.712347  5018 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:56.599692  6230 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:56.714295  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:56.771656  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:56.647748  6314 raft_consensus.cc:3055] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:57.136257  6295 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:57.036607  6314 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:09:57.331226  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 559670us
I20260709 12:09:57.333312  5568 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:57.333639  6324 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:57.335212  5568 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:57.336151  6295 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:57.336509  6295 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.336822  6295 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.186050  6230 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:57.346638  6171 consensus_meta.cc:287] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.816s	user 0.001s	sys 0.006s
I20260709 12:09:57.347062  6171 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
W20260709 12:09:57.370040  6319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.016s	sys 0.017s
I20260709 12:09:57.348727  6344 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:09:57.372371  6319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.017s	sys 0.018s
I20260709 12:09:57.373196  6133 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.405794  6314 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:57.416216  6385 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 12:09:57.420426  6280 consensus_meta.cc:287] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.001s
I20260709 12:09:57.422267  6314 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.422435  6280 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:57.443076  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.444455  4874 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.449186  6280 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:57.454663  6295 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.466933  6295 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:57.469383  4874 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:09:57.470398  6133 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:57.446314  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.473045  6133 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.473610  6133 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.475603  6133 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:57.508626  6133 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.509253  6133 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.511991  6133 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:56.712687  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.536787  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.537624  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 770) took 1222 ms. Trace:
I20260709 12:09:57.537938  5021 rpcz_store.cc:276] 0709 12:09:56.315363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.536477 (+1221114us) service_pool.cc:224] Handling call
0709 12:09:57.537567 (+  1090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.539019  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.539608  5021 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:57.540087  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 784) took 1033 ms. Trace:
I20260709 12:09:57.540400  5021 rpcz_store.cc:276] 0709 12:09:56.513648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.538737 (+1025089us) service_pool.cc:224] Handling call
0709 12:09:57.540036 (+  1299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.541510  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.542142  5021 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:57.542299  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:57.542955  6344 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:57.544104  6344 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.545559  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:57.545650  4915 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:57.546195  6344 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:57.546525  4915 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:57.546707  6344 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:57.547406  6344 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:57.548499  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:57.551589  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 79) took 1336 ms. Trace:
I20260709 12:09:57.551971  5021 rpcz_store.cc:276] 0709 12:09:56.214958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.541249 (+1326291us) service_pool.cc:224] Handling call
0709 12:09:57.543785 (+  2536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.552862  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.547544  6116 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:57.554246  6116 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.554617  6116 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.549751  6344 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.558447  6344 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.565840  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:57.547760  4915 leader_election.cc:400] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:57.548475  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:57.572412  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:57.574632  5022 consensus_meta.cc:287] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.835s	user 0.016s	sys 0.005s
I20260709 12:09:57.574960  5022 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:57.576784  6344 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:57.578786  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.579543  6344 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:57.580603  6344 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.581097  6344 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:57.582442  5021 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:57.582937  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 82) took 1366 ms. Trace:
I20260709 12:09:57.579567  5018 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:57.584386  6396 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.584834  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.584946  6396 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:57.585613  5018 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:57.586030  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 754) took 1303 ms. Trace:
I20260709 12:09:57.586323  5018 rpcz_store.cc:276] 0709 12:09:56.282882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.584546 (+1301664us) service_pool.cc:224] Handling call
0709 12:09:57.585979 (+  1433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.583182  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.591490  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.591799  4871 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.593755  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 795) took 1010 ms. Trace:
I20260709 12:09:57.594086  4871 rpcz_store.cc:276] 0709 12:09:56.583097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.587987 (+  4890us) service_pool.cc:224] Handling call
0709 12:09:57.593702 (+1005715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.583334  6344 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:57.567287  5598 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.583244  5021 rpcz_store.cc:276] 0709 12:09:56.216301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.552609 (+1336308us) service_pool.cc:224] Handling call
0709 12:09:57.582881 (+ 30272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.587298  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.597764  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.597867  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 780) took 1142 ms. Trace:
I20260709 12:09:57.598331  5021 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:57.590507  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 782) took 1134 ms. Trace:
I20260709 12:09:57.598836  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 813) took 1353 ms. Trace:
I20260709 12:09:57.598917  5024 rpcz_store.cc:276] 0709 12:09:56.455675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.498509 (+ 42834us) service_pool.cc:224] Handling call
0709 12:09:57.590370 (+1091861us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54001603d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:57.590456 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105721600}
I20260709 12:09:57.600083  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.600701  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 768) took 1286 ms. Trace:
I20260709 12:09:57.598002  5018 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:57.601150  5024 rpcz_store.cc:276] 0709 12:09:56.314764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.599867 (+1285103us) service_pool.cc:224] Handling call
0709 12:09:57.600635 (+   768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.601693  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.602051  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.602443  5018 raft_consensus.cc:2368] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
W20260709 12:09:57.602680  4873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.007s	sys 0.009s
I20260709 12:09:57.599195  5021 rpcz_store.cc:276] 0709 12:09:56.245883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.597566 (+1351683us) service_pool.cc:224] Handling call
0709 12:09:57.598794 (+  1228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.603798  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.604342  5021 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.606423  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 71) took 1118 ms. Trace:
I20260709 12:09:57.606791  4949 rpcz_store.cc:276] 0709 12:09:56.487485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.501408 (+ 13923us) service_pool.cc:224] Handling call
0709 12:09:56.552130 (+ 50722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:56.616176 (+ 64046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.606187 (+990011us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b5400118ad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:09:57.606346 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74513280}
I20260709 12:09:57.602857  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 762) took 1291 ms. Trace:
I20260709 12:09:57.608155  5024 rpcz_store.cc:276] 0709 12:09:56.312563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.601823 (+1289260us) service_pool.cc:224] Handling call
0709 12:09:57.602805 (+   982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.598250  5020 rpcz_store.cc:276] 0709 12:09:56.455035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.591260 (+1136225us) service_pool.cc:224] Handling call
0709 12:09:57.597813 (+  6553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.609126  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.609395  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.609694  5024 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.610153  5020 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:57.610605  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 760) took 1325 ms. Trace:
I20260709 12:09:57.610894  5020 rpcz_store.cc:276] 0709 12:09:56.290247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.609190 (+1318943us) service_pool.cc:224] Handling call
0709 12:09:57.610548 (+  1358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.611747  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.612377  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 807) took 1387 ms. Trace:
W20260709 12:09:57.613296  4873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.008s	sys 0.010s
I20260709 12:09:57.612665  5020 rpcz_store.cc:276] 0709 12:09:56.225183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.611537 (+1386354us) service_pool.cc:224] Handling call
0709 12:09:57.612336 (+   799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.616935  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.617583  5020 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:57.617971  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 756) took 1334 ms. Trace:
I20260709 12:09:57.618229  5020 rpcz_store.cc:276] 0709 12:09:56.283619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.616701 (+1333082us) service_pool.cc:224] Handling call
0709 12:09:57.617931 (+  1230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.618599  6116 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:57.618948  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.619500  5020 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:57.619899  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 749) took 1399 ms. Trace:
I20260709 12:09:57.620150  5020 rpcz_store.cc:276] 0709 12:09:56.220750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.618763 (+1398013us) service_pool.cc:224] Handling call
0709 12:09:57.619856 (+  1093us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.616183  5021 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.625528  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 774) took 1308 ms. Trace:
I20260709 12:09:57.625844  5021 rpcz_store.cc:276] 0709 12:09:56.317266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.603565 (+1286299us) service_pool.cc:224] Handling call
0709 12:09:57.625466 (+ 21901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.626703  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.621626  5023 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:57.602857  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 817) took 1355 ms. Trace:
I20260709 12:09:57.627743  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 805) took 1403 ms. Trace:
I20260709 12:09:57.627775  5018 rpcz_store.cc:276] 0709 12:09:56.247207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.601410 (+1354203us) service_pool.cc:224] Handling call
0709 12:09:57.602805 (+  1395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.628168  5023 rpcz_store.cc:276] 0709 12:09:56.224371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.582891 (+1358520us) service_pool.cc:224] Handling call
0709 12:09:57.627691 (+ 44800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.629073  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.620893  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.627343  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 88) took 1408 ms. Trace:
I20260709 12:09:57.630160  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 776) took 1284 ms. Trace:
I20260709 12:09:57.629392  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.630081  5021 rpcz_store.cc:276] 0709 12:09:56.218970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.626448 (+1407478us) service_pool.cc:224] Handling call
0709 12:09:57.627298 (+   850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.630646  5020 rpcz_store.cc:276] 0709 12:09:56.345481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.620670 (+1275189us) service_pool.cc:224] Handling call
0709 12:09:57.630113 (+  9443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.631436  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.631652  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.632419  5023 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:57.633126  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 764) took 1319 ms. Trace:
I20260709 12:09:57.633436  5023 rpcz_store.cc:276] 0709 12:09:56.313342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.629166 (+1315824us) service_pool.cc:224] Handling call
0709 12:09:57.633074 (+  3908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.634580  6133 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:57.634714  6116 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:57.635179  6133 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:57.636190  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 46406.8us
I20260709 12:09:57.637671  6133 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:57.637833  4916 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:57.629662  5018 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:57.638660  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 767) took 1324 ms. Trace:
I20260709 12:09:57.636461  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.638118  6295 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:57.639348  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 759) took 1354 ms. Trace:
I20260709 12:09:57.639638  6295 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:57.640091  6295 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:57.632350  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 758) took 1348 ms. Trace:
I20260709 12:09:57.641682  6397 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:57.641112  6295 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.642452  6295 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.643431  5021 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:57.643903  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 769) took 1328 ms. Trace:
I20260709 12:09:57.644205  5021 rpcz_store.cc:276] 0709 12:09:56.315069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.631199 (+1316130us) service_pool.cc:224] Handling call
0709 12:09:57.643835 (+ 12636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.645084  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.645766  5021 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:57.646111  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 783) took 1157 ms. Trace:
I20260709 12:09:57.646402  5021 rpcz_store.cc:276] 0709 12:09:56.501640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.644848 (+1143208us) service_pool.cc:224] Handling call
0709 12:09:57.646064 (+  1216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.639735  5016 rpcz_store.cc:276] 0709 12:09:56.284621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.636211 (+1351590us) service_pool.cc:224] Handling call
0709 12:09:57.639296 (+  3085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.648379  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.648550  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.649278  5016 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:57.649392  6396 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:57.649780  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 746) took 1430 ms. Trace:
I20260709 12:09:57.650885  6230 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:57.651347  6230 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.651880  4988 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:57.640112  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.652594  5017 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:57.653178  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 765) took 1339 ms. Trace:
I20260709 12:09:57.647225  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.653822  5021 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.650143  5016 rpcz_store.cc:276] 0709 12:09:56.219734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.648258 (+1428524us) service_pool.cc:224] Handling call
0709 12:09:57.649728 (+  1470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.656682  6230 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:57.657902  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:57.658594  4942 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:57.656340  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.665709  5016 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.653478  5017 rpcz_store.cc:276] 0709 12:09:56.313727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.639851 (+1326124us) service_pool.cc:224] Handling call
0709 12:09:57.653125 (+ 13274us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:57.666740  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.640990  5020 rpcz_store.cc:276] 0709 12:09:56.284295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.631425 (+1347130us) service_pool.cc:224] Handling call
0709 12:09:57.632289 (+   864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.685362  5024 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.686416  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 781) took 1231 ms. Trace:
I20260709 12:09:57.686784  5024 rpcz_store.cc:276] 0709 12:09:56.455370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.608796 (+1153426us) service_pool.cc:224] Handling call
0709 12:09:57.686365 (+ 77569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.687589  5021 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.688068  5024 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:09:57.688172  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 778) took 1342 ms. Trace:
I20260709 12:09:57.688678  5021 rpcz_store.cc:276] 0709 12:09:56.346128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.646996 (+1300868us) service_pool.cc:224] Handling call
0709 12:09:57.688113 (+ 41117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.688863  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 83) took 1472 ms. Trace:
I20260709 12:09:57.689630  5020 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:57.689471  5024 rpcz_store.cc:276] 0709 12:09:56.216691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.687456 (+1470765us) service_pool.cc:224] Handling call
0709 12:09:57.687753 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:57.688619 (+   866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.688797 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.689934  5021 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:57.690755  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 86) took 1472 ms. Trace:
I20260709 12:09:57.691378  5024 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:57.691082  5021 rpcz_store.cc:276] 0709 12:09:56.218255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.689493 (+1471238us) service_pool.cc:224] Handling call
0709 12:09:57.689755 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.690528 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.690708 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.692219  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 810) took 1466 ms. Trace:
I20260709 12:09:57.691136  5017 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:57.692854  5021 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:57.693693  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 814) took 1447 ms. Trace:
I20260709 12:09:57.685385  6397 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.692618  5024 rpcz_store.cc:276] 0709 12:09:56.226082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.690643 (+1464561us) service_pool.cc:224] Handling call
0709 12:09:57.691103 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.692014 (+   911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.692175 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5376}
I20260709 12:09:57.687191  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:57.694075  5021 rpcz_store.cc:276] 0709 12:09:56.246211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.692175 (+1445964us) service_pool.cc:224] Handling call
0709 12:09:57.692461 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.693422 (+   961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.693644 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.657930  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:57.703531  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 81) took 1479 ms. Trace:
I20260709 12:09:57.703896  5020 rpcz_store.cc:276] 0709 12:09:56.215895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.686575 (+1470680us) service_pool.cc:224] Handling call
0709 12:09:57.689280 (+  2705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.694608 (+  5328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.694772 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.674042  5018 rpcz_store.cc:276] 0709 12:09:56.314450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.628824 (+1314374us) service_pool.cc:224] Handling call
0709 12:09:57.638612 (+  9788us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:57.715508  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.694161  6397 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:57.719583  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.10343e+06us
I20260709 12:09:57.720854  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:57.721347  4942 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:57.721601  5016 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.722200  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 773) took 1406 ms. Trace:
W20260709 12:09:57.722752  4759 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica baa50eb5ed704004b7f391934a59d010 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:57.723965  6347 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.724009  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:57.724831  6295 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:57.725262  6295 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:57.649289  5023 raft_consensus.cc:2410] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:09:57.723162  4944 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:57.725329  6207 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.693053  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 804) took 1469 ms. Trace:
I20260709 12:09:57.725751  6295 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.722538  5016 rpcz_store.cc:276] 0709 12:09:56.316920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.656084 (+1339164us) service_pool.cc:224] Handling call
0709 12:09:57.722144 (+ 66060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.725026  6315 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:57.731686  6315 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:57.732059  6315 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.724613  6347 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.731331  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 816) took 1484 ms. Trace:
I20260709 12:09:57.734813  6347 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:57.734323  5020 rpcz_store.cc:276] 0709 12:09:56.246901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.704587 (+1457686us) service_pool.cc:224] Handling call
0709 12:09:57.726203 (+ 21616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.730327 (+  4124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.730356 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.730394 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:57.731127 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.731184 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.731287 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:57.735425  4868 consensus_meta.cc:287] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 1.128s	user 0.005s	sys 0.010s
I20260709 12:09:57.735939  4868 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:57.736320  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 796) took 1139 ms. Trace:
I20260709 12:09:57.735060  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 85) took 1517 ms. Trace:
I20260709 12:09:57.736765  4868 rpcz_store.cc:276] 0709 12:09:56.596723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.596876 (+   153us) service_pool.cc:224] Handling call
0709 12:09:57.736282 (+1139406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.748387  6314 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.748890  6314 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:57.749399  5602 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:57.750552  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:57.750708  6314 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:57.751160  5603 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 1.
W20260709 12:09:57.751549  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 99729.5us
I20260709 12:09:57.752302  4988 leader_election.cc:400] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4.
I20260709 12:09:57.752552  5598 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:57.752840  6367 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:57.752555  4988 leader_election.cc:403] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:09:57.757710  4990 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:57.753619  6207 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:57.762166  6207 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:57.765748  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:57.766719  6238 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4.
I20260709 12:09:57.767019  6315 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:57.767359  6238 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:57.768164  6332 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:57.759860  6324 consensus_queue.cc:1059] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:09:57.769503  6347 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:57.769747  6324 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.754555  6397 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.770642  6238 raft_consensus.cc:3055] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.771018  6238 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:57.772004  6397 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:57.771852  6238 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.768563  6295 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.773537  6238 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.774510  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:57.769860  6347 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.777434  5598 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.787786  6347 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.798584  6324 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:57.799064  6324 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:57.799618  6295 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:57.803223  6324 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:57.803308  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:57.804023  4946 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:57.804836  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 1919) took 1210 ms. Trace:
I20260709 12:09:57.805179  4944 rpcz_store.cc:276] 0709 12:09:56.594824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.594959 (+   135us) service_pool.cc:224] Handling call
0709 12:09:57.804637 (+1209678us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400375854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:57.804747 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2591407872}
I20260709 12:09:57.788847  5016 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:57.809406  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 763) took 1496 ms. Trace:
I20260709 12:09:57.809749  5016 rpcz_store.cc:276] 0709 12:09:56.313007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.754894 (+1441887us) service_pool.cc:224] Handling call
0709 12:09:57.777272 (+ 22378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.809134 (+ 31862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.809330 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.811058  5016 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:57.811627  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 777) took 1465 ms. Trace:
I20260709 12:09:57.811744  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.812366  4874 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.813527  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.814851  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.815275  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:57.815524  4871 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.821247  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.821983  6347 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.823096  4774 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.824304  6347 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:57.825109  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.825742  4875 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.811955  5016 rpcz_store.cc:276] 0709 12:09:56.345841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.810499 (+1464658us) service_pool.cc:224] Handling call
0709 12:09:57.810822 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:57.811394 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.811576 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.827689  5016 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:57.830099  5598 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:09:57.830283  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.830787  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 785) took 1314 ms. Trace:
I20260709 12:09:57.830953  4876 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.754838  5023 rpcz_store.cc:276] 0709 12:09:56.217878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.648137 (+1430259us) service_pool.cc:224] Handling call
0709 12:09:57.735002 (+ 86865us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.730116  5017 rpcz_store.cc:276] 0709 12:09:56.224006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.690558 (+1466552us) service_pool.cc:224] Handling call
0709 12:09:57.690833 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.692794 (+  1961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.692986 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.835909  5017 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:57.831182  5016 rpcz_store.cc:276] 0709 12:09:56.513950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.827209 (+1313259us) service_pool.cc:224] Handling call
0709 12:09:57.827486 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.828006 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.828181 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.836506  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 787) took 1322 ms. Trace:
I20260709 12:09:57.836972  5017 rpcz_store.cc:276] 0709 12:09:56.514508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.835350 (+1320842us) service_pool.cc:224] Handling call
0709 12:09:57.835722 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.836281 (+   559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.836450 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.837849  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 788) took 1323 ms. Trace:
I20260709 12:09:57.838232  5016 rpcz_store.cc:276] 0709 12:09:56.514758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.837051 (+1322293us) service_pool.cc:224] Handling call
0709 12:09:57.837347 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.837535 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.837565 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.837606 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:57.837640 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.837700 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.837802 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.839133  4869 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.790742  4988 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:57.791903  6315 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:57.844390  4946 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:09:57.844735  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.845469  5019 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:09:57.828553  5022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 823) took 1476 ms (client timeout 1616 ms). Trace:
I20260709 12:09:57.847185  5025 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:09:57.846326  5022 rpcz_store.cc:269] 0709 12:09:56.354019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.486745 (+132726us) service_pool.cc:224] Handling call
0709 12:09:57.828415 (+1341670us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400065754. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:09:57.828503 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444194688}
W20260709 12:09:57.845888  5019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 806) took 1621 ms (client timeout 2120 ms). Trace:
W20260709 12:09:57.849506  5025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 80) took 1634 ms (client timeout 2130 ms). Trace:
W20260709 12:09:57.849021  5019 rpcz_store.cc:269] 0709 12:09:56.224716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.816758 (+1592042us) service_pool.cc:224] Handling call
0709 12:09:57.845838 (+ 29080us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:09:57.849869  5025 rpcz_store.cc:269] 0709 12:09:56.215435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.815041 (+1599606us) service_pool.cc:224] Handling call
0709 12:09:57.849453 (+ 34412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.852159  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.858985  4871 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
W20260709 12:09:57.860239  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 69580.2us
I20260709 12:09:57.836113  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 786) took 1321 ms. Trace:
I20260709 12:09:57.867831  5023 rpcz_store.cc:276] 0709 12:09:56.514244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.835179 (+1320935us) service_pool.cc:224] Handling call
0709 12:09:57.835512 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.835773 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.835802 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.835863 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:57.835892 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.835952 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.836059 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:57.864584  6397 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.869235  6397 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:57.868208  4772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 218) took 3963 ms. Trace:
I20260709 12:09:57.870668  4869 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:57.871301  6397 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:57.865583  5016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:57.874780  5016 raft_consensus.cc:606] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:09:57.875233  5016 raft_consensus.cc:614] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:57.874801  4876 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.877791  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 815) took 1631 ms. Trace:
I20260709 12:09:57.878648  5016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:57.866321  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:57.878151  5024 rpcz_store.cc:276] 0709 12:09:56.246555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.702452 (+1455897us) service_pool.cc:224] Handling call
0709 12:09:57.728852 (+ 26400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:57.754530 (+ 25678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.754559 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:57.759493 (+  4934us) log.cc:844] Serialized 26 byte log entry
0709 12:09:57.853645 (+ 94152us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:57.853672 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.853714 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:57.877593 (+ 23879us) raft_consensus.cc:1685] finished
0709 12:09:57.877611 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.877720 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23675,"raft.queue_time_us":26674,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1564,"thread_start_us":66314,"threads_started":1,"wal-append.queue_time_us":98368}
I20260709 12:09:57.879222  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.881665  5016 raft_consensus.cc:606] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:57.866010  4874 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.882793  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.884321  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.885857  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.889524  4874 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:57.893510  4870 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:57.867465  4875 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.870728  4772 rpcz_store.cc:276] 0709 12:09:53.904226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.904359 (+   133us) service_pool.cc:224] Handling call
0709 12:09:57.868000 (+3963641us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:55.841589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:55.857231 (+ 15642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:55.857268 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:09:55.857280 (+    12us) tablet.cc:662] Decoding operations
0709 12:09:55.949701 (+ 92421us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:55.949757 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:55.949783 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:09:55.950423 (+   640us) tablet.cc:701] Row locks acquired
0709 12:09:55.950446 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:09:55.950577 (+   131us) write_op.cc:270] Start()
0709 12:09:55.956909 (+  6332us) write_op.cc:276] Timestamp: P: 1783598995950535 usec, L: 0
0709 12:09:55.956940 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:09:55.994610 (+ 37670us) log.cc:844] Serialized 3224 byte log entry
0709 12:09:56.262961 (+268351us) op_driver.cc:464] REPLICATION: finished
0709 12:09:56.325169 (+ 62208us) write_op.cc:301] APPLY: starting
0709 12:09:56.325302 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:56.325582 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:56.325760 (+   178us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:56.326994 (+  1234us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:56.327302 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:09:56.327363 (+    61us) write_op.cc:312] APPLY: finished
0709 12:09:56.327792 (+   429us) log.cc:844] Serialized 65 byte log entry
0709 12:09:56.355083 (+ 27291us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.403711 (+ 48628us) write_op.cc:454] Released schema lock
0709 12:09:56.403788 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:56.404293 (+   505us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.404323 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":752046,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":61833,"apply.run_cpu_time_us":3713,"apply.run_wall_time_us":79112,"num_ops":8,"prepare.queue_time_us":599823,"prepare.run_cpu_time_us":81301,"prepare.run_wall_time_us":287118,"raft.queue_time_us":793,"raft.run_cpu_time_us":20482,"raft.run_wall_time_us":175901,"replication_time_us":304733,"thread_start_us":800368,"threads_started":4,"wal-append.queue_time_us":136312,"wal-append.run_cpu_time_us":3873,"wal-append.run_wall_time_us":1186518}]]}
I20260709 12:09:57.897387  5016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:09:57.898236  5016 raft_consensus.cc:606] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:09:57.899240  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.900112  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.900683  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.903658  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.904033  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:57.904736  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 1.33928e+06us
I20260709 12:09:57.905124  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.906209  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.900177  4867 raft_consensus.cc:2393] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:57.907182  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.907289  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.908004  4867 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:57.908275  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.910490  4867 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:57.909246  4870 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.904702  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.913396  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.914424  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.915102  4867 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:57.916574  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:57.902055  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.902011  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.897457  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.912391  4874 raft_consensus.cc:2376] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4. Re-sending same reply.
I20260709 12:09:57.926589  4871 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:57.954526  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.930866  4916 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:09:57.949923  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:57.956439  5605 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:09:57.916790  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.940209  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.955312  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 794) took 1380 ms. Trace:
I20260709 12:09:57.997771  5025 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:09:57.962252  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 56883.4us
I20260709 12:09:57.998762  5019 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:09:57.918428  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:57.999455  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 68681.5us
I20260709 12:09:58.017798  4875 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:58.006637  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.009353  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:57.921273  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.022006  4872 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.022928  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:09:57.941201  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.023727  4875 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:58.023020  4870 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:58.023857  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.001210  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:58.025321  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.959059  6326 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:57.917373  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:57.937036  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:58.029186  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.898811  5016 raft_consensus.cc:614] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:09:57.937633  6230 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.026573  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.025866  4876 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.934301  6315 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:09:58.026944  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 160701us
I20260709 12:09:57.936574  6133 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:57.930531  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:57.999080  4873 rpcz_store.cc:276] 0709 12:09:56.574987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.575093 (+   106us) service_pool.cc:224] Handling call
0709 12:09:56.585572 (+ 10479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:56.588005 (+  2433us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:56.589176 (+  1171us) log.cc:844] Serialized 14 byte log entry
0709 12:09:57.954991 (+1365815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:57.955046 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:57.955091 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:57.955148 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:57.955260 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":341222,"prepare.queue_time_us":247,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":346024,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":1001568,"threads_started":1,"wal-append.queue_time_us":827007}
I20260709 12:09:58.029996  4868 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:57.955708  6066 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:58.003571  6344 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.041437  6332 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.041674  4917 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:58.042524  6332 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.042470  6280 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.043223  6280 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.043612  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:58.043972  6280 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.044916  6396 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.045091  6280 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.045496  6396 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.046391  6396 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.049343  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:58.042932  6332 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.049981  6332 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:58.053655  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.030429  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.045037  4988 leader_election.cc:400] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3.
I20260709 12:09:58.054975  4988 leader_election.cc:403] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:58.030803  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:57.940989  6319 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:58.032797  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.032943  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.033288  6171 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:58.027400  6276 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.031599  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 820) took 1741 ms. Trace:
I20260709 12:09:58.027375  6295 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.026209  6324 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.035087  5602 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:58.069610  5018 rpcz_store.cc:276] 0709 12:09:56.290494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.716054 (+1425560us) service_pool.cc:224] Handling call
0709 12:09:57.716303 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.716480 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:09:57.799005 (+ 82525us) log.cc:844] Serialized 14 byte log entry
0709 12:09:58.021197 (+222192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:58.023583 (+  2386us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:58.026203 (+  2620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.030174 (+  3971us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.031520 (+  1346us) inbound_call.cc:177] Queueing success response
0709 12:09:58.041399 (+  9879us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b48001c0158. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5f813aa1 00007f2a5f80ab37 00007f2a5f80a9ca 00007f2a5f90226f 00007f2a5f901f37 00007f2a5f91655c 00007f2a5f916508 00007f2a5f916488 00007f2a5f916443 00007f2a5f9156ec 00007f2a5e83fa96
Metrics: {"mutex_wait_us":114556,"prepare.queue_time_us":144853,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":165079,"raft.run_cpu_time_us":1768,"raft.run_wall_time_us":14175,"spinlock_wait_cycles":7342976,"thread_start_us":132531,"threads_started":2,"wal-append.queue_time_us":127659}
I20260709 12:09:58.073912  4988 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.074558  6295 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.075325  4988 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:58.038420  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.037395  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 822) took 1720 ms. Trace:
I20260709 12:09:58.077011  5020 rpcz_store.cc:276] 0709 12:09:56.317424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.757919 (+1440495us) service_pool.cc:224] Handling call
0709 12:09:57.902997 (+145078us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:09:57.903147 (+   150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:57.903341 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:09:57.903602 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 12:09:58.037089 (+133487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:58.037140 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:09:58.037181 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.037242 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.037340 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5233,"prepare.queue_time_us":1491,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":11091,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":18430,"spinlock_wait_cycles":2333440,"thread_start_us":123145,"threads_started":1,"wal-append.queue_time_us":169183}
I20260709 12:09:57.962568  6266 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:09:58.037859  6326 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.058238  4869 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:58.067528  6230 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:58.071384  4839 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:58.043431  6344 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.063375  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 824) took 1346 ms. Trace:
I20260709 12:09:58.088449  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:58.070622  5023 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:58.092414  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:58.093650  6116 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:09:58.090418  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 59032.5us
I20260709 12:09:58.069234  6315 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3.
I20260709 12:09:58.093732  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:58.094153  4874 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:58.088297  6347 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.054388  6133 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.102602  4867 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:58.100749  4872 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:09:58.099148  4916 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:58.103659  4868 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 4. Ops: []
I20260709 12:09:58.103919  4876 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:58.089776  6324 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.104912  4839 leader_election.cc:400] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:58.120249  4839 leader_election.cc:403] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:58.121968  6266 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:58.122582  6326 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:58.098309  6397 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.068933  6319 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.105006  6171 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:58.137755  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 44075.9us
I20260709 12:09:58.105096  6347 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.086527  6276 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:58.147830  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 48752.4us
W20260709 12:09:58.149724  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.151038  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:58.149044  6347 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.146718  6171 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:58.150719  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:58.197889  6399 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
W20260709 12:09:58.201403  6409 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:09:58.201705  6344 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.203447  4870 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:58.153075  6396 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.153460  6280 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.125993  6066 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:09:58.204938  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.209528  6417 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.190026  6324 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.231426  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.232007  4944 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:58.188310  6295 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:58.205611  6171 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.237134  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.237902  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:58.239109  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 88139.7us
I20260709 12:09:58.238461  4950 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:58.239043  6207 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.228240  6280 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:58.183486  6230 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.203989  6367 consensus_queue.cc:1059] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:09:58.253538  6397 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.232867  6116 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.249066  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:09:58.254595  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 65273.4us
I20260709 12:09:58.260334  6116 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:58.261917  6412 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:09:58.265380  6422 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.265805  6422 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.228479  6416 consensus_queue.cc:1059] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:09:58.265763  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.285718  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.285961  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.287263  4875 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.287950  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.288223  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.246886  6207 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.250368  6280 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.260273  6367 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.290392  4872 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:58.236171  6324 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.297467  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.298110  4871 raft_consensus.cc:2368] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3.
I20260709 12:09:58.298818  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.299731  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.266664  6422 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.293344  6367 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:58.301383  6422 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.301762  6367 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.288951  4875 raft_consensus.cc:2368] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4.
I20260709 12:09:58.295848  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.296108  4869 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:58.296427  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.295918  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.254153  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.304364  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.312471  4988 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.313587  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:58.315166  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.317875  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.091418  5017 rpcz_store.cc:276] 0709 12:09:56.711920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.837713 (+1125793us) service_pool.cc:224] Handling call
0709 12:09:57.838033 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:57.858113 (+ 20080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:57.860367 (+  2254us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:57.867208 (+  6841us) log.cc:844] Serialized 26 byte log entry
0709 12:09:57.915472 (+ 48264us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:09:57.916077 (+   605us) log.cc:844] Serialized 14 byte log entry
0709 12:09:58.028163 (+112086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.031913 (+  3750us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:58.035573 (+  3660us) raft_consensus.cc:1685] finished
0709 12:09:58.036801 (+  1228us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.057791 (+ 20990us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124494,"prepare.queue_time_us":155,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":205569,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":1796,"thread_start_us":47908,"threads_started":1,"wal-append.queue_time_us":60974}
W20260709 12:09:58.318544  6415 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 12:09:58.317406  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.326604  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.328411  4872 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:58.328503  4869 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:58.315207  4875 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:58.294631  6207 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.334321  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.335793  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.337886  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.314942  6367 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.358642  4839 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:58.319344  6326 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:58.360801  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:09:58.359239  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 113489us
I20260709 12:09:58.359874  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.320484  6314 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.330797  6399 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.366716  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.367013  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:58.358609  6324 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:58.362589  6314 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.373060  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 775) took 2052 ms. Trace:
I20260709 12:09:58.373752  6314 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.373418  5021 rpcz_store.cc:276] 0709 12:09:56.317575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.767544 (+1449969us) service_pool.cc:224] Handling call
0709 12:09:57.946983 (+179439us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:09:57.947142 (+   159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:58.025201 (+ 78059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:58.025230 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:58.027886 (+  2656us) log.cc:844] Serialized 26 byte log entry
0709 12:09:58.098000 (+ 70114us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:58.098038 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.098098 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:58.317877 (+219779us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:09:58.370022 (+ 52145us) raft_consensus.cc:1685] finished
0709 12:09:58.370043 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.370166 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81481,"raft.queue_time_us":80648,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3174,"spinlock_wait_cycles":45622400,"thread_start_us":54664,"threads_started":1,"wal-append.queue_time_us":86752}
I20260709 12:09:58.375475  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.376049  4942 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:58.377583  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:58.365844  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:58.378218  6332 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.360939  6326 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:09:58.378912  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.385203  6276 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:58.422780  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.423413  4944 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:58.424324  6332 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:58.385949  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.330456  6397 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.371917  6116 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:58.376843  6421 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.377321  6411 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.392222  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.420224  6326 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.422359  4946 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:58.425103  4915 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.371028  6133 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:58.426923  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.390669  6238 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.431072  4944 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: [1.3-3.4]
I20260709 12:09:58.437243  4949 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:58.437855  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.438386  4951 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.441888  4875 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:09:58.446429  5023 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:58.447642  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.448182  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.448342  6414 consensus_queue.cc:1059] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:58.448545  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.438370  4942 raft_consensus.cc:1803] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.3
I20260709 12:09:58.451107  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.451205  5017 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.449103  6332 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.450006  5019 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:58.464008  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.464413  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.448861  5024 raft_consensus.cc:2368] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:58.445066  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.452737  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.441761  6238 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:58.453416  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.453891  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.468518  5021 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:09:58.454382  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.469614  5020 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:58.454710  4951 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.455607  4949 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:58.457271  5597 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:58.457672  6133 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:58.435444  6324 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.435266  6411 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:58.460402  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.460901  6326 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.461318  6414 raft_consensus.cc:3055] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.461812  6314 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:58.462796  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 72415.1us
I20260709 12:09:58.444113  6421 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.449904  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.466349  5022 raft_consensus.cc:2368] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:58.480978  5025 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.442250  6399 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:58.464576  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.473560  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.475407  4942 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:58.479050  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.481385  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.483238  5024 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:58.483237  5021 raft_consensus.cc:2376] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2. Re-sending same reply.
I20260709 12:09:58.484485  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.484356  6324 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.484875  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.485548  5016 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:58.486017  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.486387  6324 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:58.477582  6411 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.486698  6295 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:58.487262  6238 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.488389  6238 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.490165  5017 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:58.491415  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.491914  5020 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:58.484581  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.492740  5022 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:58.493844  6399 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.494400  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:58.463255  6347 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:09:58.496371  4869 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.497251  6426 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.497303  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.497927  6426 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:58.498162  5018 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:09:58.498970  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.498812  6426 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.500006  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:58.501101  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.501662  4949 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:58.497953  4915 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:58.502220  6399 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:58.502748  6399 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:58.480371  6414 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:58.503690  6399 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:58.505340  6434 consensus_queue.cc:1059] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.505965  6431 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.506937  6417 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.507587  6416 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.494347  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:58.508006  6431 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.508380  6431 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.508760  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.507038  4942 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:58.509646  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:58.510039  6424 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.510939  6434 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.507932  6416 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.509589  6344 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.448194  5023 raft_consensus.cc:2376] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4. Re-sending same reply.
I20260709 12:09:58.499928  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:58.486843  6171 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.504078  6399 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:58.503849  6414 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.513847  6399 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.514714  4915 leader_election.cc:400] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:58.514951  6399 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.515165  6434 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.514678  4874 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:58.516443  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.517040  5020 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:58.511950  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.517688  5022 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:09:58.517825  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.518199  6319 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:58.521667  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:58.497417  6421 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.518457  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.515499  4915 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:58.526739  5025 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:58.514226  6171 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:58.531723  5020 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:58.512709  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.505244  6428 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.500385  6207 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.514272  6414 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.539315  5017 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:09:58.461812  6280 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.541042  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:58.541728  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.541811  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:58.544209  4944 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:09:58.544672  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49130.4us
I20260709 12:09:58.544191  5017 raft_consensus.cc:2376] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3. Re-sending same reply.
I20260709 12:09:58.538677  6344 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.552438  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.553237  5016 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:58.553979  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.556492  5567 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:58.557225  6319 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.557583  6319 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.557905  6319 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.560025  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:58.560797  6133 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.561053  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:58.561743  5598 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:09:58.561223  6133 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:58.566418  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.566901  5022 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:09:58.564276  4988 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.568331  4915 leader_election.cc:400] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:58.569203  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.570214  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.571139  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.571595  5019 raft_consensus.cc:2376] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3. Re-sending same reply.
I20260709 12:09:58.549782  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.572310  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.565896  6133 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.573501  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.568558  4915 leader_election.cc:403] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:09:58.575323  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.575615  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.575987  5022 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.545562  6428 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.577445  4840 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:58.578724  5019 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:09:58.579334  6429 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.142s	user 0.002s	sys 0.000s
I20260709 12:09:58.579659  6280 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:58.550197  6347 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:58.581346  6428 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.584851  4988 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.584954  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.585525  4945 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:58.585845  5021 raft_consensus.cc:2376] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2. Re-sending same reply.
I20260709 12:09:58.585017  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.586426  5017 raft_consensus.cc:2376] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4. Re-sending same reply.
I20260709 12:09:58.586723  4949 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:58.585115  5023 raft_consensus.cc:2376] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3. Re-sending same reply.
I20260709 12:09:58.589238  5568 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.589496  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.590593  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.543313  6431 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.591274  5023 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:58.591948  6431 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.563743  6344 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:58.592208  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.580986  6314 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:58.600847  6344 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.605965  5568 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.606938  5568 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:58.608143  6295 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.608647  6420 raft_consensus.cc:3055] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.600780  6171 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:09:58.609067  6420 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.609867  6420 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.610350  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.610916  5025 raft_consensus.cc:2376] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3. Re-sending same reply.
I20260709 12:09:58.593235  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:58.593418  6207 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:58.578229  4841 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:58.620517  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.596313  4915 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.621575  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:58.597899  5022 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:58.599668  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:58.599617  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:58.623029  4949 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.577316  6324 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.601629  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.629148  5021 raft_consensus.cc:2376] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3. Re-sending same reply.
I20260709 12:09:58.598459  6418 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:09:58.607528  6230 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.613541  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:58.598676  6422 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3.
I20260709 12:09:58.608608  6295 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:58.631423  4915 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:58.631513  5017 raft_consensus.cc:2376] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3. Re-sending same reply.
I20260709 12:09:58.584460  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:58.598798  6347 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:58.602566  6414 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:58.633991  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.612133  6416 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.628795  6324 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.596967  6238 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:58.611137  6420 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.635962  6332 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:09:58.635092  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 56932.8us
I20260709 12:09:58.639802  4949 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:09:58.628830  6293 raft_consensus.cc:2764] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:09:58.628952  6280 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:58.783757  4759 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica baa50eb5ed704004b7f391934a59d010 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:58.784304  6280 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.785183  6280 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:58.642246  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 92645.9us
I20260709 12:09:58.640419  6416 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.788849  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:58.789949  4840 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.791023  4840 leader_election.cc:400] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:58.791254  4840 leader_election.cc:403] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:09:58.791798  6426 raft_consensus.cc:2764] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:09:58.792428  6426 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.793015  6426 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:58.794044  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:58.794888  6445 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.795277  6445 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:58.796475  4840 leader_election.cc:400] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:58.639806  5023 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:09:58.678052  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 83880.2us
I20260709 12:09:58.798558  4839 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:58.675978  6434 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.770991  6230 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:58.694202  5568 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.638231  6347 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.731871  5024 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:58.803326  6413 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:58.802449  4988 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:58.802003  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 124180us
I20260709 12:09:58.802017  6347 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.713285  5016 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:58.745612  4772 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.810159  4772 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 3, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.811908  4772 catalog_manager.cc:5697] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 3, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 3 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:58.689868  5018 raft_consensus.cc:2410] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:09:58.692164  4774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 120) took 3377 ms. Trace:
I20260709 12:09:58.645004  6411 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.818333  6411 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:09:58.685500  6438 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:09:58.645020  6397 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.638595  6414 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:58.824239  6434 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.718886  6133 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.643951  6324 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.824572  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:58.702193  6319 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.825327  6230 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.687079  6295 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.814482  4774 rpcz_store.cc:276] 0709 12:09:55.314338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:55.314478 (+   140us) service_pool.cc:224] Handling call
0709 12:09:58.692110 (+3377632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:57.930382 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:57.931010 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:57.931060 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:09:57.931073 (+    13us) tablet.cc:662] Decoding operations
0709 12:09:57.931482 (+   409us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:57.931562 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:57.931592 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:09:57.932001 (+   409us) tablet.cc:701] Row locks acquired
0709 12:09:57.932042 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:09:57.932197 (+   155us) write_op.cc:270] Start()
0709 12:09:57.932348 (+   151us) write_op.cc:276] Timestamp: P: 1783598997932141 usec, L: 0
0709 12:09:57.932366 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:09:57.936697 (+  4331us) log.cc:844] Serialized 913 byte log entry
0709 12:09:58.593646 (+656949us) op_driver.cc:464] REPLICATION: finished
0709 12:09:58.683782 (+ 90136us) write_op.cc:301] APPLY: starting
0709 12:09:58.683858 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:58.684008 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:58.684136 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:58.684483 (+   347us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:58.684630 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:09:58.684669 (+    39us) write_op.cc:312] APPLY: finished
0709 12:09:58.684853 (+   184us) log.cc:844] Serialized 29 byte log entry
0709 12:09:58.685047 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.685137 (+    90us) write_op.cc:454] Released schema lock
0709 12:09:58.685179 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:58.685531 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:58.685556 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":292265,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":89783,"apply.run_cpu_time_us":1722,"apply.run_wall_time_us":1726,"num_ops":2,"prepare.queue_time_us":56846,"prepare.run_cpu_time_us":21603,"prepare.run_wall_time_us":141940,"raft.queue_time_us":261152,"raft.run_cpu_time_us":20280,"raft.run_wall_time_us":72352,"replication_time_us":661117,"thread_start_us":383460,"threads_started":4,"wal-append.queue_time_us":159895}]]}
I20260709 12:09:58.674520  6332 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:09:58.755450  4917 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.572s (SENT) [suppressed 56 similar messages]
I20260709 12:09:58.707465  6344 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.686506  4915 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:58.639156  6066 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.795629  6445 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.798933  6326 consensus_queue.cc:1059] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.799306  6276 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.799719  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.630650  4945 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.799897  6171 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.805652  6399 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:58.806913  4944 raft_consensus.cc:1240] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.698895  6266 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.855826  6266 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:58.821762  4772 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.823613  6397 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:58.832867  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:58.824530  6414 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.838550  6066 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:58.857218  6326 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.832741  6448 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:58.857760  6326 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:09:58.858297  5046 debug-util.cc:398] Leaking SignalData structure 0x7b0800156060 after lost signal to thread 3728
I20260709 12:09:58.858568  6326 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:58.859287  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08002bc4e0 after lost signal to thread 4808
I20260709 12:09:58.859699  6326 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.860188  6426 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:09:58.860450  5046 debug-util.cc:398] Leaking SignalData structure 0x7b080013b040 after lost signal to thread 4900
I20260709 12:09:58.858973  6171 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:58.857546  6066 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.861438  6171 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:58.859838  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 61495.9us
I20260709 12:09:58.862771  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.863812  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:58.857477  4947 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:58.857621  4772 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:58.865624  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08001c20a0 after lost signal to thread 4975
W20260709 12:09:58.875625  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb5a0 after lost signal to thread 5049
W20260709 12:09:58.876884  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca860 after lost signal to thread 5630
W20260709 12:09:58.877741  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003cabc0 after lost signal to thread 6366
W20260709 12:09:58.865931  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 110516us
I20260709 12:09:58.872900  4772 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:09:58.892241  4772 catalog_manager.cc:5697] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:09:58.864777  4840 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:58.897032  4772 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } }
I20260709 12:09:58.898099  6293 consensus_queue.cc:1059] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:58.898658  6319 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:58.857209  6397 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.837474  6332 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:58.908748  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 44039.8us
I20260709 12:09:58.909478  4840 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.911012  4945 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:58.903120  6448 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.914981  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:09:58.911998  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 91469.2us
I20260709 12:09:58.856664  6266 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:58.903961  6418 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.903769  6280 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.895002  6411 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.891049  6399 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:09:58.917598  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:58.906675  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 220232us
I20260709 12:09:58.921607  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.907341  5597 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:58.919140  4950 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:09:58.919377  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:58.908084  4772 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:09:58.909952  6133 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:58.908787  4943 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:58.925215  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.919914  6276 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:58.934207  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:58.924927  6418 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:58.974870  6424 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:58.978699  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.979439  4947 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:09:58.975427  6266 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.981285  6293 raft_consensus.cc:3055] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.981655  6293 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:58.982451  6293 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.983778  6293 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.935734  6280 raft_consensus.cc:697] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:58.929548  6238 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.986009  6280 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:58.987102  6344 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:58.987612  6418 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.990957  6324 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:58.991977  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:58.929006  6416 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:58.991606  6448 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:58.997524  6421 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:58.992314  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.005895  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 71752.6us
I20260709 12:09:59.006718  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:09:59.007632  6431 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.008095  6431 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:09:59.009038  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.008796  6431 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.009240  6410 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.009660  6410 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:59.010064  6410 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.014488  4839 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:59.015709  5567 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:59.016974  6411 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.017447  6411 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.018492  5602 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:09:59.018249  6411 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.018899  6399 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.019104  6171 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.019397  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.020951  6171 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:59.021399  6171 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.021416  6448 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:59.021982  6448 raft_consensus.cc:697] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:59.022262  6171 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.022807  6448 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.023371  6171 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.006562  6238 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:59.023228  6347 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.026633  6238 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.020922  4943 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:09:59.027196  6066 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.027669  6347 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.028950  6418 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.029676  6414 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.031001  6418 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.031714  6414 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.034081  6397 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.036027  6397 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.037444  6324 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.005203  6416 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:59.038894  6416 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.044097  5598 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:59.049364  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.055125  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:59.056164  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:09:59.056497  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49856.9us
I20260709 12:09:59.056948  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.057202  4915 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:59.061776  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:59.057528  5018 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.087589  6332 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:59.088587  4949 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:59.057854  5016 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.074098  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:59.094201  4950 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:59.103035  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.064604  6116 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.076678  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:59.063472  6066 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.065755  6414 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:59.063004  6397 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:09:59.132926  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 223535us
I20260709 12:09:59.136193  4840 leader_election.cc:400] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:09:59.137055  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:59.111408  6414 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:59.141880  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 84736.9us
I20260709 12:09:59.142633  4915 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:59.111382  6421 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:09:59.106715  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:59.148864  4949 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.140777  6414 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.131140  6418 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:09:59.131037  6426 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:09:59.152320  4949 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:59.111510  6171 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:09:59.144322  6420 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.147715  6066 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.157656  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:09:59.159747  4949 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.161185  6171 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:59.161562  6171 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.162324  6171 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:59.165218  6266 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.165639  6266 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.168331  6280 raft_consensus.cc:2764] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:09:59.170622  6410 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.181440  6445 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.182384  6066 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.183339  6066 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.186439  4944 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.148275  6421 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.172575  6410 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.189051  4950 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:09:59.194689  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:59.195065  6133 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:59.188970  6332 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.196355  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:59.196801  6276 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.203619  4988 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.166349  6266 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.209600  6266 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.210037  6445 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.198443  6411 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:09:59.181350  6462 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.220047  6462 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.220323  5016 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:09:59.220960  6462 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.222262  6462 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.227735  6238 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.215660  6410 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:09:59.229554  6238 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.230556  6421 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.231602  6238 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.201221  6426 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:09:59.233016  4915 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:59.229578  6171 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.234169  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.234508  5018 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:59.233086  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:59.210593  6399 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:59.242386  6399 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:59.242436  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:59.242877  6238 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:09:59.243561  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.233872  6426 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.235337  6411 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:59.252543  6411 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.246670  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.246084  6426 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.247056  6280 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.244047  5568 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.243294  6399 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.253394  6411 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.256551  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.256824  6280 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:59.254436  6426 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.257241  5016 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.240069  6421 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.255070  5597 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:09:59.254806  6116 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.258759  6116 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:59.259562  6116 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.251564  4950 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.261139  6414 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.265195  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:59.267622  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:59.268167  4944 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.257643  6280 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.281489  5019 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.275710  5020 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.280201  4950 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:59.284677  6133 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.286687  5025 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.287899  5017 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.288856  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.289594  5024 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:59.290344  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.290906  5021 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.293524  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.294366  6347 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.294752  6347 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.295651  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.296219  5020 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.296957  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.297509  5019 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.303073  5021 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
W20260709 12:09:59.306386  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 112038us
W20260709 12:09:59.311998  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 108965us
I20260709 12:09:59.282639  6414 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.282824  4943 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:59.295110  6347 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:59.319039  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.319438  5020 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:59.285204  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:59.243355  6238 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.323863  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:59.306129  6133 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.312867  6411 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:59.305099  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 65735us
I20260709 12:09:59.336366  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:09:59.340427  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 104481us
I20260709 12:09:59.333177  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:59.332226  6426 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.347167  4944 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:09:59.341857  6276 consensus_queue.cc:1059] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:09:59.311566  6428 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:09:59.349484  5597 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:09:59.344627  4991 leader_election.cc:336] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.534s (SENT)
I20260709 12:09:59.329748  6431 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:09:59.337874  6133 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:59.340121  6066 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.371559  6238 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.372937  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.373910  5597 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:09:59.374300  4917 leader_election.cc:336] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.651s (SENT)
W20260709 12:09:59.374781  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.359836  5023 raft_consensus.cc:2393] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
W20260709 12:09:59.375341  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 60071us
I20260709 12:09:59.408722  4944 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:59.362183  6293 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:09:59.445444  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 104296us
I20260709 12:09:59.447289  4915 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:59.407411  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 64891.5us
W20260709 12:09:59.452221  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.438184  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 63904.9us
W20260709 12:09:59.452903  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.453460  4917 leader_election.cc:336] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.699s (SENT)
I20260709 12:09:59.453819  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:59.444231  6293 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:59.461143  4915 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.448789  6238 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.465605  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:09:59.457118  6472 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:09:59.452404  6324 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.450160  6314 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:59.446511  6344 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:09:59.468003  6238 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.473824  6238 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.474046  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:59.457062  6445 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:09:59.479756  6445 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:09:59.480293  5570 leader_election.cc:336] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.130s (SENT)
I20260709 12:09:59.480690  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:59.464972  6434 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.466361  6293 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.482519  6428 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.485224  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.485564  6445 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.468614  6421 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.482810  6431 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:59.513631  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.474028  6462 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:09:59.516083  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 154721us
W20260709 12:09:59.582998  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 129565us
W20260709 12:09:59.559085  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 93538.1us
I20260709 12:09:59.475162  6324 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.479147  6314 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.506292  6414 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.587471  5019 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:09:59.523716  6462 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:59.589010  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 108738us
I20260709 12:09:59.515370  6434 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:09:59.592192  6480 log.cc:927] Time spent T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:09:59.518318  6421 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:59.589895  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:59.601558  6238 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.602029  6238 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.603860  6238 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:09:59.604211  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.604398  6238 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:09:59.604828  6414 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.605269  6414 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.604846  6238 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.613149  6238 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.615839  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.616036  6414 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.504190  6133 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.621400  5019 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:09:59.621799  5019 pending_rounds.cc:85] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 4
I20260709 12:09:59.623032  6431 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.623577  5022 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.622825  5020 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.629477  5022 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:59.631577  5017 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:59.632547  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.633201  4950 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:59.625274  5019 pending_rounds.cc:107] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:09:59.635357  4944 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.635668  5019 raft_consensus.cc:2889] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:59.638660  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.639536  6324 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.637176  5018 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.646529  6347 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.649068  6484 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:59.649071  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.649564  6484 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.651288  6462 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.653306  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:09:59.652781  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.653982  4944 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:09:59.624679  5016 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:09:59.655375  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:59.656013  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:59.664942  5019 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:59.653860  5602 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.667725  4944 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:09:59.668912  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.666167  6324 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.669752  4950 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:59.652696  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:09:59.669890  6324 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.670509  5598 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:59.671527  6280 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.671902  6324 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.672919  4841 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:59.674464  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.623512  6431 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.629923  6293 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.663754  6462 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.699868  6462 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.701812  6332 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.676525  6280 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:59.702673  6280 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:59.703605  6280 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:09:59.682040  6344 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.705117  4839 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:09:59.678542  6489 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:09:59.678651  6116 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:09:59.705801  6483 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.706336  6411 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:59.706444  6483 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.706774  6411 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.706928  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.707314  6483 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.686497  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:09:59.707526  6411 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.685544  6171 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:59.692366  5603 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:59.708467  6171 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.693507  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.694278  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.689502  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.695451  6293 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.648738  6434 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.695928  5568 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.696362  6421 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.696854  6488 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:59.697477  6414 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:59.699301  6431 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:09:59.701894  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:59.663905  6484 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.694912  5570 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:59.663252  6347 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.726081  6462 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.711225  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.721376  5019 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.722965  5024 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.724990  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:59.708868  6171 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.734228  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:09:59.735251  5025 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.708405  6411 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.739302  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:59.702836  4915 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:09:59.748394  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45631.2us
I20260709 12:09:59.749027  4991 leader_election.cc:400] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3.
I20260709 12:09:59.749341  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.749769  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:59.724638  6324 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:59.724711  6319 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:59.756913  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:59.757154  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:59.757550  4876 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:59.757782  6319 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:09:59.756929  6324 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.758423  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:59.758617  6324 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:59.758996  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.759188  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.758623  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:59.747145  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.760944  4876 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:09:59.761698  5019 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.762705  5019 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:59.763756  5019 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.751888  6238 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:59.765378  6238 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.752398  6314 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.765545  4875 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:59.767091  4870 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:59.767823  6238 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.768134  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:59.753343  5602 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:09:59.754446  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.769105  5022 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.769528  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.770056  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.759122  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:59.764675  5019 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.756330  6414 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.755151  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:59.771332  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:09:59.769536  5605 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.778586  4876 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:09:59.779465  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.780122  5024 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:09:59.779867  6238 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.781337  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:59.781836  6238 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.767836  4875 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:59.747807  6397 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:09:59.784060  6397 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.727494  6399 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:09:59.786216  4872 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:09:59.775952  5022 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:09:59.757503  6488 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.777482  5025 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.787621  5022 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:59.787827  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.788672  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:09:59.792995  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 58840.5us
I20260709 12:09:59.793061  4876 raft_consensus.cc:2376] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4. Re-sending same reply.
I20260709 12:09:59.794016  4872 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.800101  4875 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:59.801905  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.803957  4917 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.794s (SENT)
I20260709 12:09:59.804387  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:09:59.805341  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.805900  4870 raft_consensus.cc:2376] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2. Re-sending same reply.
I20260709 12:09:59.807415  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.808099  4869 raft_consensus.cc:2368] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4.
I20260709 12:09:59.810245  5019 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.777823  6414 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.795202  6332 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.794452  6482 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.794585  6462 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:59.819099  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 124237us
I20260709 12:09:59.819947  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:09:59.827044  5025 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
W20260709 12:09:59.825951  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:09:59.827057  5570 leader_election.cc:336] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.106s (SENT)
W20260709 12:09:59.827713  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.827711  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:59.825826  5019 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.831573  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:09:59.832121  4947 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.832880  6420 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.834484  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.835297  4870 raft_consensus.cc:2410] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:09:59.836900  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.837460  4944 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:09:59.829926  4915 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.811206  6238 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.812072  6493 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.842217  4950 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:59.819202  6414 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.804679  6266 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:09:59.804847  6276 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:09:59.818957  6116 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.818886  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:09:59.758613  6319 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.838070  6332 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:09:59.808142  6344 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:09:59.851337  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47443.3us
I20260709 12:09:59.844843  6477 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:09:59.852129  4944 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:59.853394  4947 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:09:59.853250  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.853991  6276 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:59.854403  6462 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:59.855968  6424 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.854024  6324 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:59.860641  5570 leader_election.cc:336] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.198s (SENT)
I20260709 12:09:59.859191  4872 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:09:59.862475  6488 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.865702  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:09:59.825466  6487 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:09:59.887006  5017 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.846875  6238 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:09:59.888772  4870 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.845203  6434 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:09:59.893641  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.892763  4869 raft_consensus.cc:2376] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2. Re-sending same reply.
I20260709 12:09:59.894232  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:09:59.883251  6477 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:59.901898  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:09:59.905539  6324 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:09:59.905282  6332 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:09:59.895138  6462 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.894626  6276 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:09:59.958680  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.959263  4872 raft_consensus.cc:2376] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3. Re-sending same reply.
W20260709 12:09:59.951774  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 91154.4us
I20260709 12:09:59.906164  6479 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.958242  4870 raft_consensus.cc:1240] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:59.965950  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 87217.2us
I20260709 12:09:59.965999  4876 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:59.949640  6477 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:59.882558  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 186696us
W20260709 12:09:59.969867  6502 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:09:59.944702  6397 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:09:59.894657  6326 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:09:59.976745  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.906173  6424 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:09:59.961555  6066 consensus_meta.cc:287] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
W20260709 12:09:59.973980  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 224254us
I20260709 12:09:59.958359  6413 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.979843  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.981308  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:09:59.984553  4876 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:59.985632  4869 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:09:59.988481  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.949707  6171 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:09:59.994762  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:09:59.998642  4944 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:59.999879  4872 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.001503  4870 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.001828  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.004137  4991 leader_election.cc:400] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4.
I20260709 12:10:00.003340  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.004971  5017 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:10:00.011162  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.013314  4872 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:09:59.987740  6116 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:59.989089  6066 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.017410  4874 raft_consensus.cc:2368] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 3. Current term is 4.
W20260709 12:10:00.072741  6499 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:10:00.017832  4868 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:00.019068  4949 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.031090  4869 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:09:59.971943  6479 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:00.038618  6495 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:10:00.015789  6276 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.116328  6276 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:00.043342  6503 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:10:00.043977  5017 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.995085  6500 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:10:00.049808  6424 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.051990  6314 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:00.053328  6171 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:00.036528  6509 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:59.990276  6462 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:00.062417  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.032112  6324 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.003304  6238 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.065557  6507 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.065987  5022 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.055791  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:00.066483  6497 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:10:00.065838  6506 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:10:00.067252  6414 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.132902  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.067987  6470 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.133512  4871 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.068091  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:00.098866  6326 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.101079  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:00.104460  4772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 195) took 2172 ms. Trace:
I20260709 12:10:00.105054  6413 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:00.105063  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:09:59.701911  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:00.107821  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 398976us
I20260709 12:10:00.110208  4868 pending_rounds.cc:85] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 1
I20260709 12:10:00.139937  4868 pending_rounds.cc:107] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:00.140228  4868 raft_consensus.cc:2889] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:00.143121  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 137831us
I20260709 12:10:00.144284  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.145062  6506 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:00.119796  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 118852us
I20260709 12:10:00.146189  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.110868  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.113464  6428 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:00.114697  6479 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.120976  4867 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.123733  4869 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.126053  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.127925  4870 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.052021  6477 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.131233  4876 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.136531  4772 rpcz_store.cc:276] 0709 12:09:57.932363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:57.932497 (+   134us) service_pool.cc:224] Handling call
0709 12:09:58.074071 (+141574us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:00.104402 (+2030331us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:59.131178 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:59.166032 (+ 34854us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:59.166065 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:09:59.166078 (+    13us) tablet.cc:662] Decoding operations
0709 12:09:59.177830 (+ 11752us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:59.177878 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:59.177906 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:09:59.178572 (+   666us) tablet.cc:701] Row locks acquired
0709 12:09:59.178588 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:09:59.178716 (+   128us) write_op.cc:270] Start()
0709 12:09:59.178817 (+   101us) write_op.cc:276] Timestamp: P: 1783598999178675 usec, L: 0
0709 12:09:59.178838 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:09:59.179472 (+   634us) log.cc:844] Serialized 3605 byte log entry
0709 12:09:59.405698 (+226226us) op_driver.cc:464] REPLICATION: finished
0709 12:09:59.511257 (+105559us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a577e00ac 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5e320ef0
0709 12:09:59.672947 (+161690us) write_op.cc:301] APPLY: starting
0709 12:09:59.673031 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:59.673253 (+   222us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:59.673275 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:59.683455 (+ 10180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:59.683656 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:09:59.683700 (+    44us) write_op.cc:312] APPLY: finished
0709 12:09:59.683961 (+   261us) log.cc:844] Serialized 71 byte log entry
0709 12:09:59.684633 (+   672us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:59.684752 (+   119us) write_op.cc:454] Released schema lock
0709 12:09:59.684793 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:59.685130 (+   337us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:59.685160 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":23,"spinlock_wait_cycles":315588864,"child_traces":[["op",{"apply.queue_time_us":216754,"apply.run_cpu_time_us":2779,"apply.run_wall_time_us":12183,"num_ops":9,"prepare.queue_time_us":91466,"prepare.run_cpu_time_us":3962,"prepare.run_wall_time_us":85588,"replication_time_us":175133,"spinlock_wait_cycles":3853440,"thread_start_us":152229,"threads_started":2}]]}
I20260709 12:10:00.157866  4873 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.159665  4872 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.168435  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.168999  4870 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.170121  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:00.170694  5603 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:00.112703  6116 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.177196  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.180526  4875 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.129916  6509 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:00.156755  4943 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.183231  4841 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:00.190059  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 43942.4us
I20260709 12:10:00.190851  4991 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:00.191888  5570 leader_election.cc:336] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.048s (SENT)
I20260709 12:10:00.177691  5016 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.197247  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.200311  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.165295  6488 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:00.200999  4874 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:00.201607  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.202090  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.202637  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.203076  4872 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:00.203367  4870 raft_consensus.cc:2410] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:00.206070  4917 leader_election.cc:336] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.172s (SENT)
I20260709 12:10:00.206301  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.206475  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.168041  6326 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.167399  6428 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.209491  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.211699  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:00.212248  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.194061  6266 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:00.178489  6431 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:10:00.179365  6479 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:00.215245  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.216214  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.198311  5597 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:00.168154  6470 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.200624  6347 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.225929  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.203454  6314 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.226146  4773 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.205581  6482 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.167263  6413 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.216528  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:00.226715  6479 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.254195  6479 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:00.255025  6479 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.256147  6479 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.261581  6493 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.262044  6493 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.263810  6493 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:00.264276  6493 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:00.265129  6513 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:00.267534  6470 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.195608  6504 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:10:00.207331  6324 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.251597  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:00.269459  6505 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.387s	user 0.001s	sys 0.001s
I20260709 12:10:00.269897  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.252230  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.270831  6326 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.271632  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.272223  4868 raft_consensus.cc:2393] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:00.272677  6477 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.272799  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.273826  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.274439  4868 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:00.251633  6116 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.268287  6413 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.238878  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.217002  6266 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:00.270867  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.243717  4773 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:00.276010  6428 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.276430  6518 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.268246  4871 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.218627  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:00.249742  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.274603  5605 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.295804  4872 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:00.297724  4869 raft_consensus.cc:2393] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:00.298547  4867 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:00.308845  4872 pending_rounds.cc:85] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 1
I20260709 12:10:00.309134  4872 pending_rounds.cc:107] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:00.309338  4872 raft_consensus.cc:2889] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:00.312580  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.312877  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.313475  4875 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.324333  6489 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.324864  6489 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.327507  6489 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.329144  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.329715  4872 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:00.295051  6525 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.334841  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.305267  6266 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.333089  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.365809  4991 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:00.367674  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.369059  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:00.369668  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.370492  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.371083  5022 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:00.378970  6414 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.379818  6507 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.380021  6347 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:00.380393  6347 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:00.380522  6507 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:00.380848  4991 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.380788  6347 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.381155  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:00.382176  6518 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.381899  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.383061  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.383167  6266 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.383682  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:00.398108  4873 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:00.399124  4991 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:00.400501  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 178111us
I20260709 12:10:00.401059  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:00.402462  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.264674  6493 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.397534  4875 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
W20260709 12:10:00.403026  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.403224  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.382076  6507 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:00.404381  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.370180  6171 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.416419  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.397059  6314 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:00.415508  5570 leader_election.cc:336] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.061s (SENT)
I20260709 12:10:00.383642  5018 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:00.425715  5570 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.427103  6266 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:00.443104  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.407744  6518 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.422677  6507 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.456669  5570 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.384353  6525 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.427547  6484 consensus_queue.cc:1059] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:10:00.473312  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 70163us
I20260709 12:10:00.307822  6509 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.424201  6171 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.473351  5570 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.478873  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:00.455703  6266 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.480202  5022 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:00.480561  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.472869  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:00.487727  6238 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.487989  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.480823  6504 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:00.511063  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.511711  6501 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.511909  6534 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.494935  6483 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.514123  6483 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:00.514779  6526 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:00.516149  6483 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.517155  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.517887  6525 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:00.518262  4991 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.518456  6525 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.519088  6525 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.519306  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.478654  6535 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.509959  5598 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.521302  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:00.522075  6545 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:00.520987  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.454417  6507 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.526401  6501 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:00.532258  6501 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:00.533660  6527 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:10:00.535761  6537 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:00.537837  4868 raft_consensus.cc:2410] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:00.538081  6507 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:00.529243  6133 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.519626  6525 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:00.514129  6524 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:10:00.523638  6504 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:00.521245  6535 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:00.556993  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 113973us
I20260709 12:10:00.517889  6171 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.536208  6500 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:00.561585  6479 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.571215  6479 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.573061  6479 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.574752  4943 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
W20260709 12:10:00.576982  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 53243us
W20260709 12:10:00.579382  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.566303  6504 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:00.580912  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.567051  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:00.568130  6314 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.582345  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.583256  6479 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.593070  4840 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.598752  6493 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:00.600601  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.600375  6347 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:00.601104  4917 leader_election.cc:336] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.913s (SENT)
I20260709 12:10:00.603027  6347 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:00.605481  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:00.606204  6332 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:00.604346  4841 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:00.607933  6470 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.613003  6470 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:00.613827  6470 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.614307  6462 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.592135  6547 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.593276  6171 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:00.593321  6266 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:10:00.603740  6484 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:00.679531  4759 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica baa50eb5ed704004b7f391934a59d010 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:00.660151  6445 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.595957  6479 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.688737  4917 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:10:00.700275  6552 log.cc:927] Time spent T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:00.700138  6280 consensus_queue.cc:1059] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:00.701331  6276 consensus_meta.cc:287] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.004s
I20260709 12:10:00.707222  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.707793  5020 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.715003  5019 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.716084  4874 raft_consensus.cc:2410] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:00.606781  6332 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.722133  4915 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:00.730931  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 60014.5us
I20260709 12:10:00.732177  4917 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:00.733022  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.737571  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:00.738058  5021 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.729378  6344 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.761188  6558 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.761806  6554 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:10:00.762581  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.763332  4871 raft_consensus.cc:2393] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 2: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:00.765107  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.765691  4876 raft_consensus.cc:2376] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4. Re-sending same reply.
I20260709 12:10:00.766089  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.766635  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.765179  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.768230  4867 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:00.731230  6424 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:10:00.779366  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.732745  6420 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:00.782439  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 46632.3us
I20260709 12:10:00.737015  6116 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:00.789435  4873 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.794605  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.796065  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.795238  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.798314  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:00.799494  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.796665  4867 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.800648  5021 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:00.796777  4875 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.800863  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.735263  6428 consensus_queue.cc:1059] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:10:00.793787  6488 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.795203  6293 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.803866  6414 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.804245  6534 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.804673  6537 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.760504  6504 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.784823  6420 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:00.797968  6347 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:00.819057  6559 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.809134  6538 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:10:00.821216  6559 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.819177  6280 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:10:00.823282  6559 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.788439  6558 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.808852  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.784343  6493 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:00.740412  6416 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 12:10:00.817788  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.815943  4871 raft_consensus.cc:2955] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:00.806205  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.794644  6560 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:10:00.825066  6420 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.842134  4875 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:00.843305  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.844080  4875 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:00.845018  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.845629  4875 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:00.846575  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.847126  4991 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:00.847427  4991 leader_election.cc:403] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:00.847954  6509 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.848284  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:00.850577  6506 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:00.852257  6506 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:00.852588  6506 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.819729  6293 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.834650  6479 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.864969  4867 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:00.835721  5018 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:10:00.866539  6293 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:00.867234  5018 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:00.837169  6558 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.878333  4873 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.879405  6558 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.883471  6506 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.885099  4915 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:00.854943  6332 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:00.865123  5598 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:00.893864  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:00.895678  4875 raft_consensus.cc:2410] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:00.867868  6424 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:00.874372  6133 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.899180  6504 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:00.901419  6421 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:00.922049  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.922282  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.922399  6421 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:00.923123  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.923848  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:00.888928  6416 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:00.905413  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.923274  6421 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.909821  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:00.908717  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:00.915766  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.929432  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:00.917137  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:00.918176  4950 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:00.924422  4867 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.924822  5020 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.923784  5019 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:00.931263  4840 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:00.927295  6530 raft_consensus.cc:3055] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.923025  6424 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:00.932049  6530 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:00.932240  6558 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.928033  6416 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.923157  4875 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.935432  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.937006  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.938546  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.939080  4945 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:00.940536  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:00.940768  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.944118  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.946069  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.946712  4951 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:00.948091  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:00.948613  4942 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.948628  4951 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:00.934252  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.958823  4942 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:00.960373  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.933468  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:00.964386  4945 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:00.968636  4870 raft_consensus.cc:2410] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:00.965309  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.960165  6344 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:00.977212  5568 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:00.934554  6479 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.935300  6493 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:00.952693  6558 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:00.952944  6116 raft_consensus.cc:697] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:00.982611  4875 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:00.985155  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:00.985893  6324 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.986387  6324 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:00.964130  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:00.980511  6319 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:00.975844  4943 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:10:00.932919  6530 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:00.979725  6558 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.026198  6066 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:01.028609  6479 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.029668  6397 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.030293  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:01.031783  6347 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:01.040297  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.045177  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:01.045853  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:01.047142  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:01.048151  5601 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:01.079326  4990 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:01.080298  6535 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:01.050799  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:01.053896  6533 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.522s	user 0.003s	sys 0.000s
I20260709 12:10:01.055078  5606 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:10:01.059461  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.062741  5604 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.987167  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:00.987572  6488 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.982808  6493 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:01.081079  6535 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:01.095407  6493 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.065682  6066 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:01.096871  6066 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.068339  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.017976  6424 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.061784  6319 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.076064  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.076205  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.104120  5020 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
W20260709 12:10:01.076985  6563 log.cc:927] Time spent T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:01.066164  6558 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.093252  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.083122  6238 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:01.070720  6530 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.069432  6397 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:01.071362  6559 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.081804  6347 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.105134  6171 consensus_queue.cc:1059] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.103219  6319 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.109318  5019 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:01.134135  5019 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:01.135180  5019 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:01.114363  5022 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.083487  5600 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:01.140549  4867 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
W20260709 12:10:01.141395  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.142040  4871 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:01.109885  4869 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:01.143325  4869 pending_rounds.cc:85] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 2
I20260709 12:10:01.143568  4869 pending_rounds.cc:107] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:01.143771  4869 raft_consensus.cc:2889] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:01.101781  6066 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.071688  6479 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.101526  6509 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:01.131147  5023 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.139195  5022 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:01.139570  6397 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.155831  5022 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.120424  6411 raft_consensus.cc:3055] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.157811  5018 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:01.123389  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:01.121477  6238 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:01.100574  6324 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.170881  4876 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:01.171250  4876 pending_rounds.cc:85] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 4
I20260709 12:10:01.171478  4876 pending_rounds.cc:107] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:01.171701  4876 raft_consensus.cc:2889] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:01.114431  6344 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.162563  6411 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:01.136070  6559 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.190662  6238 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.165033  6347 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.123757  6116 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.221597  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 1946) took 1019 ms. Trace:
I20260709 12:10:01.221865  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:01.199306  4876 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:01.201697  6555 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.433s	user 0.003s	sys 0.000s
W20260709 12:10:01.202013  6528 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.636s	user 0.003s	sys 0.001s
I20260709 12:10:01.207080  6293 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.209213  6506 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:01.211519  6509 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.222838  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:01.225008  4872 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:01.229754  6171 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.250805  6171 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.251158  6171 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.232470  5018 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:01.198465  6479 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.221987  4874 rpcz_store.cc:276] 0709 12:10:00.201791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.201893 (+   102us) service_pool.cc:224] Handling call
0709 12:10:01.221420 (+1019527us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54003e2bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:01.221545 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180299136}
I20260709 12:10:01.246795  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 853) took 1445 ms. Trace:
I20260709 12:10:01.258066  5025 rpcz_store.cc:276] 0709 12:09:59.801744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.827808 (+ 26064us) service_pool.cc:224] Handling call
0709 12:09:59.828088 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:00.089034 (+260946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.089065 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:00.089490 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:10:00.297690 (+208200us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:00.332565 (+ 34875us) log.cc:844] Serialized 14 byte log entry
0709 12:10:00.332746 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:00.332829 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:01.115789 (+782960us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:01.230728 (+114939us) raft_consensus.cc:1685] finished
0709 12:10:01.246575 (+ 15847us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:01.246711 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86404,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":5012,"raft.queue_time_us":21670,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":36109,"spinlock_wait_cycles":22828800,"thread_start_us":435115,"threads_started":2,"wal-append.queue_time_us":307358}
I20260709 12:10:01.249070  4872 pending_rounds.cc:85] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 2
W20260709 12:10:01.259078  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 373205us
I20260709 12:10:01.260054  4872 pending_rounds.cc:107] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:01.260329  4872 raft_consensus.cc:2889] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:01.249559  6266 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.249779  4840 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:01.250252  6276 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.231007  6537 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:01.253906  6238 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:01.267722  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.269706  6504 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:01.271299  6504 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.265798  6479 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:01.273463  6479 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:01.261392  6266 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.274302  6479 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.277935  6558 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.282364  6559 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.284448  6347 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:01.285235  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.286938  6397 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.286865  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:01.288832  4869 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.247180  6293 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.280011  6266 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.300539  4874 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:01.279826  6416 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:01.262743  6411 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.267520  6537 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.306955  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:01.309082  4869 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:01.314646  4915 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:01.316648  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.317323  5024 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:01.313581  6558 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.320350  6560 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.320772  6560 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.321120  6560 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.321655  6293 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.322563  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.323251  5021 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:01.324524  6566 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:10:01.314277  6066 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.326480  6066 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.328357  6066 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:01.329335  6420 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.329917  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1960) took 1078 ms. Trace:
I20260709 12:10:01.330261  4872 rpcz_store.cc:276] 0709 12:10:00.251850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.330320 (+ 78470us) service_pool.cc:224] Handling call
0709 12:10:01.224659 (+894339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.260714 (+ 36055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.329752 (+ 69038us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54003e2bd0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:01.329866 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2056154880}
I20260709 12:10:01.331303  6420 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.333094  6537 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.334858  6560 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.339918  6560 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.341472  4944 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:01.343437  6570 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.320485  6411 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.346109  6066 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:01.352833  6066 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.350443  6488 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:01.302570  6319 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.347641  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:01.350559  6414 consensus_queue.cc:1059] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:01.355921  6293 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:01.355755  6414 raft_consensus.cc:3055] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:01.356427  6293 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.356986  6414 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:01.357827  6414 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.358871  6414 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.319494  6504 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.363495  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.336762  6326 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.364606  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.365826  6326 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.368779  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:01.369477  5024 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.343843  6570 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.385020  6570 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.386286  6477 raft_consensus.cc:3055] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.386643  6477 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:01.387445  6477 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.388489  6477 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.389168  5570 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:01.355620  6319 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.412240  6319 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.419322  5598 pending_rounds.cc:85] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 4
I20260709 12:10:01.419623  5598 pending_rounds.cc:107] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:01.419878  5598 raft_consensus.cc:2889] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:01.399494  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 83015.5us
I20260709 12:10:01.400701  6509 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.401780  6488 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.404031  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:01.403920  6506 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.404515  6347 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.404906  6570 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.405797  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.429080  4773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 212) took 3187 ms. Trace:
I20260709 12:10:01.435063  6314 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.442660  5024 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:01.446888  5568 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:01.435151  6509 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:10:01.440183  6488 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:10:01.442185  6421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.026s
I20260709 12:10:01.468422  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.505563  5024 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:01.506390  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.507369  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:01.507833  5024 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:01.502252  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 46564.9us
W20260709 12:10:01.502831  4949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.017s	sys 0.080s
W20260709 12:10:01.508472  4949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.018s	sys 0.080s
I20260709 12:10:01.511425  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.445945  6314 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:10:01.520959  4950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.014s
I20260709 12:10:01.521235  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:01.522153  4950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.012s	sys 0.014s
I20260709 12:10:01.518661  4774 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.526090  4774 catalog_manager.cc:5697] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 3, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.530910  4774 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.502256  6414 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:01.505299  6421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.009s	sys 0.027s
I20260709 12:10:01.459125  6424 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:10:01.549686  5024 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:01.552652  4949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "231547812bf34f17b386898e6451cc49"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:01.553213  4949 raft_consensus.cc:606] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:01.505019  6566 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:01.550611  4774 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.440256  4773 rpcz_store.cc:276] 0709 12:09:58.245054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.248905 (+  3851us) service_pool.cc:224] Handling call
0709 12:10:01.429016 (+3180111us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:00.521605 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:00.522118 (+   513us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:00.522152 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:10:00.522170 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:00.522526 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:00.522590 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:00.522615 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:00.522898 (+   283us) tablet.cc:701] Row locks acquired
0709 12:10:00.522914 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:10:00.523030 (+   116us) write_op.cc:270] Start()
0709 12:10:00.523134 (+   104us) write_op.cc:276] Timestamp: P: 1783599000522994 usec, L: 0
0709 12:10:00.523152 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:10:00.581143 (+ 57991us) log.cc:844] Serialized 913 byte log entry
0709 12:10:00.805797 (+224654us) op_driver.cc:464] REPLICATION: finished
0709 12:10:00.846673 (+ 40876us) write_op.cc:301] APPLY: starting
0709 12:10:00.846752 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:00.846859 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:00.846973 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:00.847271 (+   298us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:00.847413 (+   142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:00.847449 (+    36us) write_op.cc:312] APPLY: finished
0709 12:10:00.847584 (+   135us) log.cc:844] Serialized 29 byte log entry
0709 12:10:00.862107 (+ 14523us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:00.867088 (+  4981us) write_op.cc:454] Released schema lock
0709 12:10:00.867132 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":55302,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":33041,"apply.run_cpu_time_us":1526,"apply.run_wall_time_us":20754,"num_ops":2,"prepare.queue_time_us":143853,"prepare.run_cpu_time_us":2884,"prepare.run_wall_time_us":63922,"replication_time_us":270027,"thread_start_us":106994,"threads_started":2}]]}
I20260709 12:10:01.554152  4915 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:01.553315  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:01.466225  6420 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:10:01.561434  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:01.561981  5021 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.563199  4871 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.557747  5024 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:01.499680  6397 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 12:10:01.556376  4948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.031s	sys 0.039s
I20260709 12:10:01.553586  4949 raft_consensus.cc:614] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:01.500792  6266 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.538497  6558 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:01.543557  6276 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:01.552292  6414 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:10:01.573261  4948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.031s	sys 0.039s
I20260709 12:10:01.561074  6416 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.565784  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:01.564258  4774 catalog_manager.cc:5697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.597383  5021 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:01.575508  6276 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.629729  5024 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.598587  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:01.634801  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.019s	sys 0.044s
W20260709 12:10:01.578713  6487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.019s	sys 0.036s
W20260709 12:10:01.637828  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.019s	sys 0.044s
W20260709 12:10:01.638106  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 852720us
I20260709 12:10:01.584084  6066 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:01.560158  6566 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:01.646530  4914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.019s	sys 0.018s
W20260709 12:10:01.652882  4914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.020s	sys 0.018s
W20260709 12:10:01.637498  6399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.014s	sys 0.038s
I20260709 12:10:01.573580  6558 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:01.646755  4870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.007s	sys 0.032s
W20260709 12:10:01.653717  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 55208.5us
W20260709 12:10:01.660185  4870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.007s	sys 0.032s
W20260709 12:10:01.662959  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.648605  6416 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:01.640900  6487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.020s	sys 0.036s
I20260709 12:10:01.639456  6276 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.648744  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:01.655220  5017 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.008s	sys 0.012s
W20260709 12:10:01.709841  5017 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.009s	sys 0.013s
I20260709 12:10:01.666132  5021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
W20260709 12:10:01.666225  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.697711  6293 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.648663  6314 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.668752  6414 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.707062  6266 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:01.663441  6560 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:01.698062  6434 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.698606  6574 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.720340  6326 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:01.668501  6424 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:10:01.630537  6488 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:01.659987  6571 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.721645  5021 raft_consensus.cc:606] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:01.722524  6324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.017s	sys 0.016s
I20260709 12:10:01.720978  6445 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.807420  5021 raft_consensus.cc:614] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:01.659348  6399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.014s	sys 0.038s
W20260709 12:10:01.728344  6516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.009s	sys 0.025s
W20260709 12:10:01.793916  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.720789  6570 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:01.793563  4873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.027s	sys 0.013s
W20260709 12:10:01.774349  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 43693.6us
W20260709 12:10:01.806730  5019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.000s	sys 0.015s
W20260709 12:10:01.845517  5019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.000s	sys 0.016s
I20260709 12:10:01.746250  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:01.781735  6344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.028s	sys 0.018s
W20260709 12:10:01.809069  6324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.021s	sys 0.016s
W20260709 12:10:01.844650  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.728381  6293 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.846549  4873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.030s	sys 0.014s
I20260709 12:10:01.847230  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:01.870568  5021 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.822785  6326 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.819037  6516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.009s	sys 0.025s
I20260709 12:10:01.871119  6428 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.871690  6570 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:01.856873  6344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.032s	sys 0.018s
W20260709 12:10:01.745658  6470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.023s	sys 0.033s
I20260709 12:10:01.872593  5602 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:01.873027  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.874254  6293 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.875115  6434 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.745702  6416 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.729439  6276 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:01.881093  5021 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
W20260709 12:10:01.881289  6581 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:10:01.886170  5020 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:01.832792  6571 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:01.850449  5016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.015s	sys 0.030s
W20260709 12:10:01.890460  5018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.013s
W20260709 12:10:01.905176  5018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.005s	sys 0.013s
W20260709 12:10:01.893469  4916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.014s	sys 0.040s
W20260709 12:10:01.906337  4916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.015s	sys 0.040s
W20260709 12:10:01.906643  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 941340us
W20260709 12:10:01.896883  5022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.006s	sys 0.016s
I20260709 12:10:01.815063  6445 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:01.898061  5606 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:10:01.892935  6470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.023s	sys 0.033s
I20260709 12:10:01.899773  6516 raft_consensus.cc:3055] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:01.893584  6332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.013s
I20260709 12:10:02.020046  4868 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:10:01.991832  6171 consensus_meta.cc:287] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.740s	user 0.007s	sys 0.002s
I20260709 12:10:01.907815  6238 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:02.018775  6332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.006s	sys 0.013s
I20260709 12:10:01.890720  6326 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:02.014197  6411 consensus_meta.cc:287] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.000s
W20260709 12:10:02.014734  6580 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 12:10:02.015321  6584 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 12:10:02.015713  6445 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:02.016027  6582 log.cc:927] Time spent T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:10:01.905088  5016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.016s	sys 0.030s
I20260709 12:10:01.894858  6570 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.018180  6516 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:02.022261  6566 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.033038  6324 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.028849  6171 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.032413  6238 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.028009  6558 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:02.062086  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 1954) took 1130 ms. Trace:
I20260709 12:10:02.062932  4950 rpcz_store.cc:276] 0709 12:10:00.931500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.931604 (+   104us) service_pool.cc:224] Handling call
0709 12:10:00.955853 (+ 24249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:00.956134 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.956158 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:00.956538 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.522528 (+565990us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:01.522564 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.522624 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.061896 (+539272us) raft_consensus.cc:1685] finished
0709 12:10:02.061916 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.062029 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108695,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":2211,"thread_start_us":539403,"threads_started":1,"wal-append.queue_time_us":766889}
W20260709 12:10:01.982812  5022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.006s	sys 0.016s
W20260709 12:10:02.075235  4874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.016s
W20260709 12:10:02.076525  4874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.010s	sys 0.016s
W20260709 12:10:02.077744  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 170485us
W20260709 12:10:01.893512  5597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.010s	sys 0.010s
W20260709 12:10:02.093768  4876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.013s	sys 0.007s
I20260709 12:10:02.103443  4916 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:10:02.075315  6547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.011s	sys 0.023s
W20260709 12:10:01.984622  6479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.004s	sys 0.018s
W20260709 12:10:02.095263  6493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.033s	sys 0.083s
W20260709 12:10:02.133602  4876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.013s	sys 0.007s
I20260709 12:10:02.076645  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 878) took 1366 ms. Trace:
I20260709 12:10:02.130714  6558 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.135541  6604 log.cc:927] Time spent T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:10:02.136200  6587 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:10:02.136911  6583 log.cc:927] Time spent T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:10:02.137604  6590 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:10:02.183051  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:02.188647  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.174535  6547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.012s	sys 0.023s
I20260709 12:10:02.057034  6324 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
W20260709 12:10:02.181326  6493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.033s	sys 0.084s
I20260709 12:10:02.132611  6293 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.128058  6586 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.049526  6571 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:02.134725  6593 log.cc:927] Time spent T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:02.186489  4949 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.181094  6575 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.175328  5567 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:02.190361  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:02.174388  6479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.004s	sys 0.018s
I20260709 12:10:02.076001  6516 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:02.225287  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.103852  6421 consensus_queue.cc:1059] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:10:02.227865  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:02.236114  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:02.249368  4951 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.224658  6314 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.250484  4950 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:02.177620  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:02.290107  5025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.007s	sys 0.035s
I20260709 12:10:02.294157  4949 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:02.294415  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 119253us
I20260709 12:10:02.305596  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.298790  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 97) took 1442 ms. Trace:
I20260709 12:10:02.191581  6558 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.308043  4951 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:02.336516  4873 rpcz_store.cc:276] 0709 12:10:00.856103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.136336 (+280233us) service_pool.cc:224] Handling call
0709 12:10:01.163017 (+ 26681us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:01.164331 (+  1314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.164359 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:01.166921 (+  2562us) log.cc:844] Serialized 52 byte log entry
0709 12:10:01.873185 (+706264us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:01.873469 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 12:10:01.873643 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.873706 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.298598 (+424892us) raft_consensus.cc:1685] finished
0709 12:10:02.298618 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.298735 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":970,"prepare.queue_time_us":583,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":1492,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":5271,"thread_start_us":672202,"threads_started":1,"wal-append.queue_time_us":848136}
I20260709 12:10:02.335675  5018 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:02.308890  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.321552  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 96) took 1495 ms. Trace:
I20260709 12:10:02.307183  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.338037  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:02.335564  5025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.009s	sys 0.036s
W20260709 12:10:02.339182  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 493826us
I20260709 12:10:02.342451  4949 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:02.249352  6547 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.295552  6570 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.346246  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:02.314086  6602 log.cc:927] Time spent T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:10:02.248857  6586 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:02.314626  6596 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:10:02.342129  4870 rpcz_store.cc:276] 0709 12:10:00.826041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.106996 (+280955us) service_pool.cc:224] Handling call
0709 12:10:01.107266 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.107560 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.107587 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.107958 (+   371us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.662571 (+554613us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:01.662609 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.662681 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.321343 (+658662us) raft_consensus.cc:1685] finished
0709 12:10:02.321363 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.321493 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":451,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":554273,"threads_started":1,"wal-append.queue_time_us":915661}
W20260709 12:10:02.315963  6607 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:10:02.291782  6575 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:02.350212  4917 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:02.315426  6324 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:02.465231  6579 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.737s	user 0.011s	sys 0.004s
W20260709 12:10:02.474539  6601 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.409s	user 0.000s	sys 0.000s
I20260709 12:10:02.348412  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.402716  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:02.403100  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.510128  6479 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.414618  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.546629  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1980) took 1634 ms. Trace:
I20260709 12:10:02.623847  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:02.593735  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 243584us
I20260709 12:10:02.625033  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:02.348095  4951 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.301625  6537 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:02.316712  6597 log.cc:927] Time spent T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:02.629874  4951 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:02.133868  5597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.010s	sys 0.011s
I20260709 12:10:02.600426  4949 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:02.390585  6276 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:02.498508  6477 consensus_meta.cc:287] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 1.099s	user 0.005s	sys 0.005s
I20260709 12:10:02.457844  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:02.669363  5023 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.311430  6326 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:02.509286  6600 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.435s	user 0.001s	sys 0.000s
I20260709 12:10:02.337352  6428 raft_consensus.cc:3055] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.673715  6428 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:02.674521  6428 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:02.675645  6428 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:02.499133  6613 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:10:02.445869  6344 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.214s
I20260709 12:10:02.349597  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.600880  6547 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:02.678293  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.679278  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.679615  6547 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:02.680094  6547 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.680202  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.680838  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 878) took 1283 ms. Trace:
I20260709 12:10:02.625149  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 95) took 1860 ms. Trace:
W20260709 12:10:02.625690  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.681595  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 325) took 1262 ms. Trace:
I20260709 12:10:02.682487  4840 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:02.184468  5016 rpcz_store.cc:276] 0709 12:10:00.710663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.106045 (+395382us) service_pool.cc:224] Handling call
0709 12:10:01.106304 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.106488 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:01.115908 (+  9420us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.054808 (+938900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.056541 (+  1733us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.059165 (+  2624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.065979 (+  6814us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.074489 (+  8510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8200,"prepare.queue_time_us":11078,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":33,"raft.queue_time_us":3291,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2353,"spinlock_wait_cycles":30705024,"thread_start_us":931871,"threads_started":1,"wal-append.queue_time_us":1378056}
I20260709 12:10:02.523614  6566 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:02.684120  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:02.684199  6566 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.586638  6411 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.446696  6606 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.596258  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:02.524541  6614 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.496549  6238 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:02.402361  6583 log.cc:927] Time spent T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:10:02.594645  6575 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.483147  6347 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.479115  6558 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.447448  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.595721  6570 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.342311  6314 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:02.702005  5017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.023s	sys 0.052s
W20260709 12:10:02.702339  5017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.023s	sys 0.053s
I20260709 12:10:02.680528  6547 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:02.693908  6614 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.704574  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1985) took 1144 ms. Trace:
I20260709 12:10:02.705278  6171 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.705602  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1974) took 1909 ms. Trace:
I20260709 12:10:02.706661  6314 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:02.705942  4875 rpcz_store.cc:276] 0709 12:10:00.796452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.986954 (+190502us) service_pool.cc:224] Handling call
0709 12:10:01.057282 (+ 70328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.057606 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.057634 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.065429 (+  7795us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.559509 (+494080us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:01.576034 (+ 16525us) log.cc:844] Serialized 14 byte log entry
0709 12:10:01.576193 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.576257 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.180342 (+604085us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b180037fa80. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:02.705349 (+525007us) raft_consensus.cc:1685] finished
0709 12:10:02.705439 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.705553 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19291,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":9818,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":2415,"spinlock_wait_cycles":4459392,"thread_start_us":490152,"threads_started":1,"wal-append.queue_time_us":960428}
I20260709 12:10:02.707136  6314 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.694159  6606 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.707608  6314 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:02.661049  5602 consensus_meta.cc:287] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.753s	user 0.003s	sys 0.008s
I20260709 12:10:02.708405  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:02.690980  6326 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.664961  6559 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:02.665392  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.472991  6293 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.155s
I20260709 12:10:02.623488  4867 rpcz_store.cc:276] 0709 12:10:00.911947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.144872 (+232925us) service_pool.cc:224] Handling call
0709 12:10:01.145716 (+   844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.154275 (+  8559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.154302 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.154672 (+   370us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.656475 (+501803us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:01.656537 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.656646 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.546430 (+889784us) raft_consensus.cc:1685] finished
0709 12:10:02.546449 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.546574 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8229,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5855,"spinlock_wait_cycles":2432,"thread_start_us":487752,"threads_started":1,"wal-append.queue_time_us":853642}
I20260709 12:10:02.684770  5016 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:02.685670  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:02.687513  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 884) took 1804 ms. Trace:
I20260709 12:10:02.681172  5024 rpcz_store.cc:276] 0709 12:10:01.397621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.634937 (+237316us) service_pool.cc:224] Handling call
0709 12:10:01.635206 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.640262 (+  5056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.640292 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.658999 (+ 18707us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.126561 (+467562us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.126711 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.126993 (+   282us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.680630 (+553637us) raft_consensus.cc:1685] finished
0709 12:10:02.680651 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.680768 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5963,"raft.queue_time_us":5009,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12605,"thread_start_us":362947,"threads_started":1,"wal-append.queue_time_us":562195}
I20260709 12:10:02.717247  4947 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.718135  5024 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:02.718708  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 893) took 1216 ms. Trace:
I20260709 12:10:02.719030  5024 rpcz_store.cc:276] 0709 12:10:01.502090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.717721 (+1215631us) service_pool.cc:224] Handling call
0709 12:10:02.717981 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.718471 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.718656 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:02.720427  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 887) took 1159 ms. Trace:
I20260709 12:10:02.689133  4868 rpcz_store.cc:276] 0709 12:10:00.764228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.767520 (+  3292us) service_pool.cc:224] Handling call
0709 12:10:00.786332 (+ 18812us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.020456 (+1234124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.624890 (+604434us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001761d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:02.625090 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836739456}
I20260709 12:10:02.658504  6324 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.698113  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:02.698705  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.692513  6411 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.340463  6414 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.321s
I20260709 12:10:02.709086  6326 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.662214  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.711113  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 877) took 2000 ms. Trace:
I20260709 12:10:02.715130  4951 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:02.731787  4942 raft_consensus.cc:2368] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4.
I20260709 12:10:02.650419  6479 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.720726  5024 rpcz_store.cc:276] 0709 12:10:01.560959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.719738 (+1158779us) service_pool.cc:224] Handling call
0709 12:10:02.720013 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.720152 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.720176 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.720215 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.720243 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.720292 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.720384 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:02.704967  4874 rpcz_store.cc:276] 0709 12:10:01.560020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.560133 (+   113us) service_pool.cc:224] Handling call
0709 12:10:01.560450 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.699127 (+138677us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b4800300858. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5f813aa1 00007f2a5f80ab37 00007f2a5f80a9ca 00007f2a5f90226f 00007f2a5f901f37 00007f2a5f91655c 00007f2a5f916508 00007f2a5f916488 00007f2a5f916443 00007f2a5f9156ec 00007f2a5e83fa96
0709 12:10:02.076922 (+377795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.076953 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.077383 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.539307 (+461924us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:02.539346 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.539411 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.704294 (+164883us) raft_consensus.cc:1685] finished
0709 12:10:02.704313 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.704513 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6283,"raft.run_cpu_time_us":1896,"raft.run_wall_time_us":124448,"spinlock_wait_cycles":2726656,"thread_start_us":977744,"threads_started":2,"wal-append.queue_time_us":625647}
I20260709 12:10:02.737901  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 888) took 1159 ms. Trace:
I20260709 12:10:02.738246  5024 rpcz_store.cc:276] 0709 12:10:01.578298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.737194 (+1158896us) service_pool.cc:224] Handling call
0709 12:10:02.737478 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.737636 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.737660 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.737696 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.737723 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.737770 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.737855 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:02.709565  6559 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:02.717159  5019 rpcz_store.cc:276] 0709 12:10:00.883556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.135727 (+252171us) service_pool.cc:224] Handling call
0709 12:10:01.135986 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.139499 (+  3513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.139527 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.139896 (+   369us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.846129 (+706233us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:01.846171 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.846242 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.687343 (+841101us) raft_consensus.cc:1685] finished
0709 12:10:02.687361 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.687463 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3506,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":705882,"threads_started":1,"wal-append.queue_time_us":917808}
I20260709 12:10:02.731590  5020 rpcz_store.cc:276] 0709 12:10:00.710431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.109593 (+399162us) service_pool.cc:224] Handling call
0709 12:10:01.109883 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.903314 (+793431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.710894 (+807580us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54002d3a54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:02.711057 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784790912}
I20260709 12:10:02.734512  4950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:02.735548  5022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 867) took 1837 ms. Trace:
I20260709 12:10:02.696110  6238 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:02.766079  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:02.697467  6347 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.775856  4947 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:02.713408  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 880) took 2002 ms. Trace:
I20260709 12:10:02.749019  6344 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:02.785701  5022 rpcz_store.cc:276] 0709 12:10:00.897794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.158819 (+261025us) service_pool.cc:224] Handling call
0709 12:10:01.159085 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.161390 (+  2305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.161420 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.161820 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.071557 (+909737us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:02.071594 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.071654 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.735365 (+663711us) raft_consensus.cc:1685] finished
0709 12:10:02.735385 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.735494 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2098,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":909395,"threads_started":1,"wal-append.queue_time_us":941882}
I20260709 12:10:02.787925  5017 rpcz_store.cc:276] 0709 12:10:00.711091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.122781 (+411690us) service_pool.cc:224] Handling call
0709 12:10:01.123066 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:01.123238 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:01.721455 (+598217us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.713106 (+991651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.713158 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:02.713200 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.713260 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.713359 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2690,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":1567646,"threads_started":2}
I20260709 12:10:02.732652  6547 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:02.731673  6116 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.734369  6326 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:02.795739  5021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.002s	sys 0.016s
W20260709 12:10:02.791241  4869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.356s	user 0.031s	sys 0.047s
I20260709 12:10:02.792169  5019 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:02.782451  6280 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:02.681962  5598 rpcz_store.cc:276] 0709 12:10:01.418721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.418847 (+   126us) service_pool.cc:224] Handling call
0709 12:10:01.419159 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.420340 (+  1181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.420367 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.420779 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.898454 (+477675us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:01.902111 (+  3657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.959112 (+ 57001us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.681373 (+722261us) raft_consensus.cc:1685] finished
0709 12:10:02.681392 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.681526 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":428003,"threads_started":1,"wal-append.queue_time_us":644845}
W20260709 12:10:02.793107  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 446531us
I20260709 12:10:02.749347  6558 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.736338  6324 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:02.791112  6488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.015s
W20260709 12:10:02.798662  4869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.363s	user 0.031s	sys 0.047s
W20260709 12:10:02.796077  5021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.002s	sys 0.016s
W20260709 12:10:02.800674  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 339402us
I20260709 12:10:02.806006  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:02.809110  6628 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.809595  6628 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:02.790454  6238 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:02.797811  6116 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:02.813808  6171 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:02.819576  6610 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:10:02.822849  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 162295us
W20260709 12:10:02.803303  6488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.008s	sys 0.015s
I20260709 12:10:02.794270  6344 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:02.821061  6595 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.762s	user 0.003s	sys 0.000s
I20260709 12:10:02.828771  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:02.831315  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:02.830621  6525 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.832893  6525 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.834906  6525 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:02.835799  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 152046us
I20260709 12:10:02.837132  4839 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:02.839463  4839 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:02.800316  6280 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.823180  6314 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:02.801460  6558 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:02.848383  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:02.848869  4991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.001s	sys 0.027s
W20260709 12:10:02.849198  4991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.001s	sys 0.027s
W20260709 12:10:02.849442  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 551192us
W20260709 12:10:02.852502  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 515299us
I20260709 12:10:02.853510  4841 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:02.847497  6293 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.843924  6622 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.874516  6525 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.880239  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1988) took 1240 ms. Trace:
I20260709 12:10:02.848541  6488 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.880596  4871 rpcz_store.cc:276] 0709 12:10:01.640280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.906489 (+266209us) service_pool.cc:224] Handling call
0709 12:10:01.906802 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:01.991696 (+ 84894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.991725 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:02.015344 (+ 23619us) log.cc:844] Serialized 52 byte log entry
0709 12:10:02.301009 (+285665us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.314471 (+ 13462us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.336094 (+ 21623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.336164 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.880030 (+543866us) raft_consensus.cc:1685] finished
0709 12:10:02.880050 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.880182 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21335,"prepare.queue_time_us":13015,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":22382,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":22623,"thread_start_us":285333,"threads_started":1,"wal-append.queue_time_us":645897}
I20260709 12:10:02.881731  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 129) took 1516 ms. Trace:
I20260709 12:10:02.882800  5025 rpcz_store.cc:276] 0709 12:10:01.365097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.366376 (+  1279us) service_pool.cc:224] Handling call
0709 12:10:01.366651 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.367203 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.367231 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.367755 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.343377 (+975622us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:02.343423 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.343482 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.881547 (+538065us) raft_consensus.cc:1685] finished
0709 12:10:02.881568 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.881674 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":975319,"threads_started":1,"wal-append.queue_time_us":1317815}
I20260709 12:10:02.846253  6171 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:02.868053  6626 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:02.887301  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:02.900688  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 890) took 1399 ms. Trace:
I20260709 12:10:02.882810  6293 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:02.902694  5018 rpcz_store.cc:276] 0709 12:10:01.501387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.692279 (+1190892us) service_pool.cc:224] Handling call
0709 12:10:02.694970 (+  2691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.695161 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:02.832609 (+137448us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.900375 (+ 67766us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:02.900424 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.900464 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.900534 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.900636 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11194,"thread_start_us":177023,"threads_started":2}
I20260709 12:10:02.882411  6411 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.907294  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:02.879523  6622 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.888324  6606 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.878051  6525 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:02.888029  6488 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:02.969726  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 130335us
W20260709 12:10:02.973613  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 174468us
W20260709 12:10:03.261010  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 374389us
I20260709 12:10:02.925485  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 889) took 1424 ms. Trace:
W20260709 12:10:03.251610  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 414837us
I20260709 12:10:02.950636  4950 raft_consensus.cc:606] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:03.266952  4950 raft_consensus.cc:614] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:03.027194  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 122455us
I20260709 12:10:03.266609  5021 rpcz_store.cc:276] 0709 12:10:01.501133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.077950 (+576817us) service_pool.cc:224] Handling call
0709 12:10:02.078246 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.083133 (+  4887us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:02.133235 (+ 50102us) log.cc:844] Serialized 14 byte log entry
0709 12:10:02.851961 (+718726us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.857253 (+  5292us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.857393 (+   140us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.857425 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.857490 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:02.925279 (+ 67789us) raft_consensus.cc:1685] finished
0709 12:10:02.925298 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:02.925430 (+   132us) inbound_call.cc:177] Queueing success response
0709 12:10:03.183107 (+257677us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b180036bce0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:03.183749 (+   642us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b180036bce0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd522 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
Metrics: {"prepare.queue_time_us":51682,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":57023,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":13907,"spinlock_wait_cycles":292551296,"thread_start_us":661025,"threads_started":2,"wal-append.queue_time_us":678237}
I20260709 12:10:02.923919  6640 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:03.275986  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:03.277408  6640 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:03.114941  6576 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 1.321s	user 0.001s	sys 0.011s
I20260709 12:10:03.279721  6640 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.279894  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 100) took 2372 ms. Trace:
I20260709 12:10:03.284351  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:03.118984  6635 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:10:03.117353  6598 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.797s	user 0.003s	sys 0.000s
W20260709 12:10:03.111938  6611 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:10:03.287963  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.259050  6428 consensus_meta.cc:287] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.000s
I20260709 12:10:03.288552  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:03.286348  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:03.185737  6566 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.905225  6479 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:03.110726  5023 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
W20260709 12:10:03.117575  6603 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.606s	user 0.000s	sys 0.002s
W20260709 12:10:03.065644  6599 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.586s	user 0.002s	sys 0.000s
I20260709 12:10:02.969769  6293 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:03.066417  6632 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.110718  6638 raft_consensus.cc:2764] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:02.905426  6631 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:03.029290  6171 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.925997  6559 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.280351  4948 rpcz_store.cc:276] 0709 12:10:00.907492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:00.909368 (+  1876us) service_pool.cc:224] Handling call
0709 12:10:00.909728 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:00.910026 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:00.910052 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:00.910463 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:10:01.583113 (+672650us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:01.583148 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:01.583205 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.114418 (+1531213us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:03.279595 (+165177us) raft_consensus.cc:1685] finished
0709 12:10:03.279615 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.279812 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71191,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":35511,"spinlock_wait_cycles":13430656,"thread_start_us":672348,"threads_started":1,"wal-append.queue_time_us":786906}
I20260709 12:10:02.915793  6634 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.066129  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:02.925683  6347 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.112982  6344 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:03.309162  4759 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica baa50eb5ed704004b7f391934a59d010 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:03.290206  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:03.039439  6647 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:03.396219  6647 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.398366  6647 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:02.951222  6623 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:03.111054  6280 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:03.063843  6628 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.064673  6614 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:03.274820  6324 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.258466  6558 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:03.186507  6591 log.cc:927] Time spent T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 1.125s	user 0.001s	sys 0.001s
I20260709 12:10:02.944974  6575 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.309782  6411 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:03.400216  6411 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.118176  6646 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.333043  6645 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.334000  6655 raft_consensus.cc:2764] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:03.335230  6639 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:03.335639  6654 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:03.337481  6488 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.329385  6116 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.340169  6525 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.343008  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 1984) took 1909 ms. Trace:
I20260709 12:10:03.280238  6640 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:03.287631  6535 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:03.350854  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 74957.3us
I20260709 12:10:03.414904  4988 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:03.410853  4869 rpcz_store.cc:276] 0709 12:10:01.434027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.434142 (+   115us) service_pool.cc:224] Handling call
0709 12:10:01.434414 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.434712 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.434736 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.435118 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.803650 (+1368532us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:02.803687 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.803749 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.342797 (+539048us) raft_consensus.cc:1685] finished
0709 12:10:03.342816 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.342951 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15273,"raft.queue_time_us":783,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":2245,"thread_start_us":1368278,"threads_started":1,"wal-append.queue_time_us":1516210}
I20260709 12:10:03.333930  6606 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.416524  6606 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.416913  6606 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.417289  6638 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:03.417822  6638 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.419834  6654 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.420637  6347 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:03.421140  6347 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:03.422143  6654 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.422888  6347 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.422653  6639 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.296625  6421 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:10:03.359196  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 410808us
I20260709 12:10:03.423439  6646 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:03.359721  6609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.000s	sys 0.005s
I20260709 12:10:03.361686  6586 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:03.363317  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 74834.3us
W20260709 12:10:03.424336  6609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.000s	sys 0.005s
I20260709 12:10:03.308393  6332 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.423975  5567 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:03.425086  6332 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:03.427066  6332 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:03.427215  6622 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.427716  6622 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:03.386234  6631 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:03.387673  6171 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.430291  6631 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.430748  6631 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.431079  6171 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.381287  6632 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.431756  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 405) took 2145 ms. Trace:
I20260709 12:10:03.432972  5603 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
W20260709 12:10:03.371749  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.399312  6623 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.382335  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:03.357733  6625 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.434247  6535 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:03.435010  6625 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.369591  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 894) took 1010 ms. Trace:
W20260709 12:10:03.393343  4759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 84219.8us
I20260709 12:10:03.400594  6411 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:03.412330  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 126045us
I20260709 12:10:03.381446  6293 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:03.354223  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:03.423254  6326 consensus_meta.cc:287] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.623s	user 0.006s	sys 0.001s
I20260709 12:10:03.388026  5016 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:03.424854  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:02.915164  6626 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.382463  6656 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.424861  6516 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.440502  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.440706  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.440474  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.400692  4946 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.450265  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:03.451220  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:03.454056  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:03.455096  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:03.455919  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:03.456974  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.457053  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:03.401463  6575 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.467152  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.979743  4951 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:03.509948  6655 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:03.967407  6293 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.981276  6655 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:03.981736  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 556937us
I20260709 12:10:03.982563  4839 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:03.848305  6666 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:03.984071  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.983932  6666 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.985229  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.986122  6666 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.985829  4942 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:03.987079  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.987787  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:03.980405  6638 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.994201  6638 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:03.506906  6571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.037s	sys 0.025s
W20260709 12:10:03.995047  6571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.524s	user 0.039s	sys 0.079s
I20260709 12:10:03.425040  6421 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:03.980129  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:03.574652  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:03.997133  4867 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:10:03.819783  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:03.511274  6326 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:03.990684  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.018744  4947 raft_consensus.cc:2410] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:03.546778  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 97252.7us
I20260709 12:10:03.444577  6171 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.433004  6632 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:03.949568  6613 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:10:03.847855  6672 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:04.037721  6672 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.038779  6421 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.994711  6638 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.039799  6672 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:04.040639  6594 log.cc:927] Time spent T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 1.530s	user 0.000s	sys 0.007s
I20260709 12:10:03.980515  6631 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:04.040772  6638 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.041222  6631 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.043104  6631 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.980677  6656 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.044932  6656 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:03.991499  6585 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 1.667s	user 0.004s	sys 0.004s
I20260709 12:10:04.050099  6626 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.983100  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.008518  6558 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:04.009114  5021 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:04.051396  6625 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:04.051764  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:03.546654  6314 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:04.052285  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.052598  6314 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.053783  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.054481  6314 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.558085  6507 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.054762  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.055250  6507 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.055840  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:04.056388  5021 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.617244  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.057204  6507 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:03.591553  6634 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:04.057832  6592 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 1.593s	user 0.000s	sys 0.003s
I20260709 12:10:04.058177  6634 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:03.680998  6668 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:10:03.764158  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.011873  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.067755  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:10:04.010046  4839 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:03.824851  6660 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.012559  6652 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:04.011829  5567 connection.cc:256] RPC call timeout handler was delayed by -1.080148200999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 12:10:04.013036  5022 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:03.576161  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:03.591435  4872 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:03.682123  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:04.014384  5025 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:03.675686  6628 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:04.015133  5020 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:03.557972  6547 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.458s
I20260709 12:10:03.674798  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:04.016052  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 579080us
I20260709 12:10:04.014771  6663 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.016793  5017 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:10:03.606601  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:03.996125  5019 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 1.
I20260709 12:10:04.021199  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.025666  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.034168  4951 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:04.034811  4988 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:03.559173  6653 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.033378  6575 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:03.444470  5023 rpcz_store.cc:276] 0709 12:10:02.347064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.457573 (+110509us) service_pool.cc:224] Handling call
0709 12:10:03.357535 (+899962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:03.572530  5600 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:04.045854  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57006 (request call id 203) took 1146 ms. Trace:
I20260709 12:10:04.033293  6171 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.046694  6326 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.187433  5019 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:04.047160  6420 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:04.047493  6655 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:03.912164  6535 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:04.047693  5603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 334) took 1141 ms (client timeout 1502 ms). Trace:
I20260709 12:10:04.045048  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.049141  6421 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.057682  6434 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:03.591706  4870 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.083927  6558 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:03.592020  6622 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.012089  6654 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:04.081332  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 71431us
I20260709 12:10:04.017928  6537 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.082053  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.078794  5021 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
W20260709 12:10:04.215883  6606 consensus_meta.cc:287] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.799s	user 0.002s	sys 0.004s
I20260709 12:10:03.443017  6640 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.074880  6672 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.039722  6238 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.031273  6646 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.112071  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.193217  6575 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.217959  4872 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:04.113035  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.218447  5020 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:10:04.218072  6640 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.154946  4951 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:04.219041  6575 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.219358  6622 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.219686  4951 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.155619  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.220872  4874 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:04.195502  6653 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.221477  6622 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.155923  4867 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:04.221689  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:04.222373  4874 raft_consensus.cc:2368] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4.
I20260709 12:10:04.222527  6653 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.215909  4868 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
W20260709 12:10:04.185568  5567 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.66:43473 timed out after 1.749s (SENT) [suppressed 19 similar messages]
I20260709 12:10:04.224130  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.224889  4868 raft_consensus.cc:2393] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:04.220577  4951 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.194943  5019 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:04.217087  6672 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.225013  6653 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.226584  6653 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.212847  6421 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.229215  6421 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.210453  6632 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.230518  6632 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.233644  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:04.195819  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 161074us
I20260709 12:10:04.156795  5604 rpcz_store.cc:276] 0709 12:10:02.899796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.899931 (+   135us) service_pool.cc:224] Handling call
0709 12:10:02.915065 (+ 15134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.293924 (+378859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.293953 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:03.293996 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:03.294023 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.045652 (+751629us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400681d54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:04.045697 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.045803 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870853376}
I20260709 12:10:04.234284  4870 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
W20260709 12:10:04.206679  6641 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 1.088s	user 0.000s	sys 0.007s
W20260709 12:10:04.204375  5603 rpcz_store.cc:269] 0709 12:10:02.906130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.907071 (+   941us) service_pool.cc:224] Handling call
0709 12:10:04.047516 (+1140445us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400580054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:04.047619 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390684032}
I20260709 12:10:04.213128  4839 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:03.432132  5597 rpcz_store.cc:276] 0709 12:10:01.286245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.289552 (+  3307us) service_pool.cc:224] Handling call
0709 12:10:01.297059 (+  7507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:01.297404 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:01.297435 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:01.297889 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.687941 (+1390052us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:02.693513 (+  5572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:02.697165 (+  3652us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.065068 (+367903us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:03.405197 (+340129us) raft_consensus.cc:1685] finished
0709 12:10:03.405227 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.431674 (+ 26447us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":813,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":98178432,"thread_start_us":1359420,"threads_started":1,"wal-append.queue_time_us":1181662}
W20260709 12:10:04.185910  6644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.005s	sys 0.013s
I20260709 12:10:04.114082  4871 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 1.
I20260709 12:10:04.158043  5017 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.223115  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:04.084055  6624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.008s	sys 0.025s
I20260709 12:10:04.220577  6634 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.216322  6606 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.124018  6628 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.101751  6660 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.222535  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.253532  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.334043  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.334717  4872 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:04.332294  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.333104  4867 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:04.336325  4951 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:04.337450  4946 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:04.343616  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.344954  4867 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:04.210367  6675 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.346839  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.334842  4874 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
W20260709 12:10:04.344333  6624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.009s	sys 0.036s
I20260709 12:10:04.400113  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:04.347333  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.345643  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.276374  6314 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:04.351374  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 331839us
I20260709 12:10:04.234709  4988 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:04.380955  4871 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 2: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:10:04.335197  6644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.009s	sys 0.015s
W20260709 12:10:04.334983  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 121950us
I20260709 12:10:04.332139  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.349767  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:04.436882  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.347158  6634 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.222987  6434 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.217157  6171 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.193861  6663 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.453420  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.400642  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.429160  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.433508  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.454294  4872 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:04.233951  5602 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:04.430548  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.431560  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.430255  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:04.457190  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.427261  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:04.457587  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.207273  6420 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.437309  4870 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:04.402370  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.428779  6660 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.233186  6632 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.438261  4947 pending_rounds.cc:85] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 1
I20260709 12:10:04.482615  4947 pending_rounds.cc:107] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:04.482873  4947 raft_consensus.cc:2889] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:04.444015  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 209347us
I20260709 12:10:04.484963  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:10:04.351837  6324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.003s	sys 0.006s
I20260709 12:10:04.447181  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.448133  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.352048  6675 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.454342  4876 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:04.448916  6238 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:04.436246  4874 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:04.494442  4874 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:04.495599  6434 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.458906  4868 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.496423  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.399508  6653 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:04.496923  6662 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:10:04.497051  5605 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:04.459771  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37900 (request call id 406) took 1011 ms. Trace:
I20260709 12:10:04.461016  6606 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:04.477945  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:04.438441  4869 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.004s	sys 0.014s
I20260709 12:10:04.381806  6661 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:04.478747  6397 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.479240  6575 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:04.481184  4872 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:04.485677  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.445370  6421 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.433651  4839 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:04.487556  4876 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:04.497920  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.499217  4873 raft_consensus.cc:2410] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:04.486491  6516 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:04.513846  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 278542us
W20260709 12:10:04.514441  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 328879us
I20260709 12:10:04.497972  5602 rpcz_store.cc:276] 0709 12:10:03.448684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.509508 (+ 60824us) service_pool.cc:224] Handling call
0709 12:10:04.459691 (+950183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:04.498085  5598 raft_consensus.cc:2393] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
W20260709 12:10:04.552227  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 118647us
I20260709 12:10:04.554301  4839 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:04.506623  4868 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
W20260709 12:10:04.496318  6679 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:10:04.487025  6324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.006s	sys 0.016s
I20260709 12:10:04.478153  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.443446  6314 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:04.504065  6643 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 1.170s	user 0.000s	sys 0.006s
I20260709 12:10:04.551312  4841 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:04.505581  4869 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.004s	sys 0.015s
I20260709 12:10:04.555644  4868 raft_consensus.cc:1240] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:04.550662  6641 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:04.562633  4839 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:04.580421  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.601810  4873 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:04.604756  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 53513.7us
I20260709 12:10:04.647815  5605 raft_consensus.cc:2410] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:04.559487  4870 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:04.649039  4873 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:04.499693  6238 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:04.652616  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.552227  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 335) took 1626 ms. Trace:
I20260709 12:10:04.561880  6688 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.598815  6644 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.492081  6675 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.542038  6507 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:04.656065  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 93500.6us
I20260709 12:10:04.541723  6397 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.549729  6655 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:10:04.655711  6238 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:04.549930  6575 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.653985  5568 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:04.680984  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:04.654692  5599 rpcz_store.cc:276] 0709 12:10:02.923459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.924608 (+  1149us) service_pool.cc:224] Handling call
0709 12:10:02.924977 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:03.283417 (+358440us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:03.284341 (+   924us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:03.299668 (+ 15327us) log.cc:844] Serialized 52 byte log entry
0709 12:10:03.380499 (+ 80831us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:03.384286 (+  3787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.388472 (+  4186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.498460 (+1109988us) raft_consensus.cc:1685] finished
0709 12:10:04.506317 (+  7857us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.550124 (+ 43807us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":190812,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":358447,"threads_started":2,"wal-append.queue_time_us":908218}
I20260709 12:10:04.541582  6661 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.703397  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:04.703780  6575 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.646860  6634 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.704763  4839 leader_election.cc:400] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4.
I20260709 12:10:04.705004  6634 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:04.705387  6558 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.705894  4839 leader_election.cc:403] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:04.705718  6326 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:04.707754  6628 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:04.683485  6685 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.709167  6685 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.553839  6516 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.710351  6314 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:04.554654  6421 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.711184  6685 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.711856  6516 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:04.712129  6421 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.657308  6171 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:04.656864  6632 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:04.690766  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 894) took 3029 ms. Trace:
I20260709 12:10:04.691705  6663 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.693255  6653 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.693866  6687 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.700105  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.701421  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:04.713559  4948 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:04.723871  5019 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:04.721487  5024 rpcz_store.cc:276] 0709 12:10:01.661627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.739076 (+1077449us) service_pool.cc:224] Handling call
0709 12:10:02.739359 (+   283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:02.739661 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.739685 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:02.790782 (+ 51097us) log.cc:844] Serialized 52 byte log entry
0709 12:10:02.863766 (+ 72984us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:02.989555 (+125789us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.108180 (+118625us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b1800109d80. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:03.284473 (+176293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.284540 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.020297 (+735757us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:04.690576 (+670279us) raft_consensus.cc:1685] finished
0709 12:10:04.690595 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.690715 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126120,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":272965,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":1920,"spinlock_wait_cycles":76079232,"thread_start_us":454927,"threads_started":3,"wal-append.queue_time_us":248256}
I20260709 12:10:04.688927  6626 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.705436  6634 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.691691  6397 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.721318  6558 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:04.688038  6672 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:04.722867  6657 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.716017  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.561630  6606 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.728991  6626 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.756408  5020 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:04.730638  6661 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:04.715631  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 61735.9us
W20260709 12:10:04.737388  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 257351us
I20260709 12:10:04.759549  6663 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:04.682097  6688 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:04.764380  4915 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:04.732518  6276 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:04.754894  6657 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:04.774230  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 223809us
W20260709 12:10:04.768714  6411 consensus_meta.cc:287] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 1.301s	user 0.008s	sys 0.002s
I20260709 12:10:04.794440  6411 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:04.795488  4875 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:04.777629  6547 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4.
I20260709 12:10:04.779316  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2003) took 1019 ms. Trace:
I20260709 12:10:04.783131  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2000) took 1166 ms. Trace:
I20260709 12:10:04.783319  4870 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:04.800143  4867 rpcz_store.cc:276] 0709 12:10:03.617083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.434439 (+817356us) service_pool.cc:224] Handling call
0709 12:10:04.434724 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.434910 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.434934 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.435311 (+   377us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.735806 (+300495us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:04.735838 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.735898 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.782928 (+ 47030us) raft_consensus.cc:1685] finished
0709 12:10:04.782947 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.783077 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":257604,"threads_started":1,"wal-append.queue_time_us":328724}
I20260709 12:10:04.802237  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.783963  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:04.785359  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 132897us
I20260709 12:10:04.786628  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.726143  6687 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.727648  6653 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:04.817306  5020 raft_consensus.cc:2410] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:04.796626  4917 leader_election.cc:336] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.795s (SENT)
I20260709 12:10:04.756458  6434 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:04.803166  5022 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:04.818490  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.819056  5022 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:10:04.803500  4871 rpcz_store.cc:276] 0709 12:10:03.759731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.454747 (+695016us) service_pool.cc:224] Handling call
0709 12:10:04.455049 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.455239 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.455263 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.455650 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.777442 (+321792us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:04.777477 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.779042 (+  1565us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.779097 (+    55us) raft_consensus.cc:1685] finished
0709 12:10:04.779114 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.779254 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":275264,"threads_started":1,"wal-append.queue_time_us":290618}
I20260709 12:10:04.820432  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.821112  5022 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:10:04.821857  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.755976  6558 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.825444  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:04.830286  4991 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:04.793673  6420 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.827754  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.798044  6657 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.826462  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:04.832665  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 70695.5us
I20260709 12:10:04.836519  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.837306  4991 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:04.839617  5021 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:04.837209  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 44567.7us
I20260709 12:10:04.842777  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.843385  4868 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:10:04.815660  6644 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:04.846637  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.847014  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.847229  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:04.852922  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:04.854393  4991 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:04.856066  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:04.858700  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 103) took 1287 ms. Trace:
I20260709 12:10:04.792641  6276 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.833218  6347 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.861874  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:04.868327  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:04.860577  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.869488  4867 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:04.829813  6701 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:04.872444  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.841048  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 1961) took 2609 ms. Trace:
I20260709 12:10:04.868129  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:04.862624  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 130361us
I20260709 12:10:04.846472  6661 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:04.874969  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:04.882666  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.853462  6493 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.831976  6516 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:10:04.825667  6434 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:04.883630  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:04.894980  4951 raft_consensus.cc:2376] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5. Re-sending same reply.
I20260709 12:10:04.888319  5021 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:04.888899  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.895640  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.895988  4867 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:04.859098  4869 rpcz_store.cc:276] 0709 12:10:03.571512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.579820 (+  8308us) service_pool.cc:224] Handling call
0709 12:10:03.580092 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:03.580269 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:04.606156 (+1025887us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.858382 (+252226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.858431 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:04.858470 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.858552 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.858647 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":646218,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":1054255,"threads_started":3,"wal-append.queue_time_us":140375}
I20260709 12:10:04.876149  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:04.865751  6651 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.872253  6622 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.872475  6507 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.900022  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.907138  4951 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:04.907823  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.908778  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.900588  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.898294  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:04.899303  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.845377  6710 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:10:04.872356  6672 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.921766  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:04.898932  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:04.872371  6347 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:04.872131  6655 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.878353  6397 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:10:04.852164  6420 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:10:04.875530  6640 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:04.909511  5020 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:10:04.882781  6661 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:04.933934  6661 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:04.934242  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.934836  6276 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:04.935286  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.936254  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:04.890021  6701 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:04.925518  4867 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.906090  6699 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.900350  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:04.930083  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.936736  5020 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 1.
I20260709 12:10:04.926048  4869 raft_consensus.cc:2410] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:04.905833  6622 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:04.954397  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:04.955032  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:04.954092  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:04.926412  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.899595  6717 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:04.911396  6507 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:04.934870  6722 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:04.957775  4951 raft_consensus.cc:2410] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:10:04.958277  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 67583us
I20260709 12:10:04.959025  5020 raft_consensus.cc:2368] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4.
I20260709 12:10:04.911123  6411 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:04.924588  6672 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:04.930194  6347 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.930294  6655 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:04.964109  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 80271.1us
I20260709 12:10:04.942296  6687 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:04.944753  6493 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:04.937438  6626 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:04.970100  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:04.971740  4840 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:04.950865  6699 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:04.939209  6238 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.064878  6653 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:05.065760  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 94084.3us
I20260709 12:10:05.065291  6688 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.066416  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:05.052567  6651 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:05.067340  4870 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:04.961572  6507 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:05.062129  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 48826.1us
I20260709 12:10:04.958484  6622 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.058091  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:05.068331  4840 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:05.075248  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:05.075413  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:05.077400  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:05.078678  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:05.067435  6651 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.080931  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:05.066933  6736 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.969686  6276 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.977129  6655 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.977903  6672 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.057597  6420 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:05.104664  6420 consensus_queue.cc:1059] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:05.107265  6732 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.107733  6732 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.108054  6732 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.108757  6737 raft_consensus.cc:3055] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.109143  6737 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:05.109828  6737 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.080370  6411 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.111335  6411 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.111730  6411 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.004092  6516 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:10:05.113104  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.098752  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.061286  6623 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.068425  6314 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:05.090643  5022 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:10:05.048535  6558 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.115830  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.113950  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.070700  6699 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.070230  6723 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.110991  6737 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:05.116670  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 218439us
I20260709 12:10:05.012291  6720 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.124411  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.125581  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:04.963177  6717 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:04.875572  4943 rpcz_store.cc:276] 0709 12:10:02.225056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.227341 (+  2285us) service_pool.cc:224] Handling call
0709 12:10:02.290923 (+ 63582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.338823 (+ 47900us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:04.058712 (+1719889us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b180035ae20. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a5a4924bc 00007f2a577e048b 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fa455 00007f2a5e2e23c7 00007f2a5a8f49a7 00007f2a5a9040bf
0709 12:10:04.058855 (+   143us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.796413 (+737558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.796469 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:04.798961 (+  2492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.822619 (+ 23658us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.834800 (+ 12181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":452819,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":208764,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":7646592,"thread_start_us":1069372,"threads_started":3,"wal-append.queue_time_us":647860}
I20260709 12:10:05.138361  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.138279  6717 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.139209  5604 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:05.139549  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.140271  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:05.139617  6717 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:05.141729  6347 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.142015  6717 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:05.143703  6347 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.144026  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 903) took 1158 ms. Trace:
I20260709 12:10:05.144590  5025 rpcz_store.cc:276] 0709 12:10:03.985390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.118798 (+133408us) service_pool.cc:224] Handling call
0709 12:10:04.119023 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.222715 (+103692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.222747 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.222784 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:04.222814 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.143790 (+920976us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003cda54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:05.143836 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.143967 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238058880}
I20260709 12:10:05.145466  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:05.146850  5019 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:05.148912  5017 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.113731  6276 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.118870  6723 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.155227  6639 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.155359  6276 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:05.113454  6708 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:05.156919  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.157351  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.157783  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.158851  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:05.159809  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.160351  4945 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:05.089389  6736 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:05.163793  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.164853  4950 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
W20260709 12:10:05.161017  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 82401.6us
I20260709 12:10:05.155146  6723 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.162086  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.173791  4945 raft_consensus.cc:2410] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:05.149034  6558 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.189055  6558 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.189464  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:05.190728  6719 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:10:05.191242  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 870) took 1225 ms. Trace:
W20260709 12:10:05.192327  6724 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:10:05.191586  4874 rpcz_store.cc:276] 0709 12:10:03.966007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.495140 (+529133us) service_pool.cc:224] Handling call
0709 12:10:04.495396 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.495700 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.495726 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.496172 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.772990 (+276818us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:04.799616 (+ 26626us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.799787 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.799871 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.191062 (+391191us) raft_consensus.cc:1685] finished
0709 12:10:05.191080 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.191192 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2078,"prepare.queue_time_us":25869,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":3902,"raft.queue_time_us":35166,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":34683,"spinlock_wait_cycles":34299136,"thread_start_us":276496,"threads_started":1,"wal-append.queue_time_us":620797}
I20260709 12:10:05.142213  6675 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.146005  6547 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.204100  6657 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.206351  5602 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:05.214984  6661 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:05.216962  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.229188  4874 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.229662  6675 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.230600  4874 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:05.231644  6661 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.189395  6558 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.150167  6720 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:05.123594  6314 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.175280  6736 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.244045  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 871) took 1274 ms. Trace:
I20260709 12:10:05.144013  6717 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.040246  6701 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.240584  6720 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.201169  6547 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:05.244408  4876 rpcz_store.cc:276] 0709 12:10:03.970153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.552724 (+582571us) service_pool.cc:224] Handling call
0709 12:10:04.553025 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.581223 (+ 28198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.581250 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.602885 (+ 21635us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.850036 (+247151us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:04.870940 (+ 20904us) log.cc:844] Serialized 14 byte log entry
0709 12:10:04.893845 (+ 22905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.893929 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.243807 (+349878us) raft_consensus.cc:1685] finished
0709 12:10:05.243840 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.243985 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9930,"prepare.queue_time_us":22450,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":97899,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":29010,"thread_start_us":189939,"threads_started":2,"wal-append.queue_time_us":394438}
I20260709 12:10:05.271718  6397 consensus_queue.cc:1243] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:05.278111  6732 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.280205  6732 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.272763  6547 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.328722  6723 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.333475  6723 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.336166  4943 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:05.339996  6238 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.342344  4949 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:05.344015  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 110) took 2013 ms. Trace:
I20260709 12:10:05.345723  6651 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:05.348112  6634 consensus_meta.cc:287] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.003s
I20260709 12:10:05.349671  6622 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.364106  4874 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:05.364794  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:05.340543  4946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 108) took 3135 ms (client timeout 1749 ms). Trace:
I20260709 12:10:05.373567  5568 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:05.344328  4949 rpcz_store.cc:276] 0709 12:10:03.330179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.348589 (+ 18410us) service_pool.cc:224] Handling call
0709 12:10:05.342000 (+1993411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.342695 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.343808 (+  1113us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400256050. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:05.343958 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4583748480}
I20260709 12:10:05.375283  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.375840  4949 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:05.405414  5022 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:05.365867  4946 rpcz_store.cc:269] 0709 12:10:02.204852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.224422 (+ 19570us) service_pool.cc:224] Handling call
0709 12:10:05.340313 (+3115891us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400256054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:05.340452 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443356928}
I20260709 12:10:05.348505  6634 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.407327  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.408633  6657 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.409984  4839 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:05.344300  6699 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.364496  6651 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.422884  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:05.423383  4944 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.365916  6622 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:05.429572  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 56087.5us
W20260709 12:10:05.449668  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 84105.4us
I20260709 12:10:05.451200  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:05.452076  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.452641  4871 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:10:05.453393  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.453887  4871 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:05.454581  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.457650  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:05.462886  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:05.464064  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.465065  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.461804  5568 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:05.469368  4839 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:05.470381  4839 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:05.470417  4944 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:05.472976  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.473029  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.472075  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:05.473816  4871 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:05.474675  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.474985  4949 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.476718  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.476919  4944 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:05.478045  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 904) took 2019 ms. Trace:
I20260709 12:10:05.477957  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.479169  4949 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:05.478425  5018 rpcz_store.cc:276] 0709 12:10:03.458389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.827631 (+369242us) service_pool.cc:224] Handling call
0709 12:10:03.844415 (+ 16784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.400299 (+555884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.400328 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.428341 (+ 28013us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.757203 (+328862us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:04.757237 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.477673 (+720436us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54001635d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:05.477730 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.477778 (+    48us) raft_consensus.cc:1685] finished
0709 12:10:05.477792 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.477990 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276949248,"thread_start_us":328493,"threads_started":1,"wal-append.queue_time_us":358188}
I20260709 12:10:05.405427  6411 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.465948  6625 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:10:05.484191  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.483129  4874 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:05.482298  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.487351  4949 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:05.472620  6657 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.481767  6632 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.491204  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:05.473820  6171 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.485186  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:05.473954  6575 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.489307  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.493376  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:05.479888  6397 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.494287  4944 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:05.494374  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.537034  5604 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:05.537839  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.475464  6651 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:05.538527  6651 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:05.538911  6651 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:05.486502  6737 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:05.539064  6639 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:05.539623  6639 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.489957  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:05.541565  4949 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.497026  6632 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.523170  4839 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:05.546134  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:05.556916  6732 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.557387  6732 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:05.558144  6732 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.499178  6740 consensus_queue.cc:1059] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:10:05.558051  6639 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.554265  6411 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.561867  6740 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:05.552734  6507 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.562917  6634 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.564325  6507 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.565537  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.566105  5606 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:05.566860  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:05.567880  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:05.567986  6720 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.573191  4949 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:05.509789  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.486052  6735 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:10:05.484241  6420 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.488070  6729 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:05.466285  6736 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.547341  6632 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.495463  6606 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.532063  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.531399  6748 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:05.500926  6314 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.503561  6397 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:05.531948  6725 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 12:10:05.585911  4869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.019s	sys 0.023s
I20260709 12:10:05.533712  6657 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.535460  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.553782  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:05.490537  6516 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:10:05.499661  6739 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.509151  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:05.561579  6688 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:05.499272  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.578320  6736 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.574030  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:05.539216  6547 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.604882  6660 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.605343  6660 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.576932  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:05.578627  4876 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.577899  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:05.572582  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:05.580008  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.607092  6660 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.607324  5606 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:05.579440  5567 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:05.607591  6314 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.581086  4947 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:05.608021  6314 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.608402  6314 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.608999  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.609203  4944 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:05.610008  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.610759  6632 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.611857  5604 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:05.612022  6623 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.610965  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:05.613224  6632 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.577360  4839 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:05.547036  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.614670  5599 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:05.614812  6314 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.544852  6575 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:05.617826  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:05.562247  6740 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:05.577081  6634 consensus_queue.cc:1059] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:10:05.618633  6660 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.619046  6660 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:05.587667  6397 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.603770  5603 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:05.620410  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.620661  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:05.576709  6420 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:05.619364  6634 raft_consensus.cc:3055] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.541811  6655 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.568596  6651 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:05.586841  4869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.019s	sys 0.023s
I20260709 12:10:05.641050  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 889) took 1185 ms. Trace:
W20260709 12:10:05.623421  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 46568.5us
I20260709 12:10:05.644225  4916 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:05.645527  4916 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:05.630759  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:05.634177  5025 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.585800  6743 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.631397  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 895) took 3969 ms. Trace:
W20260709 12:10:05.630728  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 53438.5us
I20260709 12:10:05.632411  6699 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.631920  6745 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.625168  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:05.631266  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 932368us
I20260709 12:10:05.633457  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:05.649752  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.650611  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:05.603461  6688 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:05.585209  6558 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.578930  6672 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.619390  6660 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.648442  4839 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:05.650506  5021 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.625177  6740 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.619473  6314 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.652056  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:05.685312  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:05.621250  6653 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.686810  6653 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:05.687202  6653 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.690814  6647 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.691184  6647 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:05.691533  6647 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.641379  4869 rpcz_store.cc:276] 0709 12:10:04.455324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.954820 (+499496us) service_pool.cc:224] Handling call
0709 12:10:04.955056 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.969496 (+ 14440us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:05.028651 (+ 59155us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.339323 (+310672us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b4800300858. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5f813aa1 00007f2a5f80ab37 00007f2a5f80a9ca 00007f2a5f90226f 00007f2a5f901f37 00007f2a5f91655c 00007f2a5f916508 00007f2a5f916488 00007f2a5f916443 00007f2a5f9156ec 00007f2a5e83fa96
0709 12:10:05.640748 (+301425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.640794 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.640850 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.640908 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.641000 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89673,"prepare.queue_time_us":58137,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":57187,"raft.run_cpu_time_us":2096,"raft.run_wall_time_us":325141,"spinlock_wait_cycles":2891136,"thread_start_us":611744,"threads_started":1}
I20260709 12:10:05.583050  6729 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.674392  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:05.718287  5018 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.639766  6737 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.638501  6634 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:05.652570  6428 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:05.658068  6414 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.676039  6507 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.623301  6420 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.716552  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.647147  6276 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.719532  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.648164  6743 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:05.799588  6743 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.800552  6743 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.716454  6314 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.649432  6745 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:05.804311  6634 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.805719  6634 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.807740  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:05.808324  4951 raft_consensus.cc:2376] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4. Re-sending same reply.
I20260709 12:10:05.808921  6729 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.809208  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:05.811220  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 333) took 2924 ms (client timeout 1647 ms). Trace:
W20260709 12:10:05.811614  5600 rpcz_store.cc:269] 0709 12:10:02.887555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.889149 (+  1594us) service_pool.cc:224] Handling call
0709 12:10:05.811027 (+2921878us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002a6054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:05.811144 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351344896}
I20260709 12:10:05.719524  6737 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.678303  6699 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:05.781785  4871 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:05.698906  6748 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.652463  6632 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:10:05.758750  6428 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.657361  6639 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:10:05.762836  6414 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:05.802932  6314 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.804368  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 888) took 1357 ms. Trace:
I20260709 12:10:05.804883  6745 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.619942  6657 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.813301  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.841595  4869 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:05.683868  5021 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:05.813616  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:05.817495  5019 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.817838  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:05.843235  4874 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:05.769915  6507 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:05.780838  6740 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.829051  5601 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:05.849980  5018 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:05.830201  6314 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.830461  6434 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.648119  5016 rpcz_store.cc:276] 0709 12:10:01.661888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.783306 (+1121418us) service_pool.cc:224] Handling call
0709 12:10:03.356971 (+573665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.509740 (+152769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.631188 (+2121448us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b540011f650. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:05.631318 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274244992}
I20260709 12:10:05.826562  4867 rpcz_store.cc:276] 0709 12:10:04.446745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.945625 (+498880us) service_pool.cc:224] Handling call
0709 12:10:04.949989 (+  4364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.964338 (+ 14349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.964390 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.964880 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:10:05.200934 (+236054us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.227305 (+ 26371us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.240528 (+ 13223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.240603 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.563516 (+322913us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b18003f0040. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd522 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:05.802901 (+239385us) raft_consensus.cc:1685] finished
0709 12:10:05.804191 (+  1290us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.804316 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25781,"prepare.queue_time_us":26346,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1157,"raft.queue_time_us":66417,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":40114,"spinlock_wait_cycles":3880320,"thread_start_us":188638,"threads_started":1,"wal-append.queue_time_us":701386}
I20260709 12:10:05.838107  6547 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.843135  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 910) took 1144 ms. Trace:
I20260709 12:10:05.856101  5024 rpcz_store.cc:276] 0709 12:10:04.698385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.725283 (+ 26898us) service_pool.cc:224] Handling call
0709 12:10:05.813479 (+1088196us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:10:05.843078 (+ 29599us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085568}
I20260709 12:10:05.856655  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:05.843554  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:05.820271  6737 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.862349  5024 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.826519  6748 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:05.827363  6428 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:05.827584  6414 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.858994  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 909) took 1070 ms. Trace:
I20260709 12:10:05.851831  6507 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.851480  6525 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:05.855773  6729 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:10:05.866281  4875 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 1990) took 2284 ms (client timeout 2343 ms). Trace:
I20260709 12:10:05.854511  6720 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.853583  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:05.840015  6632 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.869506  5017 rpcz_store.cc:276] 0709 12:10:04.797707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.085913 (+288206us) service_pool.cc:224] Handling call
0709 12:10:05.086145 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.156215 (+ 70070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.858798 (+702583us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54001621d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:05.858943 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143906560}
I20260709 12:10:05.859642  4872 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:05.879802  6632 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:05.872244  6655 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.880642  6632 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.881788  6632 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.864897  6647 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.886312  6647 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:05.876030  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:05.803481  6688 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.888670  6688 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:05.877138  4875 rpcz_store.cc:269] 0709 12:10:03.573741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.576416 (+  2675us) service_pool.cc:224] Handling call
0709 12:10:05.858343 (+2281927us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54002fbf54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:05.858494 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697896320}
I20260709 12:10:05.832067  6723 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.801894  6653 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:05.879424  5018 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:10:05.875139  6750 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:05.906648  4875 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.889261  6558 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:05.889258  6672 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:05.933094  4945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.032s	sys 0.032s
I20260709 12:10:05.890101  6525 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.922768  6728 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:05.890218  6729 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:05.898154  6723 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:05.950040  5022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.014s	sys 0.007s
W20260709 12:10:05.950488  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:05.936725  6651 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:05.959254  5022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 926) took 1061 ms. Trace:
W20260709 12:10:05.960764  4946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.016s
W20260709 12:10:05.962350  4946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.007s	sys 0.016s
I20260709 12:10:05.941756  6728 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:05.960026  5022 rpcz_store.cc:276] 0709 12:10:04.897880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.417570 (+519690us) service_pool.cc:224] Handling call
0709 12:10:05.417813 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.418002 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:05.422673 (+  4671us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.958970 (+536297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.959022 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.959056 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.959108 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.959206 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5404,"prepare.queue_time_us":29774,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":6267,"thread_start_us":530582,"threads_started":1}
W20260709 12:10:05.943791  6701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.014s	sys 0.025s
W20260709 12:10:05.961076  4988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.015s	sys 0.012s
W20260709 12:10:05.968478  4988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.015s	sys 0.012s
W20260709 12:10:05.968858  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 1.04468e+06us
W20260709 12:10:06.071218  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 101756us
I20260709 12:10:06.072155  4988 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:06.073283  4988 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:10:05.970357  6701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.014s	sys 0.025s
I20260709 12:10:05.942229  6748 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.097023  6397 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:06.069401  6293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.988s	user 0.045s	sys 0.070s
I20260709 12:10:05.991864  6720 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:06.108180  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 909) took 1410 ms. Trace:
I20260709 12:10:06.119880  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 904) took 1426 ms. Trace:
I20260709 12:10:06.120256  4876 rpcz_store.cc:276] 0709 12:10:04.693796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.267369 (+573573us) service_pool.cc:224] Handling call
0709 12:10:05.267645 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.606621 (+338976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.119670 (+513049us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54003e44d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:06.119825 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714826624}
W20260709 12:10:06.114569  4948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 1980) took 1683 ms (client timeout 1870 ms). Trace:
W20260709 12:10:06.121322  4948 rpcz_store.cc:269] 0709 12:10:04.431487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.432616 (+  1129us) service_pool.cc:224] Handling call
0709 12:10:06.114401 (+1681785us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002756d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:06.114514 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523083520}
I20260709 12:10:06.122359  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.115089  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 875) took 2085 ms. Trace:
I20260709 12:10:06.123413  4872 rpcz_store.cc:276] 0709 12:10:04.029356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.579211 (+549855us) service_pool.cc:224] Handling call
0709 12:10:05.859486 (+1280275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.880133 (+ 20647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.114880 (+234747us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002fbf50. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:06.115032 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2776636672}
I20260709 12:10:06.115347  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 913) took 1316 ms. Trace:
I20260709 12:10:06.124444  5025 rpcz_store.cc:276] 0709 12:10:04.798690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.145626 (+346936us) service_pool.cc:224] Handling call
0709 12:10:05.633982 (+488356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.647787 (+ 13805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.115173 (+467386us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400162bd0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:06.115295 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122535808}
W20260709 12:10:06.125679  4949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.040s
W20260709 12:10:06.126019  4949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.000s	sys 0.040s
I20260709 12:10:06.126482  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 883) took 1976 ms. Trace:
I20260709 12:10:06.108560  6638 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:06.130674  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 444206us
I20260709 12:10:06.108701  6672 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:06.133175  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.108844  6314 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:06.112960  6293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.129s	user 0.046s	sys 0.071s
I20260709 12:10:06.136085  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:06.126842  4873 rpcz_store.cc:276] 0709 12:10:04.150955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.649931 (+498976us) service_pool.cc:224] Handling call
0709 12:10:04.650205 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.766394 (+116189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.766424 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.766832 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.891778 (+124946us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:04.892087 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 12:10:05.172766 (+280679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.189564 (+ 16798us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b18003eba20. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd522 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:06.126198 (+936634us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54003e30d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:06.126259 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.126299 (+    40us) raft_consensus.cc:1685] finished
0709 12:10:06.126312 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.126428 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102397,"prepare.queue_time_us":185,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":80305,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":44399,"spinlock_wait_cycles":285141632,"thread_start_us":285625,"threads_started":2,"wal-append.queue_time_us":201340,"wal-append.run_cpu_time_us":1764,"wal-append.run_wall_time_us":1057731}
I20260709 12:10:06.143946  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.144646  4948 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:06.136751  6238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.019s	sys 0.026s
I20260709 12:10:06.105712  6428 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:06.147574  5603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.018s	sys 0.008s
W20260709 12:10:06.153533  5603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.018s	sys 0.008s
I20260709 12:10:06.154297  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:06.141776  6632 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:06.147925  6238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.020s	sys 0.026s
I20260709 12:10:06.146749  6653 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:06.150122  5602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 340) took 1289 ms (client timeout 1502 ms). Trace:
I20260709 12:10:06.128693  6720 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.111366  6728 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.155025  6657 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:06.146562  6314 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.163786  6632 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:06.153798  4842 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.007s	sys 0.066s
W20260709 12:10:06.207075  4842 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.007s	sys 0.066s
W20260709 12:10:06.165037  5602 rpcz_store.cc:269] 0709 12:10:04.860556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.872247 (+ 11691us) service_pool.cc:224] Handling call
0709 12:10:06.138808 (+1266561us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400580054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:06.147644 (+  8836us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577611136}
I20260709 12:10:06.210691  4948 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:06.212517  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.215102  4948 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
W20260709 12:10:06.219899  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.220362  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:06.209080  4870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.021s	sys 0.013s
W20260709 12:10:06.225565  4870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.021s	sys 0.013s
I20260709 12:10:06.191115  5600 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.190001  6729 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:06.236369  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 927) took 1336 ms. Trace:
I20260709 12:10:06.208132  6723 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:06.211931  6632 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.224488  6728 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.213286  6525 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:06.267117  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 193894us
I20260709 12:10:06.237215  6558 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:06.269693  4988 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:06.238456  5020 rpcz_store.cc:276] 0709 12:10:04.900528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.423921 (+523393us) service_pool.cc:224] Handling call
0709 12:10:05.463317 (+ 39396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.463505 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:05.925628 (+462123us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.236077 (+310449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.236122 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:06.236159 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.236217 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.236320 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20560,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":1620,"thread_start_us":772001,"threads_started":2}
I20260709 12:10:06.263649  6414 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.276465  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:06.279999  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.286769  4876 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:06.287635  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.280539  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.270001  6558 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.283996  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:06.293514  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.279796  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:06.277030  6738 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:06.300642  6238 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.306361  6238 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:06.306742  6238 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.305753  5025 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:06.309048  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.310084  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.311003  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.311903  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.119128  5023 rpcz_store.cc:276] 0709 12:10:04.698146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.701861 (+  3715us) service_pool.cc:224] Handling call
0709 12:10:04.731278 (+ 29417us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:04.925195 (+193917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.931223 (+  6028us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:05.053757 (+122534us) log.cc:844] Serialized 608 byte log entry
0709 12:10:05.265836 (+212079us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.265875 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.834708 (+568833us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54001630d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:05.834768 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.993464 (+158696us) raft_consensus.cc:1685] finished
0709 12:10:06.069612 (+ 76148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.108106 (+ 38494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7070,"raft.queue_time_us":5813,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":15311,"spinlock_wait_cycles":245442816,"thread_start_us":199291,"threads_started":1,"wal-append.queue_time_us":595488}
I20260709 12:10:06.289072  6397 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.312776  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.318948  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.319380  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.322927  4871 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.322966  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.321448  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.285490  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:06.313347  6756 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:10:06.316085  6655 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.328166  6655 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:06.318441  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:06.328553  6655 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.329666  6738 raft_consensus.cc:3055] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:06.330022  6738 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:06.331110  6720 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.317432  6314 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.333189  6558 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:06.320029  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.326577  4873 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:06.323851  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:06.325217  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.336088  4874 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.336931  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.337468  5025 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.336088  4991 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:06.319698  4988 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:06.341209  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:06.312680  6660 consensus_meta.cc:287] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.002s
I20260709 12:10:06.341995  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:06.341952  4988 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:06.347707  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.347936  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:06.343940  4871 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:06.344731  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.344657  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.348737  5604 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:06.349632  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.350036  4915 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:06.351296  4991 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:06.352063  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:06.323331  6525 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.348277  5022 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:06.342775  6314 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.277263  6755 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:06.344965  6672 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.345183  6653 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.346629  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.346650  6638 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.353258  6397 raft_consensus.cc:2764] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:06.359566  6625 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.326778  6238 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.359751  6314 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:06.379218  6525 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:06.385421  6743 consensus_meta.cc:287] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.584s	user 0.006s	sys 0.002s
I20260709 12:10:06.347669  6737 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.353333  6660 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.383494  6776 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.385236  6672 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:06.357100  6516 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:10:06.377521  6434 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:10:06.394857  6507 consensus_meta.cc:287] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.516s	user 0.033s	sys 0.025s
I20260709 12:10:06.334142  6738 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:06.397822  6763 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:10:06.403167  6672 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.416453  6738 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.397064  6755 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:06.443270  6758 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.254s	user 0.003s	sys 0.000s
W20260709 12:10:06.445760  6766 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
W20260709 12:10:06.445919  6762 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:10:06.439905  6737 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:06.447520  6745 consensus_meta.cc:287] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 12:10:06.447919  6745 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.449958  6776 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.449874  6745 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:06.450301  6740 consensus_meta.cc:287] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.011s
I20260709 12:10:06.479877  4840 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:06.482270  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:06.486033  4868 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:06.486393  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:06.487340  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 129358us
I20260709 12:10:06.488101  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 891) took 1972 ms. Trace:
I20260709 12:10:06.489462  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:06.489732  4946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 984) took 1568 ms. Trace:
I20260709 12:10:06.490978  5023 raft_consensus.cc:2368] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:06.490111  4946 rpcz_store.cc:276] 0709 12:10:04.921468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.418528 (+497060us) service_pool.cc:224] Handling call
0709 12:10:05.419050 (+   522us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:05.420486 (+  1436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.420512 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:05.422226 (+  1714us) log.cc:844] Serialized 608 byte log entry
0709 12:10:05.962866 (+540640us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.962906 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.962986 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.489128 (+526142us) raft_consensus.cc:1685] finished
0709 12:10:06.489174 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.489506 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2902,"raft.queue_time_us":4887,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":17505,"thread_start_us":540305,"threads_started":1,"wal-append.queue_time_us":912344}
I20260709 12:10:06.395025  5025 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:06.491328  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:06.523398  6746 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:06.526250  6745 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.526904  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 1993) took 1363 ms. Trace:
I20260709 12:10:06.527330  4949 rpcz_store.cc:276] 0709 12:10:05.162971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.611034 (+448063us) service_pool.cc:224] Handling call
0709 12:10:05.611290 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:05.611482 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.611504 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:05.612474 (+   970us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.126384 (+513910us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:06.126425 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.126497 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.445110 (+318613us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:06.492393 (+ 47283us) raft_consensus.cc:1685] finished
0709 12:10:06.492436 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.526700 (+ 34264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4316416,"thread_start_us":513565,"threads_started":1,"wal-append.queue_time_us":659587}
I20260709 12:10:06.528535  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.526526  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:06.529503  6736 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:06.530279  6736 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:06.528179  6729 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:06.530192  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.399117  6314 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.538611  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:06.409556  6420 consensus_meta.cc:287] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.596s	user 0.006s	sys 0.003s
I20260709 12:10:06.544843  6622 raft_consensus.cc:2764] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:10:06.545574  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:06.545882  6634 consensus_meta.cc:287] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.001s
I20260709 12:10:06.546693  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 1997) took 1137 ms. Trace:
I20260709 12:10:06.547127  4950 rpcz_store.cc:276] 0709 12:10:05.408945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.357997 (+949052us) service_pool.cc:224] Handling call
0709 12:10:06.546556 (+188559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:06.548390  6420 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.550138  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.550385  6660 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.550896  4871 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:06.551508  6420 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:06.551939  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.553395  4876 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:06.413086  6507 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.556231  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:06.538908  6746 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:06.557238  4951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 1999) took 1147 ms. Trace:
I20260709 12:10:06.558507  6746 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.553413  6414 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:06.561321  5020 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.561764  5603 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.488623  4870 rpcz_store.cc:276] 0709 12:10:04.515534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.068168 (+552634us) service_pool.cc:224] Handling call
0709 12:10:05.084367 (+ 16199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:05.173922 (+ 89555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.173951 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:05.363703 (+189752us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.235757 (+872054us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:06.264787 (+ 29030us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.265027 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.265092 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.437802 (+172710us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18000fc700. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:06.487319 (+ 49517us) raft_consensus.cc:1685] finished
0709 12:10:06.487483 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.487823 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6838,"prepare.queue_time_us":30727,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":62147,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":170,"spinlock_wait_cycles":3945088,"thread_start_us":944265,"threads_started":2,"wal-append.queue_time_us":1047500}
I20260709 12:10:06.563983  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:06.564960  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 76247.8us
I20260709 12:10:06.566525  4870 raft_consensus.cc:2410] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:06.574015  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:06.575860  4840 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:06.552744  4871 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.587213  6660 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:06.587752  6314 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.588069  6660 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.590029  6314 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:06.590276  6660 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.592347  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:06.593442  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:06.594295  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2022) took 1138 ms. Trace:
I20260709 12:10:06.594682  4867 rpcz_store.cc:276] 0709 12:10:05.455583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.853806 (+398223us) service_pool.cc:224] Handling call
0709 12:10:05.858453 (+  4647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.958904 (+100451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.958932 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.958969 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.958998 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.593913 (+634915us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54002fc454. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:06.593977 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.594139 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230567680}
I20260709 12:10:06.596177  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.557723  4951 rpcz_store.cc:276] 0709 12:10:05.409495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.810029 (+400534us) service_pool.cc:224] Handling call
0709 12:10:05.810311 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:05.814718 (+  4407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.814782 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:05.818702 (+  3920us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.213646 (+394944us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:06.213686 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.213753 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.539185 (+325432us) raft_consensus.cc:1685] finished
0709 12:10:06.541995 (+  2810us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.557057 (+ 15062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14474,"raft.queue_time_us":5742,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":5455,"thread_start_us":394540,"threads_started":1,"wal-append.queue_time_us":561614}
I20260709 12:10:06.595090  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:06.603075  4947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 1992) took 1454 ms (client timeout 1549 ms). Trace:
I20260709 12:10:06.603268  6736 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:06.603516  4947 rpcz_store.cc:269] 0709 12:10:05.148939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.149527 (+   588us) service_pool.cc:224] Handling call
0709 12:10:06.602601 (+1453074us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b540007ab54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:06.602883 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973780736}
I20260709 12:10:06.604740  6293 consensus_queue.cc:1059] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:06.605448  4942 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.605996  6634 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:06.607191  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 976) took 1742 ms. Trace:
I20260709 12:10:06.613157  4942 rpcz_store.cc:276] 0709 12:10:04.864687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.632337 (+767650us) service_pool.cc:224] Handling call
0709 12:10:06.604955 (+972618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.605960 (+  1005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.606987 (+  1027us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b540007ab50. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:06.607121 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236003072}
I20260709 12:10:06.615684  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:06.616390  5605 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.617556  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52376 (request call id 972) took 1753 ms. Trace:
I20260709 12:10:06.617956  4943 rpcz_store.cc:276] 0709 12:10:04.863769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.139297 (+275528us) service_pool.cc:224] Handling call
0709 12:10:06.617206 (+1477909us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400376c54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:06.617410 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450686336}
I20260709 12:10:06.621045  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:06.622864  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:06.625051  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:06.626062  4867 raft_consensus.cc:2376] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4. Re-sending same reply.
I20260709 12:10:06.627303  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.621800  5597 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.629657  6575 consensus_queue.cc:1059] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:06.631352  6575 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:06.631709  6575 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:06.634056  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.634214  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.611806  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2007) took 1159 ms. Trace:
W20260709 12:10:06.614218  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.646890  5603 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:06.626020  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 916) took 1778 ms. Trace:
I20260709 12:10:06.649200  4871 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:06.638847  4868 rpcz_store.cc:276] 0709 12:10:05.452006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.839103 (+387097us) service_pool.cc:224] Handling call
0709 12:10:05.839359 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.486816 (+647457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.611556 (+124740us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54003e2bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:06.611754 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485752704}
I20260709 12:10:06.667232  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2020) took 1212 ms. Trace:
I20260709 12:10:06.649616  5019 rpcz_store.cc:276] 0709 12:10:04.847615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.147530 (+299915us) service_pool.cc:224] Handling call
0709 12:10:05.147770 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.845334 (+697564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.625437 (+780103us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400065754. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:06.625763 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322708352}
I20260709 12:10:06.608834  6729 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:06.608592  5599 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:06.675550  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2025) took 1219 ms. Trace:
I20260709 12:10:06.676062  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 346) took 1177 ms. Trace:
I20260709 12:10:06.676942  5606 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.678722  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.679327  6558 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:06.679561  6739 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.605731  6723 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.667657  4869 rpcz_store.cc:276] 0709 12:10:05.455099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.845219 (+390120us) service_pool.cc:224] Handling call
0709 12:10:05.845456 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.845646 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:05.863297 (+ 17651us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.612277 (+748980us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b1800346f00. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a23a 00007f2a5a8f4a2a
0709 12:10:06.666494 (+ 54217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.666580 (+    86us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:06.666733 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.666838 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.667018 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17499,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":109,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":256,"spinlock_wait_cycles":7821568,"thread_start_us":53804,"threads_started":1,"wal-append.queue_time_us":803082}
I20260709 12:10:06.684731  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.686470  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.632732  6575 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.680301  4875 rpcz_store.cc:276] 0709 12:10:05.456223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.907370 (+451147us) service_pool.cc:224] Handling call
0709 12:10:05.927066 (+ 19696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.927230 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:05.927443 (+   213us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.592222 (+664779us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b1800382180. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a23a 00007f2a5a8f4a2a
0709 12:10:06.674934 (+ 82712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.675029 (+    95us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:06.675129 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.675221 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.675391 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2496,"raft.queue_time_us":2182,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"spinlock_wait_cycles":11532672,"thread_start_us":78730,"threads_started":1}
W20260709 12:10:06.705113  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 352955us
I20260709 12:10:06.693925  6729 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.706565  6640 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:06.707340  6729 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:06.707926  6238 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.681216  5598 rpcz_store.cc:276] 0709 12:10:05.498892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.503201 (+  4309us) service_pool.cc:224] Handling call
0709 12:10:05.836394 (+333193us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800157898. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:10:05.836610 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.224584 (+387974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.228707 (+  4123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.229757 (+  1050us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:06.237523 (+  7766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.675596 (+438073us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b540044aa54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:06.675657 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.675862 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":981,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":83,"spinlock_wait_cycles":95596160,"thread_start_us":335696,"threads_started":1}
I20260709 12:10:06.712879  6632 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:06.718954  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.707005  6739 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.720156  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.721141  4869 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:06.722009  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.722357  6293 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:06.723052  6293 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.724162  6739 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:06.714972  4839 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:06.726763  6655 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.727947  6786 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.727453  4770 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:06.728497  6786 raft_consensus.cc:697] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:06.729244  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.729550  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.729786  6786 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.707113  6644 raft_consensus.cc:3055] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.730798  6644 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:06.733692  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57006 (request call id 210) took 3042 ms. Trace:
I20260709 12:10:06.706642  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:10:06.715787  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 140202us
I20260709 12:10:06.697990  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.717414  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.730468  4867 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:06.718426  4870 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:10:06.719681  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.713263  6672 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.712539  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.717950  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.723131  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.737708  4874 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:06.738718  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:06.739045  6672 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:06.739423  4874 raft_consensus.cc:606] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:10:06.739835  4874 raft_consensus.cc:614] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:06.740139  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.718894  6575 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.741348  5605 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
W20260709 12:10:06.743520  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:06.732002  6644 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.745507  6632 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:06.739912  4949 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.753814  4868 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:06.754415  6623 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.772102  6740 consensus_queue.cc:1059] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:06.772027  6623 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:06.772505  6434 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:06.760025  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.748705  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.760658  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.734186  5601 rpcz_store.cc:276] 0709 12:10:03.691110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.849172 (+158062us) service_pool.cc:224] Handling call
0709 12:10:05.816145 (+1966973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.851960 (+ 35815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.733221 (+881261us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54002a6050. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:06.733489 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4517551360}
I20260709 12:10:06.767292  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.778749  5023 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:06.779635  5597 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
W20260709 12:10:06.767499  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 60990.9us
I20260709 12:10:06.768054  6622 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.781994  6434 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:06.782451  6434 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:06.783576  6434 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:06.768771  5020 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:06.769408  4876 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:06.771489  4868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:06.785822  4868 raft_consensus.cc:606] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:10:06.777086  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:06.768978  6293 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:06.781910  6622 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:06.789799  6622 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.790150  4875 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:06.789152  4876 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: [3.5-4.6]
I20260709 12:10:06.777154  4867 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:06.777719  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.792876  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.793540  4871 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:06.777874  6737 raft_consensus.cc:3055] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:06.707953  6640 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:06.797271  4949 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:06.785969  6434 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.814514  4872 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.815201  4870 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:06.816362  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.817184  5020 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:06.817097  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.818104  5025 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:06.795794  6640 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:06.819068  4869 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:06.794652  6737 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:06.820247  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 124) took 1181 ms. Trace:
I20260709 12:10:06.825070  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.826217  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.827011  4942 raft_consensus.cc:2410] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:06.827740  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.827287  6787 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:06.830476  6507 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.828743  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.820598  6640 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.839824  6644 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.840183  6640 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.847815  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.848671  5016 raft_consensus.cc:2393] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:06.848910  6723 consensus_queue.cc:1059] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:06.849949  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.840368  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:06.821980  4948 rpcz_store.cc:276] 0709 12:10:05.555077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.321820 (+766743us) service_pool.cc:224] Handling call
0709 12:10:06.344920 (+ 23100us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.345235 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.345262 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.345659 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.685583 (+339924us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:06.685667 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.685760 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.735817 (+ 50057us) raft_consensus.cc:1685] finished
0709 12:10:06.735834 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.735938 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":647,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":11303,"thread_start_us":110196,"threads_started":1,"wal-append.queue_time_us":313508}
I20260709 12:10:06.850050  6723 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.848374  6623 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.862674  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.865572  4872 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
W20260709 12:10:06.861845  4917 leader_election.cc:336] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.518s (SENT)
I20260709 12:10:06.859751  6723 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:06.871662  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 91913.2us
I20260709 12:10:06.873159  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.869921  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.883390  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.885414  4942 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:06.880234  6314 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.899658  6737 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.899931  6314 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:06.900979  6737 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.901986  6314 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:06.890548  5021 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.893054  4841 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:06.895152  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.896158  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.898196  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.874082  6428 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.917260  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.919106  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.921901  5023 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:06.922338  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 108332us
I20260709 12:10:06.923072  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:06.924124  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.925073  6786 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.925773  6786 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:06.927121  6786 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:06.931501  4946 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:06.940737  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.941440  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.887939  6655 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:06.942049  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.943229  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:06.943915  4946 raft_consensus.cc:2368] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3.
I20260709 12:10:06.944561  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.945284  4946 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:10:06.945958  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.946986  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.947876  4946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:06.948328  4946 raft_consensus.cc:606] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:10:06.948652  4946 raft_consensus.cc:614] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:06.949061  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:06.950361  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:06.902494  6238 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:06.951277  6238 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:06.956173  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:06.956794  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.957374  5024 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.965862  5017 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 12:10:06.966337  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 108443us
I20260709 12:10:06.882797  6622 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:06.942121  6757 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.754s	user 0.000s	sys 0.003s
I20260709 12:10:06.976222  6428 consensus_queue.cc:1059] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:06.976735  6653 consensus_meta.cc:287] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.004s
I20260709 12:10:06.977200  6653 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.977337  6428 raft_consensus.cc:3055] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:06.977691  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 975) took 2113 ms. Trace:
W20260709 12:10:06.978525  4917 leader_election.cc:336] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.542s (SENT)
I20260709 12:10:06.978961  4917 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:06.976178  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:06.967772  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:06.985929  5020 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:06.976358  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:06.961742  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:06.941161  6723 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.000407  5606 raft_consensus.cc:2368] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4.
I20260709 12:10:06.992143  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.005916  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:06.977723  6428 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:07.016301  6738 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:07.016952  4917 leader_election.cc:336] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.655s (SENT)
I20260709 12:10:07.017257  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:07.016314  5022 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:07.017985  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 55155.4us
I20260709 12:10:07.018277  4917 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.018638  6672 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.019165  6672 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:07.019078  6738 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.023451  5018 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.023748  6623 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:07.025413  6738 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:07.029196  6723 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.032437  6738 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:07.033172  6740 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.033092  6738 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.033456  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:07.029000  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 208367us
I20260709 12:10:07.034247  5025 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:07.040434  6738 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:06.988886  6575 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.046010  6238 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:07.046447  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 120) took 2091 ms. Trace:
I20260709 12:10:07.046792  4944 rpcz_store.cc:276] 0709 12:10:04.955127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.609873 (+654746us) service_pool.cc:224] Handling call
0709 12:10:05.610105 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.630989 (+1020884us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:06.696967 (+ 65978us) log.cc:844] Serialized 14 byte log entry
0709 12:10:06.858341 (+161374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.858397 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:06.858436 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.046135 (+187699us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400118ad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:07.046172 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.046296 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2681,"prepare.queue_time_us":83156,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":51,"raft.queue_time_us":2690,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":11583,"spinlock_wait_cycles":2346732416,"thread_start_us":122456,"threads_started":2,"wal-append.queue_time_us":120682}
I20260709 12:10:07.054445  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.055799  4947 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.040544  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:06.978047  4945 rpcz_store.cc:276] 0709 12:10:04.864469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.174311 (+309842us) service_pool.cc:224] Handling call
0709 12:10:05.174944 (+   633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:05.194174 (+ 19230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.194206 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:05.365961 (+171755us) log.cc:844] Serialized 26 byte log entry
0709 12:10:05.933532 (+567571us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.933572 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.933634 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:06.941389 (+1007755us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:06.977316 (+ 35927us) raft_consensus.cc:1685] finished
0709 12:10:06.977334 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.977544 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41702,"raft.queue_time_us":26407,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":17435,"spinlock_wait_cycles":3383552,"thread_start_us":509679,"threads_started":1,"wal-append.queue_time_us":735906}
I20260709 12:10:07.057439  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.060900  6414 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:07.062510  6623 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.062839  6623 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:07.063678  6623 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.064703  6723 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:07.022737  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:07.067734  4869 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:07.069732  5024 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:07.066082  4770 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.081811  4942 raft_consensus.cc:2410] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:07.086753  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:07.020332  6672 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.082183  6623 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.089426  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 48957.8us
I20260709 12:10:07.133364  4990 leader_election.cc:400] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4.
I20260709 12:10:07.133714  4990 leader_election.cc:403] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:07.017091  6428 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:07.138818  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.086798  6634 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:07.124068  6739 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:07.139711  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51665.4us
I20260709 12:10:07.143841  4840 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.089007  6575 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.150281  5598 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:07.153483  4774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 219) took 8143 ms. Trace:
I20260709 12:10:07.155385  5016 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:07.158004  6428 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.157325  4770 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 3, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 3 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.159078  4770 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 3 to 4, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 4 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.161070  6634 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.161955  4770 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 2, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.163304  6634 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:07.164453  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:07.165241  6622 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:07.165274  5606 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
W20260709 12:10:07.166081  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 155411us
W20260709 12:10:07.167572  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 82841.9us
I20260709 12:10:07.153815  4774 rpcz_store.cc:276] 0709 12:09:59.009708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.009858 (+   150us) service_pool.cc:224] Handling call
0709 12:10:07.153270 (+8143412us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:02.317680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:02.318218 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:02.318251 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:10:02.318264 (+    13us) tablet.cc:662] Decoding operations
0709 12:10:02.318873 (+   609us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:02.318937 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:02.318967 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:10:02.319441 (+   474us) tablet.cc:701] Row locks acquired
0709 12:10:02.319458 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:02.319590 (+   132us) write_op.cc:270] Start()
0709 12:10:02.319689 (+    99us) write_op.cc:276] Timestamp: P: 1783599002319547 usec, L: 0
0709 12:10:02.319710 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:02.500399 (+180689us) log.cc:844] Serialized 2079 byte log entry
0709 12:10:03.187829 (+687430us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a577e00ac 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b
0709 12:10:04.831359 (+1643530us) op_driver.cc:464] REPLICATION: finished
0709 12:10:05.166121 (+334762us) write_op.cc:301] APPLY: starting
0709 12:10:05.166205 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:05.166371 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:05.166394 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:05.167082 (+   688us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:05.167269 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:10:05.167315 (+    46us) write_op.cc:312] APPLY: finished
0709 12:10:05.167557 (+   242us) log.cc:844] Serialized 47 byte log entry
0709 12:10:05.168358 (+   801us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.168452 (+    94us) write_op.cc:454] Released schema lock
0709 12:10:05.168503 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:05.168865 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.168895 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7323,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":324287,"apply.run_cpu_time_us":2092,"apply.run_wall_time_us":2722,"num_ops":5,"prepare.queue_time_us":680429,"prepare.run_cpu_time_us":8931,"prepare.run_wall_time_us":1107163,"raft.queue_time_us":552117,"raft.run_cpu_time_us":33273,"raft.run_wall_time_us":198469,"replication_time_us":2473307,"spinlock_wait_cycles":28131712,"thread_start_us":1737496,"threads_started":4,"wal-append.queue_time_us":1060011,"wal-append.run_cpu_time_us":42901,"wal-append.run_wall_time_us":2606576}]]}
I20260709 12:10:07.177625  6737 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:07.178449  6737 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.178750  6737 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:07.179554  6737 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.181146  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:07.174741  6238 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4.
I20260709 12:10:07.188954  6737 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.191533  6739 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.188241  6738 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:07.203454  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 78257.8us
I20260709 12:10:07.219453  4840 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:07.223567  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.222440  6575 consensus_queue.cc:1059] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:10:07.221045  6738 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.225188  6575 raft_consensus.cc:3055] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.225757  6575 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:07.226779  6575 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.227214  6738 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:07.228071  6575 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:07.232308  4917 leader_election.cc:336] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.785s (SENT)
I20260709 12:10:07.232769  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:10:07.233844  4917 leader_election.cc:336] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.899s (SENT)
I20260709 12:10:07.234233  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.234918  6434 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.235571  6434 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.239617  6420 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:07.240127  6420 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.241747  4943 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:07.242208  6434 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.222616  6739 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.242899  6739 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:07.243307  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.243955  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.242851  6420 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:07.249434  6728 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.249854  6728 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:07.250737  6728 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:07.254420  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.260315  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.261459  6723 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:07.262076  6723 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.263222  6644 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.263579  6644 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:07.243287  6739 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.264029  6723 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:07.289611  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 246014us
I20260709 12:10:07.289824  4840 leader_election.cc:400] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:07.290380  4840 leader_election.cc:403] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:07.290270  4916 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.301126  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 920) took 1018 ms. Trace:
I20260709 12:10:07.301554  4874 rpcz_store.cc:276] 0709 12:10:06.282373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.740651 (+458278us) service_pool.cc:224] Handling call
0709 12:10:06.752729 (+ 12078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:06.753232 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.753275 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:06.753763 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:10:06.795027 (+ 41264us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:07.291837 (+496810us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.300666 (+  8829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.300738 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:07.300959 (+   221us) raft_consensus.cc:1685] finished
0709 12:10:07.300969 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.301072 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1431,"prepare.queue_time_us":224757,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":1192,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":513556,"threads_started":2,"wal-append.queue_time_us":68748}
I20260709 12:10:07.311313  4916 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:07.312731  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:07.313870  6737 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.314675  6748 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:07.314986  6428 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.315451  6428 raft_consensus.cc:697] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:07.316063  6737 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:07.316587  6748 raft_consensus.cc:993] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:10:07.317085  6748 raft_consensus.cc:1081] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Signalling peer ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:10:07.317134  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.317971  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.318863  4948 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.319252  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.320266  4947 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:07.319759  4949 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:07.320200  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.316303  6428 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.301019  6420 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.327667  4839 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:07.329095  4948 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 12:10:07.337744  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 250284us
I20260709 12:10:07.338614  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.339399  4944 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:07.264369  6644 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.312705  6738 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:07.316592  6737 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.329449  4948 pending_rounds.cc:85] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 1
I20260709 12:10:07.356266  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:07.350705  4948 pending_rounds.cc:107] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:07.358700  4948 raft_consensus.cc:2889] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:07.359584  5599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:37906
I20260709 12:10:07.360985  6790 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:07.361543  6790 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:07.362389  6790 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:07.365768  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.369400  4946 raft_consensus.cc:2410] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:07.358106  6738 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:07.376374  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.374099  4839 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.365658  6238 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:07.374202  6644 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.373610  5599 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:10:07.389731  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.390728  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.378051  6723 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:07.388259  6293 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.387737  5599 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.393095  4949 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.407485  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.391273  6434 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.410948  4944 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:07.411405  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.421797  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.422521  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.426045  6728 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.389562  6238 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.429143  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.405534  6748 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:10:07.433159  6810 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:10:07.417757  6623 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:10:07.434943  6623 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.435287  6623 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:07.436106  6623 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.436323  5599 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.428839  6738 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.438820  5599 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:07.444566  6814 log.cc:927] Time spent T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:07.416338  6434 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.451540  6434 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:07.453444  6805 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.152s	user 0.000s	sys 0.003s
I20260709 12:10:07.454787  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2029) took 1140 ms. Trace:
I20260709 12:10:07.455121  4875 rpcz_store.cc:276] 0709 12:10:06.313887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.791105 (+477218us) service_pool.cc:224] Handling call
0709 12:10:06.791560 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:06.799734 (+  8174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.799761 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:06.833299 (+ 33538us) log.cc:844] Serialized 52 byte log entry
0709 12:10:07.125249 (+291950us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:07.125292 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.125360 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:07.452728 (+327368us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:07.454495 (+  1767us) raft_consensus.cc:1685] finished
0709 12:10:07.454515 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.454728 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2543,"raft.queue_time_us":3611,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":19785,"spinlock_wait_cycles":17366400,"thread_start_us":258918,"threads_started":1,"wal-append.queue_time_us":356674}
W20260709 12:10:07.463033  4917 leader_election.cc:336] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.943s (SENT)
I20260709 12:10:07.463469  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.447751  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.467446  6623 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.469455  4917 leader_election.cc:336] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.944s (SENT)
W20260709 12:10:07.470451  4917 leader_election.cc:336] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.982s (SENT)
I20260709 12:10:07.471047  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:07.471829  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.473219  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:07.435027  6808 log.cc:927] Time spent T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:10:07.474581  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 79249.4us
W20260709 12:10:07.477398  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 64109.5us
I20260709 12:10:07.484194  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.488306  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:07.475409  6414 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.475754  6420 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.483394  6737 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:07.507638  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.489023  6434 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:07.514846  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 69254.3us
I20260709 12:10:07.501142  6787 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:10:07.525513  4944 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.528720  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:07.543140  6739 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.526786  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.545696  4943 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.529747  4988 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:07.553475  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:07.553813  6622 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:07.554972  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:07.555487  5016 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.556032  5022 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.556380  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:07.569343  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 91531.7us
I20260709 12:10:07.554983  6507 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.553429  6672 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.578969  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.586898  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.586654  5024 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:07.588706  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:07.589417  6672 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:07.617633  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.586591  6827 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:07.620711  4988 leader_election.cc:400] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3.
I20260709 12:10:07.621251  4988 leader_election.cc:403] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:07.619614  6739 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:07.594758  6723 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:10:07.616786  6672 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.623865  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.618484  6428 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.634549  6837 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:07.629792  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:07.641101  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 86463.5us
I20260709 12:10:07.642772  6825 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:07.644440  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.645326  6748 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:07.645844  6748 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.646313  4874 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:10:07.642706  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 135141us
I20260709 12:10:07.647528  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.648658  6625 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.649518  4876 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:07.622800  6832 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:07.651785  6634 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.652170  6634 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:07.658871  6238 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:07.659415  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:07.660670  4869 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.661393  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.661834  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.662438  4872 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:07.662832  6625 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.663130  5570 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.663549  6625 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.664333  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:07.664865  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 129021us
I20260709 12:10:07.665130  4869 raft_consensus.cc:2410] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:07.665678  6632 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:07.666041  6655 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.666456  6748 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:07.666183  6632 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.667251  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:07.626930  6827 consensus_queue.cc:1243] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:07.674006  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.675447  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.676052  5597 raft_consensus.cc:1240] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:07.676658  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.641865  6428 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.679800  6428 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:07.680832  4942 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:07.672509  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.685392  6634 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.686875  6634 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.690351  4943 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:07.691027  4945 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.666481  6655 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:07.693938  6655 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.694861  6655 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.694612  6672 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.672914  6837 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3.
I20260709 12:10:07.698230  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.698768  4867 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.701432  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.701967  4868 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.705155  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.637796  6838 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:07.707233  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.675374  4948 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:07.708827  6434 consensus_queue.cc:1059] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.710942  4948 pending_rounds.cc:85] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 1
I20260709 12:10:07.711261  4948 pending_rounds.cc:107] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:07.711473  4948 raft_consensus.cc:2889] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:07.692632  6817 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.281s	user 0.002s	sys 0.000s
I20260709 12:10:07.706315  6838 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:07.713617  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:10:07.713549  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 97865.5us
I20260709 12:10:07.711404  4867 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:07.714224  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:07.728457  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 59818.5us
I20260709 12:10:07.729032  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.730171  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.731151  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:07.735586  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.721495  6623 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.737186  4991 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:07.737592  6414 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:07.737942  6622 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:07.738101  6414 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:07.738976  6414 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.739509  4988 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:07.739885  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:07.740383  6837 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:07.741130  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.745164  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.745499  4868 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:07.745803  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.746587  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.745021  6507 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.712769  6632 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:07.748572  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.766748  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.767606  4867 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:07.767148  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:07.770797  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.771337  4871 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:07.771664  4871 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:07.771399  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.741864  6748 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:07.774001  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 110975us
I20260709 12:10:07.774565  5016 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.775295  4991 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:07.777707  4876 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:07.780915  5016 raft_consensus.cc:1240] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.781352  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.772552  6736 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.784461  6736 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:07.784848  6736 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.787544  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.781801  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.789335  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:07.785244  4871 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.791342  4871 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.769975  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.794934  4951 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:07.795099  6786 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.795533  6786 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.796195  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:07.797319  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:07.801002  4876 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:07.803258  6839 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.803385  6737 raft_consensus.cc:3055] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.803850  6737 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:07.804952  6737 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:07.805717  5016 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:07.805886  6737 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.785434  6238 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.806553  6238 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:07.806934  6839 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:07.807303  6672 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:07.807873  6672 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.808200  6672 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:07.775964  6748 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:07.808692  6748 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.808995  6672 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.797641  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.812359  6825 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.786024  5024 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:07.802888  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.824411  5016 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:07.824483  4874 raft_consensus.cc:2393] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:07.827895  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.828840  4868 raft_consensus.cc:2376] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5. Re-sending same reply.
I20260709 12:10:07.829758  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:07.824750  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.805517  6837 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.831306  4871 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:07.836128  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.834383  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.806957  6238 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.842907  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.836853  4876 raft_consensus.cc:2376] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4. Re-sending same reply.
I20260709 12:10:07.838809  5599 raft_consensus.cc:1240] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:07.839385  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.806135  6838 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.838760  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.841890  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.851595  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.851780  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.834210  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.852633  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.856128  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.857189  4867 raft_consensus.cc:2376] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3. Re-sending same reply.
I20260709 12:10:07.858364  4943 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.858693  4872 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.830550  6575 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:07.860363  6575 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:07.860695  6575 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:07.861486  6575 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:07.862589  6575 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:07.863581  6844 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 12:10:07.833278  6837 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:07.865502  6837 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.869222  6840 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.869872  6728 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.822418  6414 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:07.870378  6728 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:07.871404  6842 log.cc:927] Time spent T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:10:07.872498  6728 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:07.814807  6723 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:10:07.875056  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:07.877514  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.877851  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.879125  4876 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:07.879134  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:07.879648  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 77330.6us
I20260709 12:10:07.881210  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.874161  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:07.882938  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:07.882915  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:07.903416  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 61603.8us
I20260709 12:10:07.896347  4943 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:07.893097  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.901890  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.887854  4871 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:07.906272  6293 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:07.905995  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.908847  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.909482  4945 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:07.901387  4872 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:07.911072  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:07.911561  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:07.915517  4946 raft_consensus.cc:2410] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:07.915920  4840 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.917107  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.918427  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.919581  6826 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.920266  6826 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.920933  6826 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.922250  6826 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:07.924857  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 127615us
I20260709 12:10:07.928205  4874 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.929190  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:07.929785  4873 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.882601  6507 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.932214  4988 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:07.932965  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.925800  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:07.937536  4988 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:07.903870  6827 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.939122  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:07.940251  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.938237  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.933207  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:07.973945  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 122434us
I20260709 12:10:07.973474  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:07.924269  5023 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.914345  6787 consensus_queue.cc:1059] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:07.923653  5599 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
W20260709 12:10:08.027482  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 50942.4us
I20260709 12:10:08.029601  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.030462  5022 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:08.028514  5018 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
W20260709 12:10:08.030731  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 115790us
I20260709 12:10:08.033126  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.033702  5021 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:07.940244  6434 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.925942  6632 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:10:08.045382  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:08.045720  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 108254us
I20260709 12:10:07.974116  6786 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:08.030164  6794 log.cc:927] Time spent T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:10:07.974525  6414 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:08.072757  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.069535  5018 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:08.072359  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.073850  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.034404  6428 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:08.084619  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:08.073328  5021 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:08.083031  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:08.084698  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 55170.3us
W20260709 12:10:08.086721  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 147661us
I20260709 12:10:08.085829  5025 raft_consensus.cc:2376] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3. Re-sending same reply.
I20260709 12:10:08.088999  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:08.089649  6849 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.090821  6748 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.091841  4871 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:08.093055  6434 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.093473  6434 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.093791  6434 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:08.095847  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.097702  6414 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.099818  6414 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.100543  6507 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.109365  4917 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.116313  6434 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.103173  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:08.039821  6832 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:10:08.120327  6748 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:08.122077  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.082497  6827 consensus_queue.cc:1059] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:10:08.131516  4991 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:08.135768  6238 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.137554  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.149156  6238 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:08.155529  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:10:08.158306  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 127767us
I20260709 12:10:08.159281  6748 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:08.146010  6420 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.160718  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.147996  6740 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.162166  6739 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.146311  6428 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.162853  6428 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:08.163550  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.165724  6836 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.166069  6836 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:08.166814  6836 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.168038  6836 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.168999  6739 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.169523  6825 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:08.169909  6825 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:08.170847  6739 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:08.170728  6825 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.171974  6825 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.177801  6428 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.179039  4840 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:08.163153  6847 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:10:08.163141  6672 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.182435  6420 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.183187  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.183897  6790 raft_consensus.cc:3055] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.184244  6790 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:08.181923  6837 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.193070  4870 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:08.193918  4873 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:08.184744  4917 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:10:08.187335  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 98406us
I20260709 12:10:08.192222  6507 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:08.210459  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:08.199038  6238 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:08.162612  6846 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:10:08.200348  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.197523  6723 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.197728  6420 consensus_queue.cc:1059] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:10:08.121685  6434 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:08.199720  6838 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:08.202329  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 98368.9us
I20260709 12:10:08.154743  6738 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:08.198933  6622 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.219131  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.238471  5018 raft_consensus.cc:2410] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:08.229628  5568 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.238731  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.185525  6809 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:08.235772  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.242640  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.236369  5023 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.186395  6790 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.236716  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.237346  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.239724  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:08.243995  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 59302.3us
I20260709 12:10:08.198689  6787 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:10:08.252844  5019 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:08.268512  5568 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.267858  4870 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:08.244472  6428 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:08.247843  6632 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.269708  6414 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.273301  6723 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:08.286221  6634 consensus_meta.cc:287] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 12:10:08.242532  6838 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.302141  6238 raft_consensus.cc:697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:08.313751  6238 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.291677  6623 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:08.301965  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 65110.5us
I20260709 12:10:08.310338  4917 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:08.323696  6856 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.326117  6663 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.326555  6663 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:08.327411  6860 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:08.327944  6860 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.330015  6860 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:08.333120  4868 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:08.337489  5021 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:08.298714  6825 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:10:08.319805  6736 consensus_meta.cc:287] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.002s
I20260709 12:10:08.343490  4917 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:10:08.402837  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 63762.7us
I20260709 12:10:08.403555  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:10:08.408214  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 64779.5us
I20260709 12:10:08.409433  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.301026  6507 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:08.420670  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 169111us
I20260709 12:10:08.424373  5570 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.407387  6414 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:08.411177  6809 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:08.427593  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 161068us
I20260709 12:10:08.434348  4915 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.401368  6736 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.459179  4991 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.424402  6840 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:08.432565  6738 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:08.466806  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 57436.1us
W20260709 12:10:08.434312  6575 consensus_meta.cc:287] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.004s
I20260709 12:10:08.467785  4917 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.422479  6723 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:08.482192  6238 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:08.495100  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 209445us
I20260709 12:10:08.454394  6644 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:08.465406  6622 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.431918  6414 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.475989  6428 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.504182  6868 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:08.506191  6740 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.506490  6838 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:08.507073  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 74933.3us
I20260709 12:10:08.507169  6869 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.507798  6869 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:08.508674  6869 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.513144  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.514564  4944 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
W20260709 12:10:08.515015  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47296.9us
W20260709 12:10:08.503177  6861 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:10:08.523092  6868 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.499637  6644 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.499528  6738 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:08.499856  6622 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.527647  6837 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:08.514745  6860 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.545285  6420 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:08.550284  6428 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.501499  6575 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:08.526121  6877 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:08.505489  6848 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:08.553267  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 45519.2us
I20260709 12:10:08.567800  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:08.568439  4942 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:08.568215  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:08.553334  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 119037us
I20260709 12:10:08.511854  6625 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:08.557300  4917 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:08.500653  6809 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.562793  6420 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:08.575739  6644 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.575541  6420 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.513628  6740 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:08.548316  6790 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.563616  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 121) took 9213 ms. Trace:
I20260709 12:10:08.548110  6238 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.576563  6740 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.553503  6786 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:08.566156  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:08.578902  5606 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:08.556147  6838 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.569509  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:08.580451  4917 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.569623  4870 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:08.580714  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.570863  4949 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:08.577651  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:08.571583  6625 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:08.584390  4915 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:08.585227  4991 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.585512  4915 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.567365  4951 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:08.583214  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:08.577178  6876 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.576972  6420 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.576534  6736 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:08.584215  6634 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.589340  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:08.591023  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:08.586221  6826 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.589071  6625 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.590466  6623 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.577212  4770 rpcz_store.cc:276] 0709 12:09:59.346669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:59.350539 (+  3870us) service_pool.cc:224] Handling call
0709 12:09:59.780014 (+429475us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:08.560449 (+8780435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:07.414760 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:07.457061 (+ 42301us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:07.457118 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:10:07.457137 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:07.457825 (+   688us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:07.457937 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:07.457963 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:10:07.458597 (+   634us) tablet.cc:701] Row locks acquired
0709 12:10:07.458641 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:10:07.458796 (+   155us) write_op.cc:270] Start()
0709 12:10:07.458946 (+   150us) write_op.cc:276] Timestamp: P: 1783599007458742 usec, L: 0
0709 12:10:07.458982 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:10:07.459610 (+   628us) log.cc:844] Serialized 2054 byte log entry
0709 12:10:07.808080 (+348470us) op_driver.cc:464] REPLICATION: finished
0709 12:10:07.914629 (+106549us) write_op.cc:301] APPLY: starting
0709 12:10:07.928983 (+ 14354us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:08.028755 (+ 99772us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:08.082440 (+ 53685us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:08.090484 (+  8044us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:08.090768 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:10:08.090824 (+    56us) write_op.cc:312] APPLY: finished
0709 12:10:08.091138 (+   314us) log.cc:844] Serialized 47 byte log entry
0709 12:10:08.091310 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.091414 (+   104us) write_op.cc:454] Released schema lock
0709 12:10:08.091467 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:08.091818 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:08.091845 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":705343,"reported_tablets":10,"spinlock_wait_cycles":539080576,"child_traces":[["op",{"apply.queue_time_us":106315,"apply.run_cpu_time_us":3091,"apply.run_wall_time_us":177163,"num_ops":5,"prepare.queue_time_us":98582,"prepare.run_cpu_time_us":27189,"prepare.run_wall_time_us":206032,"raft.queue_time_us":141012,"raft.run_cpu_time_us":15969,"raft.run_wall_time_us":75699,"replication_time_us":348957,"spinlock_wait_cycles":23808,"thread_start_us":353428,"threads_started":4,"wal-append.queue_time_us":157870}]]}
I20260709 12:10:08.577800  6837 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.591035  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.577603  6848 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:08.564426  6860 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.586105  6575 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.586659  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:08.588958  6874 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.602339  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:08.600581  6883 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:08.593963  5568 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:08.618309  4868 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.591531  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:08.566928  6428 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:08.595950  6434 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.600364  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:08.578114  6786 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.593832  6622 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:08.599988  6644 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.625670  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.601353  6839 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.601215  6880 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.631315  4949 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:08.600492  6894 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.591652  6890 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:08.592636  6623 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.570446  6877 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.619596  6575 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:08.592198  6887 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:08.606069  6634 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.636173  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:08.591981  6826 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:08.593638  6869 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.626034  6837 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.622610  5601 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:08.624683  6434 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:08.602375  6876 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.645092  6575 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.648607  6893 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.627300  6644 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:08.638346  5597 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 2: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:08.647446  6880 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.653818  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.654687  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.633271  6894 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.656301  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.596943  6738 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.639220  6622 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.666918  5016 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:08.650048  6869 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:08.655377  6632 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:08.668227  6644 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.671268  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:08.672485  4951 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:08.672623  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.673744  4991 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.674712  4991 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.675312  5023 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:08.655861  6414 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.676965  6238 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.677455  6238 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:08.678085  6875 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.678200  6238 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.678938  6869 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.677156  6880 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.681471  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:08.652153  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.683760  5020 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:08.684976  6873 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.671406  4868 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:08.685766  6873 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.686113  6873 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.687250  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:08.687841  5601 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:08.671859  6634 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.689286  6881 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.684969  6860 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:08.689821  6894 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.691021  6876 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.692631  4841 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:08.693728  6634 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.693778  5570 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:08.694204  6634 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.694543  6634 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.697500  6625 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:08.697856  6625 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.698184  6625 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:08.700601  6836 consensus_meta.cc:287] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.000s
I20260709 12:10:08.639886  6839 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:10:08.707459  6849 consensus_meta.cc:287] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.617s	user 0.000s	sys 0.009s
I20260709 12:10:08.759883  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:08.723003  6622 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:08.725813  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.710026  5606 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:08.714728  6663 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.701145  6623 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.701153  6837 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.711091  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:08.702160  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:08.703814  6826 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:08.692795  6888 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.685506  6895 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:08.709991  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.665452  6848 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.733922  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.709889  5022 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.712939  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.718218  6825 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:08.743764  4988 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:08.753314  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:08.706861  5018 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:08.683363  6880 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.709547  5597 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:08.718713  6898 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:10:08.671430  6434 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.758801  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:08.685194  6877 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:08.764006  4915 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:08.712549  6786 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.788846  6737 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.789227  6737 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.789541  6737 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.765302  6723 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.721824  6881 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:08.716208  6428 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.767095  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:08.768421  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 66322.4us
I20260709 12:10:08.793320  5023 raft_consensus.cc:2410] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:08.795943  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:08.774257  6837 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:08.705687  6740 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:08.822175  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 206558us
I20260709 12:10:08.786158  6867 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:08.783707  6663 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.773303  5601 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.765697  6849 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.775945  6507 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.707873  6868 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.791554  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.772984  6787 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.784510  4951 raft_consensus.cc:2410] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:08.815318  4872 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:08.824249  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.824985  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.825413  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:08.826113  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:08.841885  4871 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 3: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:08.826858  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.792573  6840 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.829442  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.830107  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.794869  6881 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.833206  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:08.836125  4870 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.837844  5022 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:08.844002  4876 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:10:08.845891  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 49232.4us
I20260709 12:10:08.831573  6877 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.851866  5023 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:08.853786  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.796648  6575 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.792335  6901 consensus_queue.cc:1059] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:10:08.795055  6723 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.857053  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.783910  6895 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.859625  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.857748  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.860189  5017 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:08.861708  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.867341  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.868055  4869 raft_consensus.cc:2393] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:08.874621  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:08.875828  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:08.885460  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.886571  5022 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.886487  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.887524  4871 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:08.855980  6871 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.889027  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.857870  6893 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.827571  6878 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:08.893465  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:08.890225  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:08.891077  4867 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:08.889652  4869 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:08.895399  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.891799  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:08.860596  6860 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.895954  4871 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:08.897738  4871 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:08.900684  6507 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:08.901655  6507 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.838393  6873 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.860025  6877 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:08.867025  6875 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.894596  5025 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:08.865005  6787 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:08.892933  6867 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:08.890707  6738 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.917903  4949 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:08.915690  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:08.924219  4874 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
W20260709 12:10:08.933203  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 70819.5us
I20260709 12:10:08.914103  6880 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:08.935127  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:08.918995  6876 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.846311  6839 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.849524  6840 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.925000  6420 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.930491  6790 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.893747  6874 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:10:08.912729  6869 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.907037  6860 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.965342  4991 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:08.937731  6880 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:08.912086  4759 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica baa50eb5ed704004b7f391934a59d010 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:08.913928  6894 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.904927  6871 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:09.003191  4759 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 151573us
W20260709 12:10:09.003930  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 90544.8us
I20260709 12:10:08.906973  6893 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.008535  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:08.930076  6738 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.008083  4915 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:08.918781  6837 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:08.989847  6910 log.cc:927] Time spent T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:10:08.989671  6899 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:08.962893  6790 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:09.026203  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 60925.9us
I20260709 12:10:08.995945  6740 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:08.996376  6914 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.027697  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:09.043463  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:09.029204  6907 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:10:09.029846  6900 log.cc:927] Time spent T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:10:09.017724  6728 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:10:09.034947  6870 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.991358  6895 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:09.025565  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 149784us
I20260709 12:10:09.015673  6880 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:08.966102  6420 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.990478  6428 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:09.056931  6870 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.060959  6912 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.054610  6867 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:08.991132  6877 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:08.995203  6913 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:10:09.049558  6878 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.036648  6790 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.069221  6882 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.069706  6723 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.060879  6870 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.074944  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 153289us
W20260709 12:10:09.079502  6911 log.cc:927] Time spent T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:10:09.071741  6428 consensus_queue.cc:1243] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer ab9da67236874634be59ebfd05b18255 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:09.061616  6902 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:10:09.073235  6728 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:09.076732  6575 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.109696  6728 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:09.141851  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 85565.1us
I20260709 12:10:09.149104  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:09.113893  6873 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.153131  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:09.153791  5016 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:09.112020  6914 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:09.154516  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.155608  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.157137  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.157640  4868 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.159757  4873 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.109381  6644 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.162492  6737 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.163563  6644 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.166980  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.167863  4868 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:09.169384  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:09.171206  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.171770  4868 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:09.173913  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 151940us
I20260709 12:10:09.165925  6913 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.184005  6932 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.184376  6932 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.184686  6932 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.197556  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:09.179311  6869 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.176313  6873 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:09.177474  6860 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:09.197721  6918 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:10:09.193339  6894 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.221125  6922 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:09.211733  6856 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.190339  6634 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.219777  6420 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.187819  6728 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.191942  6913 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.248474  6932 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.249506  6913 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:09.249873  4839 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:09.247011  4868 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:09.251070  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:09.241247  6625 consensus_meta.cc:287] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.004s
I20260709 12:10:09.253825  6876 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.256711  6927 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.257372  6927 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:09.259006  5601 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:09.242681  6890 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.260237  6890 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.261399  5599 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.241969  6893 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.263618  6434 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.270172  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:09.271675  6623 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.272032  6623 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:09.272385  6623 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.274528  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:09.276029  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:09.219193  6914 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.280622  6790 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.281509  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:09.282521  6790 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.282529  6736 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.241581  6856 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.284795  6856 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.253255  6786 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.285790  6786 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.287772  6786 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.288738  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:09.289237  6634 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.289981  5601 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:09.290377  6880 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:09.290962  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:09.291719  6634 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:09.292081  6634 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.292264  6880 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.264530  6625 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.293038  6634 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:09.294668  6625 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.262414  6890 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.297029  5598 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:09.299760  6870 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.301687  6870 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:09.265568  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 114283us
I20260709 12:10:09.302619  6634 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.307235  5606 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:09.330063  4917 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.340490  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:09.336659  6655 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:10:09.339455  6623 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.347720  6723 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.355422  6935 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:09.358566  6737 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.347898  6434 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.348208  6901 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:09.349062  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:09.379302  6723 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:09.383206  5601 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.391233  4949 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:09.382442  6434 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:09.397624  6634 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.399179  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:09.399704  5606 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:09.399806  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.400516  4951 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:10:09.401659  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 150678us
I20260709 12:10:09.406543  4951 raft_consensus.cc:3055] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:09.406852  4951 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:09.408831  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.410027  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:09.409744  6663 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.414732  6663 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.381983  6901 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.417831  6434 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.418967  6901 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.420251  6623 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.420038  6723 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:09.423295  6881 consensus_meta.cc:287] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.006s
I20260709 12:10:09.423746  6881 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.394447  6869 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.375154  6935 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.429236  6937 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:09.429495  6871 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:09.410565  4951 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.430881  4951 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.429005  6238 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.431257  6238 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:09.433099  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.433715  4947 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:09.438262  4839 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.416675  6663 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.440760  6238 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.447640  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:09.431962  6837 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.451581  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:09.455675  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.460184  6238 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.412707  6787 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:09.461205  4945 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:09.436057  5597 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.435911  6888 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.466076  6881 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.467111  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:09.469094  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:09.469614  4947 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:09.429069  6869 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.429759  6937 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.452899  6914 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.477254  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:09.477811  4943 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.441109  6634 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:10:09.480540  5603 raft_consensus.cc:1217] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Deduplicated request from leader. Original: 2.4->[3.5-5.6]   Dedup: 3.5->[5.6-5.6]
I20260709 12:10:09.481071  5603 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:10:09.486940  5606 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:09.472474  6787 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.491564  6869 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.492079  6787 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.476337  6914 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.493090  6914 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.498545  4950 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:09.499459  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.475147  6888 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:09.504607  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:09.506083  6932 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.507740  6935 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.503615  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:09.511173  5603 raft_consensus.cc:2393] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 3: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:09.462981  6837 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.514307  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:09.515219  5601 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:09.500715  6634 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.519557  6634 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.521529  6634 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.523382  4841 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:09.524642  4951 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:09.525048  4951 pending_rounds.cc:85] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 5
I20260709 12:10:09.525309  4951 pending_rounds.cc:107] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:09.525588  4951 raft_consensus.cc:2889] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:09.527067  4943 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:09.511181  6739 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:09.536316  6840 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.537081  6655 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.534190  6827 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:09.543572  6914 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.546288  4947 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:09.550136  6837 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:09.558521  6655 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.560511  6655 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.561076  6827 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:09.558001  5597 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:09.550820  6739 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:09.552995  6937 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.509931  6888 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:09.565837  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.564524  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:09.571282  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:09.574775  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:09.575352  5021 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.582450  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:09.583006  5025 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.584474  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:09.585636  6936 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.593271  6739 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.594463  6739 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.574180  6837 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.570449  6634 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:09.598981  6634 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.608260  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:09.612481  6919 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:09.610307  6787 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.614238  6787 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.616214  6787 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.609047  6921 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:09.571134  6895 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:09.581629  6644 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.633255  4867 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:09.609223  6837 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:09.562844  6827 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.636745  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.637010  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.637396  4868 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:09.637806  4871 raft_consensus.cc:2368] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5.
I20260709 12:10:09.620463  6736 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.618350  6936 raft_consensus.cc:697] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:09.642323  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:09.631568  6746 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.644594  5570 leader_election.cc:400] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5.
I20260709 12:10:09.645547  6663 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.646365  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.650386  4875 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.646674  6738 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.646891  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.648020  5570 leader_election.cc:403] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:09.650655  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.652396  4870 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:09.652839  4868 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:09.652356  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.650386  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.653903  4871 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.656531  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.657117  4867 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:09.657063  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.658125  4869 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.641805  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:09.660617  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.661187  4872 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:09.617060  6921 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.663684  6921 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.667996  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.668525  4873 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.670866  6634 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:09.687841  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.632128  6644 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.628062  6895 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.693022  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.693612  4867 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:10:09.651403  6663 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.674661  4873 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:09.674310  6837 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.651649  6826 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.677457  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:09.680028  6832 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.647593  6881 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:10:09.680032  6930 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.293s	user 0.000s	sys 0.002s
I20260709 12:10:09.644599  6736 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.703685  4869 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:09.705289  4871 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:09.705662  4876 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:09.681780  6947 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:09.682744  6914 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.658847  6890 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5.
W20260709 12:10:09.694891  6951 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:10:09.701478  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.680948  5025 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:09.710814  6238 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:09.707468  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.712029  4871 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:09.697597  6663 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.714675  4872 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:09.716028  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:09.716594  5603 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:09.720952  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:09.721431  4948 raft_consensus.cc:606] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:09.721668  4948 raft_consensus.cc:614] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:09.716980  5601 raft_consensus.cc:2368] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:10:09.722860  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:09.726574  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.727357  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.728237  4917 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.730209  5021 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:09.730876  5598 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:09.731364  6957 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:10:09.732781  6880 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.733163  6880 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.733492  6880 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.730345  4917 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.704684  6826 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.701965  6832 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.755924  6895 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.740753  4990 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:09.739899  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.741353  6919 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:09.764551  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.749271  6736 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.750555  6644 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.765375  4841 leader_election.cc:400] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:10:09.765744  4841 leader_election.cc:403] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:09.766175  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.737566  6902 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.730906  6738 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.738214  6856 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.683743  6936 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.759495  4917 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.761132  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.736743  6746 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:09.737046  6942 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.328s	user 0.000s	sys 0.002s
I20260709 12:10:09.769650  4875 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:09.782735  4870 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.771421  4869 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:10:09.771780  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.773835  4873 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:09.745303  6880 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.787616  4871 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.767349  6895 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.792836  5570 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:09.777328  6902 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.797196  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:09.798158  4870 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:09.777166  6738 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:09.799302  6881 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:09.776986  6856 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.784722  6937 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.800045  6832 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.781067  6915 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.791254  6746 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.801885  4869 raft_consensus.cc:606] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:09.841909  4869 raft_consensus.cc:614] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:09.785924  6914 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.815491  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:09.800566  6902 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.829830  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.830772  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:09.832221  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.833215  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.833465  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.836163  4839 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.772850  6919 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.841178  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.843837  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.862469  4943 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.864328  4947 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:09.834533  6738 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.846298  6880 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.839604  6915 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.849426  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:09.839757  6856 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:09.850675  6963 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:10:09.850860  6914 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.843400  6937 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:09.835439  6840 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:09.853730  4869 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:09.827970  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:09.867620  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 52213us
I20260709 12:10:09.868335  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:09.761761  6428 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.873431  4948 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:09.875672  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:09.774226  6888 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:09.876600  6860 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.905609  6428 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:09.906044  6860 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:09.906544  6428 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.906739  6937 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.906988  6860 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.910844  4870 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.889472  4874 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:09.841713  6881 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:09.883551  6919 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.794552  6867 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:10:09.899091  4839 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:09.900141  6868 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:09.887197  6915 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.887472  6632 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.854606  6746 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:09.895474  4943 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:09.920787  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:09.884546  6890 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.924229  4949 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:09.902278  6663 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.917126  6888 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:09.929787  6836 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.917096  6912 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:09.948279  6826 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.946970  6746 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.947408  6625 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:09.934406  6867 consensus_queue.cc:1243] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer ab9da67236874634be59ebfd05b18255 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:09.950501  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:09.952138  4869 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:09.953177  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 56821us
I20260709 12:10:09.948256  6663 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:09.945017  6836 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:09.933831  6890 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:09.975857  6836 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.990651  5601 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:09.976975  6888 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:09.960711  6881 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:10.035245  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 81444us
I20260709 12:10:10.067967  6868 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.070210  6632 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:10.085891  6890 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:10.078888  6868 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:10.087883  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:10.091441  6625 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.101329  6625 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.103323  6625 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:10.100162  6739 consensus_meta.cc:287] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.003s
W20260709 12:10:10.105819  6974 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:10.108958  6915 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.110976  6895 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3.
I20260709 12:10:10.110988  6915 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:10.112419  4870 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:10.114462  6738 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:10.116386  6738 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:10.106761  6836 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:10.118152  6868 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:10.119277  6836 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:10.122026  6856 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.125785  6632 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.127333  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:10.129199  5603 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:10:10.134336  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.134951  6915 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:10.134524  6856 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:10.134053  6837 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:10:10.148213  5597 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:10.156863  6902 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.159783  4944 raft_consensus.cc:2368] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4.
I20260709 12:10:10.160332  6238 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:10.257951  6625 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.258598  6625 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.261646  6625 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:10.468344  6836 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.468912  6836 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.470916  6836 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:10.471655  6836 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:10.472148  6836 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:10.604684  4869 consensus_meta.cc:287] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
I20260709 12:10:10.605141  4869 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:10.176270  6902 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:10.756978  4840 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.527s (SENT) [suppressed 42 similar messages]
I20260709 12:10:10.780095  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:10.753031  6895 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.751794  6736 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:10.816646  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:10.817348  4869 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:10.818163  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:10.818701  4869 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:10:10.819423  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:10.820345  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:10.800019  6980 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.658s	user 0.001s	sys 0.000s
I20260709 12:10:10.821182  4869 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.831198  4869 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:10.822382  6895 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:10.832639  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:10.840090  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:10.840793  4869 raft_consensus.cc:2410] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:10.849107  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 141) took 1055 ms. Trace:
I20260709 12:10:10.849510  4870 rpcz_store.cc:276] 0709 12:10:09.793261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.115522 (+322261us) service_pool.cc:224] Handling call
0709 12:10:10.115825 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:10.116531 (+   706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.116557 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:10.117070 (+   513us) log.cc:844] Serialized 52 byte log entry
0709 12:10:10.129022 (+ 11952us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:10.129059 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.129118 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:10.848883 (+719765us) raft_consensus.cc:1685] finished
0709 12:10:10.848905 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.849047 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3724,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":11620,"threads_started":1,"wal-append.queue_time_us":24037}
W20260709 12:10:10.876909  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 119963us
I20260709 12:10:10.878952  6921 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:10.879523  6921 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:10.890524  6921 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:10.906908  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 990) took 1038 ms. Trace:
I20260709 12:10:10.908306  4869 rpcz_store.cc:276] 0709 12:10:09.868582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.843579 (+974997us) service_pool.cc:224] Handling call
0709 12:10:10.843860 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.844069 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:10.885232 (+ 41163us) log.cc:844] Serialized 14 byte log entry
0709 12:10:10.906489 (+ 21257us) log.cc:844] Serialized 14 byte log entry
0709 12:10:10.906616 (+   127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:10.906653 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:10.906689 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.906751 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:10.906857 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":59488,"threads_started":2}
I20260709 12:10:10.911072  4869 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:10.918814  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57006 (request call id 238) took 1096 ms. Trace:
I20260709 12:10:10.919239  5601 rpcz_store.cc:276] 0709 12:10:09.822123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.835092 (+ 12969us) service_pool.cc:224] Handling call
0709 12:10:10.918615 (+1083523us) spinlock_profiling.cc:243] Waited 94.1 ms on lock 0x7b54002a6054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:10.918734 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216356224}
I20260709 12:10:10.943881  6871 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:10.944305  6871 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:10.945127  6871 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.946374  6871 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.922252  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:10.951721  6293 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:10.831815  6632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.020s	sys 0.048s
W20260709 12:10:10.955307  6632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.023s	sys 0.048s
W20260709 12:10:10.951891  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 1.02963e+06us
I20260709 12:10:10.962036  4839 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:10.962735  6293 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.963176  6293 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:10.963990  6293 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:10.823283  6736 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:10.969765  4869 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:10:10.974644  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.977443  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 978) took 1326 ms. Trace:
I20260709 12:10:10.977831  4876 rpcz_store.cc:276] 0709 12:10:09.651280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.651374 (+    94us) service_pool.cc:224] Handling call
0709 12:10:09.651608 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.706007 (+ 54399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.977216 (+1271209us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b540031bfd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:10.977375 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120870784}
I20260709 12:10:10.980589  6293 consensus_queue.cc:1059] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:10.983450  5597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.020s	sys 0.023s
W20260709 12:10:10.988063  5597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.021s	sys 0.024s
I20260709 12:10:10.981854  6293 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:10.989014  6293 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:10.990370  6293 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:10.991662  6293 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.981501  6871 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.000378  6914 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.162444  6293 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:11.167214  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2099) took 1003 ms. Trace:
I20260709 12:10:11.168197  6293 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.172881  4869 rpcz_store.cc:276] 0709 12:10:10.163293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.972201 (+808908us) service_pool.cc:224] Handling call
0709 12:10:11.166726 (+194525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.166901 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.166936 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.166980 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:11.167007 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.167062 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.167161 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.175539  4869 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:11.175486  6736 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.178714  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 441) took 1449 ms. Trace:
I20260709 12:10:11.181769  5603 rpcz_store.cc:276] 0709 12:10:09.729039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.729333 (+   294us) service_pool.cc:224] Handling call
0709 12:10:09.729654 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.129608 (+399954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.178477 (+1048869us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54006a0c54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:11.178656 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916967296}
I20260709 12:10:10.996735  6871 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:10.638290  5606 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.027s
W20260709 12:10:11.185973  5606 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.005s	sys 0.034s
I20260709 12:10:11.178560  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 997) took 1014 ms. Trace:
I20260709 12:10:11.190716  6293 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:11.198211  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 985) took 1497 ms. Trace:
I20260709 12:10:11.198634  4873 rpcz_store.cc:276] 0709 12:10:09.701150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.701276 (+   126us) service_pool.cc:224] Handling call
0709 12:10:11.198020 (+1496744us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54001752d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:11.198124 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143974656}
I20260709 12:10:11.200387  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 146) took 1034 ms. Trace:
I20260709 12:10:11.204129  4873 rpcz_store.cc:276] 0709 12:10:10.166015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.199658 (+1033643us) service_pool.cc:224] Handling call
0709 12:10:11.199954 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.200110 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.200135 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.200173 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:11.200201 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.200249 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.200338 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.208734  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:11.209542  5599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37900 (request call id 440) took 1493 ms (client timeout 1808 ms). Trace:
W20260709 12:10:11.209882  5599 rpcz_store.cc:269] 0709 12:10:09.715931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.716682 (+   751us) service_pool.cc:224] Handling call
0709 12:10:11.208576 (+1491894us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800157898. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:10:11.209484 (+   908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2691328}
I20260709 12:10:11.188482  4869 rpcz_store.cc:276] 0709 12:10:10.163814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.174537 (+1010723us) service_pool.cc:224] Handling call
0709 12:10:11.175035 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.177185 (+  2150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.178139 (+   954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:11.218794  6293 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.219415  6293 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.221624  6293 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.223662  6293 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:11.225389  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:11.225960  4869 raft_consensus.cc:606] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:11.226269  4869 raft_consensus.cc:614] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:11.236035  4869 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:11.224144  6293 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:11.343777  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.306070  6825 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.357594  6825 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.360422  6825 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.361159  6871 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:11.361653  6871 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.362069  6871 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.363873  6871 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.364369  6871 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:11.289261  6914 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:11.239676  6736 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:11.368971  6293 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.371321  5606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 442) took 1244 ms. Trace:
I20260709 12:10:11.376467  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:11.380347  6736 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.380986  6914 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.384519  4869 raft_consensus.cc:606] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:11.383121  5606 rpcz_store.cc:276] 0709 12:10:10.126601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.132281 (+  5680us) service_pool.cc:224] Handling call
0709 12:10:10.132543 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.132714 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:11.186471 (+1053757us) log.cc:844] Serialized 14 byte log entry
0709 12:10:11.371002 (+184531us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:11.371054 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:11.371093 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.371157 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.371265 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3596,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":92,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6564,"thread_start_us":1236785,"threads_started":2}
I20260709 12:10:11.390964  6914 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.393934  6736 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.396706  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c480da15ff054400bdd09744d494717c"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:11.400394  4869 raft_consensus.cc:606] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:11.401212  4869 raft_consensus.cc:614] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:11.401898  4875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.527s	user 0.022s	sys 0.021s
W20260709 12:10:11.402225  4875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.527s	user 0.022s	sys 0.021s
I20260709 12:10:11.402822  6293 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:11.403332  6293 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:10.841884  6836 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.406476  6293 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:11.409934  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:11.402870  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2086) took 1641 ms. Trace:
I20260709 12:10:11.410988  4869 raft_consensus.cc:606] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:11.413178  4869 raft_consensus.cc:614] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:11.414769  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:11.416360  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:11.417078  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:11.412528  4875 rpcz_store.cc:276] 0709 12:10:09.761365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.782934 (+ 21569us) service_pool.cc:224] Handling call
0709 12:10:09.783604 (+   670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:09.784305 (+   701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.784336 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:09.795917 (+ 11581us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.402537 (+1606620us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:11.402577 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.402649 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.402707 (+    58us) raft_consensus.cc:1685] finished
0709 12:10:11.402717 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.402823 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2025,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4918,"thread_start_us":1527224,"threads_started":1,"wal-append.queue_time_us":170308,"wal-append.run_cpu_time_us":1608,"wal-append.run_wall_time_us":1047211}
I20260709 12:10:11.399019  6914 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:11.427629  6914 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.436691  6871 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:11.437569  6871 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.496762  6871 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.517907  6737 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.518589  5603 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:11.519205  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:11.519913  4839 leader_election.cc:400] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4.
W20260709 12:10:11.606702  4874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 979) took 1954 ms (client timeout 1851 ms). Trace:
I20260709 12:10:11.698794  6890 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.526646  4869 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:11.705139  6890 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.548151  7002 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.607079  4868 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:11.706218  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:11.594411  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 987) took 1878 ms. Trace:
I20260709 12:10:11.547551  6997 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:11.708027  6997 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:11.625218  5598 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:11.705971  4839 leader_election.cc:403] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:11.709671  6890 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.710083  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:11.710206  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 190416us
I20260709 12:10:11.547178  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2095) took 1422 ms. Trace:
I20260709 12:10:11.542689  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 445) took 1372 ms. Trace:
I20260709 12:10:11.595520  6902 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.705780  5601 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.488329  6914 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.558138  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2082) took 1798 ms. Trace:
I20260709 12:10:11.615123  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 983) took 1954 ms. Trace:
I20260709 12:10:11.525206  6632 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.713013  5597 rpcz_store.cc:276] 0709 12:10:10.170419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.170582 (+   163us) service_pool.cc:224] Handling call
0709 12:10:10.170889 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.171224 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.171255 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.172867 (+  1612us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.988402 (+815535us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:10.988444 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.988521 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.542480 (+553959us) raft_consensus.cc:1685] finished
0709 12:10:11.542509 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.542635 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85381,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":815097,"threads_started":1,"wal-append.queue_time_us":1368200}
I20260709 12:10:11.640431  6825 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.523991  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:11.666958  6988 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.658180  6507 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.715644  6825 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:11.639048  4991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.008s	sys 0.015s
I20260709 12:10:11.584264  6728 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.717451  6632 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.706796  4869 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.694067  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:11.704550  4874 rpcz_store.cc:269] 0709 12:10:09.652017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.652148 (+   131us) service_pool.cc:224] Handling call
0709 12:10:11.606512 (+1954364us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540004ea54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:11.606636 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302066944}
I20260709 12:10:11.720237  5600 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.547868  6995 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.716907  5602 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:11.696715  5604 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:11.721064  6995 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.540189  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2100) took 1376 ms. Trace:
I20260709 12:10:11.578620  6856 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.722049  4876 rpcz_store.cc:276] 0709 12:10:10.163561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.978706 (+815145us) service_pool.cc:224] Handling call
0709 12:10:10.979021 (+   315us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:11.003431 (+ 24410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.003464 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:11.004068 (+   604us) log.cc:844] Serialized 78 byte log entry
0709 12:10:11.213367 (+209299us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:11.213493 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.213698 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.539966 (+326268us) raft_consensus.cc:1685] finished
0709 12:10:11.539984 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.540135 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2352,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":232737,"threads_started":2,"wal-append.queue_time_us":533985}
I20260709 12:10:11.723158  6995 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.718364  6825 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.723814  6825 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:11.724159  6856 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.724388  6825 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:11.724241  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 200354us
I20260709 12:10:11.725824  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:11.727054  6825 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.731356  6825 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:11.721900  4991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.012s	sys 0.019s
I20260709 12:10:11.714900  4770 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:11.732434  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 732552us
I20260709 12:10:11.732426  6825 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:11.706388  7002 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.715080  4872 rpcz_store.cc:276] 0709 12:10:09.671266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.672220 (+   954us) service_pool.cc:224] Handling call
0709 12:10:09.691870 (+ 19650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.715004 (+ 23134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.614894 (+1899890us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54003e49d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:11.615057 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51782016}
W20260709 12:10:11.653039  6959 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 2.004s	user 0.013s	sys 0.007s
I20260709 12:10:11.718550  6902 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.716437  6507 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.717123  4867 rpcz_store.cc:276] 0709 12:10:09.760039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.760146 (+   107us) service_pool.cc:224] Handling call
0709 12:10:09.766896 (+  6750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:09.767184 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:09.767209 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:09.767587 (+   378us) log.cc:844] Serialized 26 byte log entry
0709 12:10:09.887486 (+119899us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:09.887525 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:09.887589 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.557929 (+1670340us) raft_consensus.cc:1685] finished
0709 12:10:11.557958 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.558083 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":339,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":119565,"threads_started":1,"wal-append.queue_time_us":173207,"wal-append.run_cpu_time_us":13055,"wal-append.run_wall_time_us":1578695}
I20260709 12:10:11.767222  6902 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.723426  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2085) took 1962 ms. Trace:
I20260709 12:10:11.733246  4770 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 3, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:11.767745  6902 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:11.768296  6902 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.768462  4770 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 3 to 4, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:11.707110  4871 rpcz_store.cc:276] 0709 12:10:09.716240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.716344 (+   104us) service_pool.cc:224] Handling call
0709 12:10:09.717169 (+   825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:09.788122 (+ 70953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.594186 (+1806064us) spinlock_profiling.cc:243] Waited 67.2 ms on lock 0x7b540031b5d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:11.594354 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154516864}
I20260709 12:10:11.531080  6895 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.736505  6737 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.716137  6988 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.539469  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.710956  4870 rpcz_store.cc:276] 0709 12:10:10.130598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.852006 (+721408us) service_pool.cc:224] Handling call
0709 12:10:10.852350 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.876133 (+ 23783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.876165 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.876733 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.907347 (+ 30614us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:10.929750 (+ 22403us) log.cc:844] Serialized 14 byte log entry
0709 12:10:10.929935 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.929999 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.546980 (+616981us) raft_consensus.cc:1685] finished
0709 12:10:11.547002 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.547122 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637237,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":38810,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":212,"thread_start_us":64023,"threads_started":3,"wal-append.queue_time_us":658035}
I20260709 12:10:11.726827  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:11.745924  4869 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:11.753261  7012 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:11.757519  7011 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.759786  7015 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:11.760212  7010 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:11.795681  7010 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.796522  4874 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.760131  6634 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:11.762146  7002 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.708866  6997 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.751607  6871 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:11.764389  6632 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.742309  6890 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.727519  6856 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.767765  4868 rpcz_store.cc:276] 0709 12:10:09.761126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.777990 (+ 16864us) service_pool.cc:224] Handling call
0709 12:10:11.606867 (+1828877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.706482 (+ 99615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.723180 (+ 16698us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b540004ea50. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:11.723375 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4205378432}
I20260709 12:10:11.699512  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:11.815169  7002 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.815460  7014 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.767225  6507 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.815653  7002 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.816243  6507 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.815974  7014 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.816716  6507 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.817654  7002 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.818127  7002 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:11.818140  7014 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.818673  6507 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:11.771134  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.818681  7002 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.815721  5603 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:11.772367  4770 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:11.820645  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.821327  4870 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:11.778100  7019 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.782953  7007 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.785543  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.785800  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.825201  4867 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:11.786456  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.787215  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 158) took 1718 ms. Trace:
W20260709 12:10:11.789634  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 62869.3us
I20260709 12:10:11.789572  6293 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4.
I20260709 12:10:11.791288  6902 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.833776  6921 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:11.834467  6902 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:11.833379  4988 connection.cc:256] RPC call timeout handler was delayed by -1.0294212930002686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 12:10:11.794483  5601 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:11.791604  6737 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.835171  4950 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:11.751893  6825 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.813479  4874 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:11.825953  4943 rpcz_store.cc:276] 0709 12:10:10.068891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.069007 (+   116us) service_pool.cc:224] Handling call
0709 12:10:10.069312 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.072736 (+  3424us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:10.072765 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.073125 (+   360us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.582238 (+1509113us) spinlock_profiling.cc:243] Waited 949 us on lock 0x7b1800254b00. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a0d1 00007f2a5a8a5a0f
0709 12:10:11.770275 (+188037us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:11.770315 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.770375 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:11.770415 (+    40us) raft_consensus.cc:1685] finished
0709 12:10:11.770425 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:11.787160 (+ 16735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3026,"raft.queue_time_us":3313,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1974,"spinlock_wait_cycles":2182528,"thread_start_us":187881,"threads_started":1,"wal-append.queue_time_us":1680829}
I20260709 12:10:11.821573  4770 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 3, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:11.832266  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.832631  6507 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.833246  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.833820  6728 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:11.834828  6936 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:11.794889  7015 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.840348  4872 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:11.813812  7008 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.815024  7005 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.836444  7019 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.842301  6507 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.843505  7005 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.822599  6997 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.839708  4871 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:11.844714  6988 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:11.845009  7019 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.845499  7019 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.845911  7019 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.846138  6507 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:11.838805  4770 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 5, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 5 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:11.832685  6739 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:11.842844  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:11.839568  6737 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:11.847427  4770 catalog_manager.cc:5697] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 4, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:11.849589  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:11.850692  5021 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.836037  7013 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.801101  7011 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.872928  5025 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.873731  6871 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:11.834901  6902 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.823740  6890 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.841748  7012 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:10:11.884259  4950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52376 (request call id 1065) took 2051 ms (client timeout 2125 ms). Trace:
W20260709 12:10:11.887079  4950 rpcz_store.cc:269] 0709 12:10:09.833153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.833258 (+   105us) service_pool.cc:224] Handling call
0709 12:10:11.884109 (+2050851us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400276ad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:11.884207 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4532660480}
I20260709 12:10:11.843032  6728 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.888342  6871 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.889653  6902 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:11.867919  4897 debug-util.cc:398] Leaking SignalData structure 0x7b080019d780 after lost signal to thread 3728
I20260709 12:10:11.890039  6728 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:11.890974  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1560 after lost signal to thread 4808
W20260709 12:10:11.892272  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce7a0 after lost signal to thread 4900
W20260709 12:10:11.892563  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08003eaec0 after lost signal to thread 4901
I20260709 12:10:11.893287  7005 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.893788  7005 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.894238  7005 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.895349  7019 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:11.893719  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08002dae80 after lost signal to thread 4975
W20260709 12:10:11.896016  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08002be620 after lost signal to thread 4976
W20260709 12:10:11.897272  4897 debug-util.cc:398] Leaking SignalData structure 0x7b080023bb80 after lost signal to thread 5049
W20260709 12:10:11.897552  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08003879a0 after lost signal to thread 5050
I20260709 12:10:11.898459  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:11.898697  4897 debug-util.cc:398] Leaking SignalData structure 0x7b080003efe0 after lost signal to thread 5630
W20260709 12:10:11.899019  4897 debug-util.cc:398] Leaking SignalData structure 0x7b0800305e00 after lost signal to thread 5631
W20260709 12:10:11.899519  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08003b05a0 after lost signal to thread 6428
W20260709 12:10:11.899891  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7600 after lost signal to thread 6723
W20260709 12:10:11.900218  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0880 after lost signal to thread 6740
W20260709 12:10:11.900447  4897 debug-util.cc:398] Leaking SignalData structure 0x7b080038f1c0 after lost signal to thread 6746
W20260709 12:10:11.900720  4897 debug-util.cc:398] Leaking SignalData structure 0x7b080038f6c0 after lost signal to thread 6826
I20260709 12:10:11.890966  7010 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:11.881273  6737 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.903388  6737 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:11.890381  6871 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:11.901474  4897 debug-util.cc:398] Leaking SignalData structure 0x7b080029ebe0 after lost signal to thread 6867
W20260709 12:10:11.904328  4897 debug-util.cc:398] Leaking SignalData structure 0x7b0800375c40 after lost signal to thread 6876
I20260709 12:10:11.840054  7007 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.905458  5017 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:11.904656  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08003544a0 after lost signal to thread 6888
I20260709 12:10:11.851003  6507 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:11.913854  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:11.914517  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:11.921867  4945 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:11.926321  5021 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:11.915125  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:11.927481  5025 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:11.930583  5018 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:11.931176  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:11.872861  4770 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 3, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:11.933332  5023 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:11.933662  4949 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.935238  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:11.843355  7022 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:10:11.896010  7005 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:11.936328  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:11.938232  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.939085  4943 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:11.939617  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.033131  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:11.940552  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.047999  4951 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:11.940653  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.032959  4770 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 4, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 4 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
W20260709 12:10:11.941596  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.049588  5020 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.033704  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.050745  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:11.942888  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.051630  5022 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:11.943311  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.052347  5016 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:11.942790  4946 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:11.930742  6728 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.949339  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:11.922814  6871 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:11.929769  6902 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.954154  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:11.954756  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:11.945943  4897 debug-util.cc:398] Leaking SignalData structure 0x7b080036abe0 after lost signal to thread 6912
I20260709 12:10:11.956698  4947 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:11.930956  7019 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:11.958015  7010 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:11.904847  6825 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:11.851522  7008 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:11.958389  7021 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:12.058542  6985 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.026952  7024 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:12.067397  7027 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:12.074684  7027 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.072991  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:11.998332  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.002661  7002 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.003052  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:11.961053  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:12.017136  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:11.962735  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:11.961331  4915 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:12.034221  4950 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 2.
I20260709 12:10:12.048296  4871 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
W20260709 12:10:12.031960  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.055979  4770 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 5, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 5 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:12.060133  5024 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:12.061333  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.087359  4946 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:12.091354  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.056118  7028 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.059404  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.099720  4949 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:12.062520  5023 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 3: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:12.101341  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.097833  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:12.073344  7030 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:11.934759  6507 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.129223  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.130998  4949 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:12.067481  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.048400  6737 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.079980  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.079443  4988 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:12.132297  4943 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
W20260709 12:10:12.132681  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 53326.3us
I20260709 12:10:12.133215  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.068486  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.077984  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.134522  4947 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:12.074152  7011 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.073417  6985 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.077401  5019 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:12.134080  4948 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:12.078146  5021 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:12.069056  7015 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.103585  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:12.047004  4944 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:12.090170  4770 catalog_manager.cc:5697] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 3, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:12.144438  4770 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:12.096742  5016 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:12.072585  7021 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.070691  7007 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.120319  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:12.154505  4870 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.072342  7008 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:12.070916  6825 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.059717  6238 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:10:12.068799  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08003abc60 after lost signal to thread 6930
I20260709 12:10:12.073051  7025 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:12.075663  6902 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.102937  5601 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:12.157702  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.069271  7010 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.174149  4950 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:12.073900  6728 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:12.181046  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 229778us
I20260709 12:10:12.069020  7019 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.169107  6238 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.156198  4770 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 3, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 3 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:12.173053  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:12.181695  4897 debug-util.cc:398] Leaking SignalData structure 0x7b0800380340 after lost signal to thread 6947
I20260709 12:10:12.173265  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.202734  5016 raft_consensus.cc:2393] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:12.144799  7011 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:12.154203  7013 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.154994  7015 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.026988  7012 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.145884  6737 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.210762  6238 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.211007  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.169824  7007 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:12.202301  4897 debug-util.cc:398] Leaking SignalData structure 0x7b0800214f40 after lost signal to thread 6948
I20260709 12:10:12.067227  6871 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.204039  4770 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 2, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:12.215173  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 253899us
I20260709 12:10:12.209070  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.216642  5016 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:12.129230  7028 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.218530  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.219704  5016 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:12.074188  7024 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.227430  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.225360  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.200263  4870 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:12.236824  4874 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:12.237514  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.238119  5021 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:12.240979  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.242075  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.242648  4871 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:12.243661  5022 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:12.249311  5017 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:12.249922  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.250420  5024 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:12.251078  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.251765  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.252429  5022 raft_consensus.cc:2410] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:12.253221  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.253476  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.181461  7025 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:12.234331  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 131097us
I20260709 12:10:12.205683  7013 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.236379  5016 raft_consensus.cc:2393] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:10:12.221570  4897 debug-util.cc:398] Leaking SignalData structure 0x7b08003136c0 after lost signal to thread 6953
I20260709 12:10:12.254243  5017 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:12.255126  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.290940  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:10:12.291189  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47290.3us
I20260709 12:10:12.270066  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.273061  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.272972  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.273718  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.274363  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.211812  7015 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.281733  7027 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:12.281970  6728 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.282760  4872 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:12.257082  4875 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:12.284116  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 102368us
I20260709 12:10:12.211915  7011 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.229313  4770 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:12.293385  4916 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:12.215550  7023 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:12.291858  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:12.293772  4897 debug-util.cc:398] Leaking SignalData structure 0x7b080037fd80 after lost signal to thread 6960
I20260709 12:10:12.284857  6985 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:12.303284  7033 log.cc:927] Time spent T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:10:12.303418  7024 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:12.303874  7032 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:10:12.304983  6632 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.305516  6632 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:12.305605  6890 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:12.306414  6632 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.307550  7043 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:12.307955  7043 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.308173  7010 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.309000  7007 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:12.310627  7011 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.318118  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.320541  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.284466  7013 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.322036  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.300678  4770 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:12.325695  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.326279  5021 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:12.283347  7045 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:12.327694  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.308280  7043 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.329121  5016 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:12.331067  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.330801  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.331614  5016 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:10:12.332203  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.332285  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.333396  5016 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:12.333981  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.334689  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.335374  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.329376  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.329483  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.336545  5022 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:12.337015  5023 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:12.337664  5022 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:12.338891  5016 raft_consensus.cc:2393] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:12.339149  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:12.339529  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.341988  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.349488  6895 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:12.350209  7031 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:10:12.338575  6728 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:12.345448  6995 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:12.399777  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:12.296056  7016 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:12.327364  7021 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.330051  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:12.424233  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.399194  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:12.338320  4770 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 4, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 4 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:12.414521  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.415059  5597 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.415300  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.428375  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:12.429092  5024 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:12.417309  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.338928  7045 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.418980  6895 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.419813  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.404606  5020 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:12.425379  5019 raft_consensus.cc:2410] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:12.426213  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.429653  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:12.421722  7020 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.420401  6995 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:12.404096  7011 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:10:12.434824  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:12.425463  6902 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.436709  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:12.429744  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 136416us
I20260709 12:10:12.434712  5016 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:12.435984  7020 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:12.422864  7008 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:12.441365  7020 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.445413  7008 consensus_queue.cc:1243] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:12.439016  7047 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.438736  7044 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:12.435000  7041 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.436543  7010 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:12.447036  7041 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.447432  7041 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.428853  6728 raft_consensus.cc:697] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:12.442606  7039 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.443145  7024 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:12.444389  6737 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.442646  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:12.458252  6895 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.430699  7019 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.436977  7021 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:12.453256  7045 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.453763  6871 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:12.428699  6997 consensus_queue.cc:1059] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:10:12.434901  7007 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:12.445863  7008 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:12.461347  5598 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:12.461051  6997 raft_consensus.cc:3055] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:12.463222  6997 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:12.463937  6997 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.451283  7039 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.464957  7039 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.461802  6728 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.464983  6997 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:12.462090  7008 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:12.459195  5606 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:12.469364  7025 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:12.470031  7008 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.471704  5016 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:12.464234  7020 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.465796  6871 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:10:12.475484  6936 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:12.475656  6871 consensus_queue.cc:1243] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer ab9da67236874634be59ebfd05b18255 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:12.456667  7041 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.476001  6936 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.476238  6737 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:12.471225  7005 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.476760  6895 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:12.512441  5020 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:12.504842  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.538009  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.538621  5020 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:12.539009  6936 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.501650  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:12.539587  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.505088  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.540588  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.502242  7028 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.543881  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.437000  6507 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:12.449617  6902 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.544701  6902 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:12.545207  6902 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.509900  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.542721  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.517192  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.496943  7007 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:10:12.536769  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.506850  7008 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:12.542426  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 100458us
W20260709 12:10:12.477988  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 226015us
I20260709 12:10:12.542289  6895 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.477234  7020 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.505003  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.525782  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.536720  7005 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:12.541311  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.567477  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.439105  4770 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:12.563153  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 61580us
I20260709 12:10:12.559594  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:12.569974  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.569609  4770 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:12.568033  4876 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:12.505189  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:12.559157  6936 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:12.577478  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.582501  4991 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:12.578779  7015 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.579051  6895 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:12.582021  5023 raft_consensus.cc:2368] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:12.582020  4915 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:12.584280  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.583967  4770 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:12.583617  5016 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:12.592368  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:12.592550  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.592919  4876 raft_consensus.cc:2376] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5. Re-sending same reply.
I20260709 12:10:12.586520  4946 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:10:12.595010  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:12.595228  5025 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:12.595773  4876 raft_consensus.cc:2376] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5. Re-sending same reply.
I20260709 12:10:12.572167  6985 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:12.603631  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.604575  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.607394  5016 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:12.605796  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:12.613703  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.614262  5016 raft_consensus.cc:2376] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4. Re-sending same reply.
I20260709 12:10:12.593374  6507 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.572566  6995 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.591431  7014 raft_consensus.cc:2764] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:12.591398  7046 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.606621  6985 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.621551  7013 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.615532  7028 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:10:12.628189  4872 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:12.601189  7045 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.621644  4917 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:12.652140  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.638739  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.653059  5023 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:12.594973  4770 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 5, now has a pending config: VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65), VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66), VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67), VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:12.640166  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 81164.5us
I20260709 12:10:12.644598  7067 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.594079  7020 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:10:12.640949  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 71929.9us
I20260709 12:10:12.647920  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.649861  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.671036  5016 raft_consensus.cc:2376] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5. Re-sending same reply.
I20260709 12:10:12.601320  7007 consensus_queue.cc:1059] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:12.591598  6936 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.601516  7044 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:12.652535  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:12.680979  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:12.654681  5568 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:12.629580  6507 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.679845  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.609186  7011 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:10:12.684316  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.648224  6985 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:12.681915  7067 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.647541  7046 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:12.647606  7002 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:12.688129  5568 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:12.630267  7025 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:12.730207  5597 raft_consensus.cc:1217] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:10:12.686559  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.687098  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:12.682314  7043 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.797780  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.918129  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.825531  5022 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:12.762036  4991 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:12.761667  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:12.802002  5025 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:12.826177  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:13.039817  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 351736us
I20260709 12:10:13.041244  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.041926  4951 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 2.
I20260709 12:10:12.853330  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:12.686326  7021 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:12.681759  6737 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:12.686324  6507 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:13.070988  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.073724  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.834830  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:12.730327  7010 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:13.045395  5019 raft_consensus.cc:2393] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:10:13.044874  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 283268us
I20260709 12:10:12.933063  4871 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:13.009061  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:13.121429  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:13.122763  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:13.124054  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:12.801110  7007 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.056507  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:13.056507  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 294537us
W20260709 12:10:13.138125  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.138602  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.023691  7055 log.cc:927] Time spent T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:10:12.730362  6890 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.057874  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:13.058519  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 378084us
I20260709 12:10:13.057312  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:12.859169  7056 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:10:12.793850  7058 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:10:13.065269  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:13.129851  6902 consensus_meta.cc:287] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.000s
I20260709 12:10:12.860291  7039 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:12.961021  7061 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:13.129012  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:13.159334  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:13.159876  4872 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:13.129360  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:13.161093  4875 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:13.053079  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.068145  5597 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:13.142424  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:12.768180  7013 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.064850  6997 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.064878  6737 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.069095  7028 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.068113  7021 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:13.171437  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.152107  5022 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:13.080217  6849 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.153223  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.067318  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.127115  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.166144  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.166291  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.163123  7061 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.168351  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.208629  5024 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:13.129540  7022 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.174255  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.176102  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.178205  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.179215  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.179891  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.182264  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.185537  7054 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.184232  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.225499  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.226198  7061 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.142387  7010 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:13.218494  7022 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:13.226933  7022 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.227231  7010 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.210916  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.210881  5022 raft_consensus.cc:2376] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5. Re-sending same reply.
I20260709 12:10:13.211786  4988 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.218462  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.168084  6890 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:13.185863  5019 raft_consensus.cc:2376] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6. Re-sending same reply.
I20260709 12:10:13.218060  5020 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:13.154094  6632 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:10:13.223413  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.223680  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.234958  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.142495  7007 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.168553  6902 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.239660  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.221053  7073 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.170908  7075 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.217370  7028 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:13.231498  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.234978  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.236740  6632 consensus_queue.cc:1243] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer baa50eb5ed704004b7f391934a59d010 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:13.170953  6737 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.238464  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.219754  6936 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.241149  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:13.263710  4870 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.017s
I20260709 12:10:13.243425  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:13.275626  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 123781us
I20260709 12:10:13.244947  7023 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.235267  7054 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:13.248172  7008 consensus_meta.cc:287] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.000s
W20260709 12:10:13.249456  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 240460us
I20260709 12:10:13.230623  6895 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.234539  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.231971  7014 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.230841  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.224336  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.252133  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.281512  5017 raft_consensus.cc:2376] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5. Re-sending same reply.
I20260709 12:10:13.253988  4944 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:13.255184  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.244364  6507 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.235806  4947 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:13.258320  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:10:13.353400  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 95161.2us
I20260709 12:10:13.353770  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.354450  5022 raft_consensus.cc:2393] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:13.355193  4988 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:13.355388  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:13.356333  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.356437  4916 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:13.262264  5024 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:13.210386  6849 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.242180  7052 raft_consensus.cc:3055] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:13.276219  5018 raft_consensus.cc:2410] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:13.243629  6985 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:13.277266  4870 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.001s	sys 0.017s
I20260709 12:10:13.302349  5023 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:13.369766  5023 pending_rounds.cc:85] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 2
I20260709 12:10:13.370021  5023 pending_rounds.cc:107] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:13.370231  5023 raft_consensus.cc:2889] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:13.301550  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 335109us
I20260709 12:10:13.302697  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.297488  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.254812  7075 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:13.312723  7070 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:10:13.313848  7043 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.301898  6895 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.316507  4869 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:13.316900  7067 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.321485  7046 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:13.277038  7024 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:13.303113  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.279032  7023 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:13.350402  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.259881  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.368079  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.368722  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.396598  5019 raft_consensus.cc:2376] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5. Re-sending same reply.
I20260709 12:10:13.361263  7052 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:13.372445  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.374440  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.376194  4946 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:13.399250  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.385471  5025 raft_consensus.cc:2368] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4.
I20260709 12:10:13.262880  7021 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.359498  7008 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.253412  7073 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.278723  6997 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:10:13.397241  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:13.398037  7046 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.389732  4872 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:13.401980  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.409601  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.427832  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.428897  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.428715  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.429591  4947 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:13.429893  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.430393  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.431485  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.432129  4947 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:13.432825  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.433336  4947 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:13.434067  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.435164  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.436165  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.395757  5016 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:13.387010  6895 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.437506  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.438700  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.439216  5016 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:13.440368  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.377017  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:13.413434  7076 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:13.441393  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.372745  7085 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:10:13.385934  7079 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.441937  5016 raft_consensus.cc:2376] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4. Re-sending same reply.
I20260709 12:10:13.442392  7079 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.442883  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.443655  5016 raft_consensus.cc:2410] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:13.324939  7028 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:13.421701  7074 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:10:13.445056  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.446226  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.447235  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:13.422956  6849 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.449302  6849 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.449659  6849 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.449975  6849 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.423717  7007 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:13.398190  7043 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.401645  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.425325  4991 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:13.444388  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.453799  5016 raft_consensus.cc:2368] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:13.453975  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.454520  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.455024  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.456063  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.456607  4951 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:13.457341  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.458269  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.455065  5016 raft_consensus.cc:2376] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4. Re-sending same reply.
I20260709 12:10:13.463721  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.463670  5024 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:13.466290  4951 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.468540  4951 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:13.466312  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.471400  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.472019  5024 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:13.473029  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.474445  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.475126  5024 raft_consensus.cc:2368] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:13.468885  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.477633  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.481009  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.482993  5024 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:13.481889  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.486230  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.490041  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:13.486402  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 130141us
I20260709 12:10:13.497197  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.516500  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.517961  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.518764  5024 raft_consensus.cc:2410] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:13.520474  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 479448us
W20260709 12:10:13.520998  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.521426  5568 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.424633  7014 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.516835  6997 consensus_queue.cc:1243] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer ab9da67236874634be59ebfd05b18255 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:13.526129  7008 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:13.604923  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 183719us
W20260709 12:10:13.641039  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.637259  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 280869us
I20260709 12:10:13.644991  4916 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:10:13.646824  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 342697us
I20260709 12:10:13.687387  4916 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:13.689198  4916 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:13.427096  7022 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:13.693930  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 317082us
I20260709 12:10:13.638229  6997 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:13.655146  7008 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:13.709245  7008 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:13.709656  7087 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.289s	user 0.000s	sys 0.000s
I20260709 12:10:13.687594  6902 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.688999  7037 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.544238  6895 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.694831  7043 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.689785  7092 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:13.721279  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.701920  7054 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:13.723717  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:13.726488  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 360487us
W20260709 12:10:13.727964  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.724161  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 202826us
I20260709 12:10:13.524299  7052 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.731609  5568 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.718596  7078 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.735008  6895 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.736281  6995 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.726270  6507 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.718968  7080 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:13.771904  7080 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.715790  6997 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.773067  7071 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:13.773355  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1029) took 1171 ms. Trace:
I20260709 12:10:13.773567  7071 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:13.774016  7080 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.774363  6997 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:13.727694  6985 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:13.772125  7008 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.776118  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.737474  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.764556  7073 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:13.761152  5601 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:13.769687  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.778410  7080 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.778826  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1020) took 1047 ms. Trace:
I20260709 12:10:13.779191  5023 rpcz_store.cc:276] 0709 12:10:12.731748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.732438 (+   690us) service_pool.cc:224] Handling call
0709 12:10:12.732740 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.370620 (+637880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.778640 (+408020us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400064354. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:13.778776 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309261184}
I20260709 12:10:13.779863  6997 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:13.780932  5568 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.770088  7041 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.764559  6739 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:10:13.784463  7008 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.781774  5017 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:13.743535  6632 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.820169  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2128) took 1139 ms. Trace:
I20260709 12:10:13.820515  4873 rpcz_store.cc:276] 0709 12:10:12.681009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.311025 (+630016us) service_pool.cc:224] Handling call
0709 12:10:13.357746 (+ 46721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.357934 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:13.358198 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.819866 (+461668us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.819913 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:13.819960 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.820018 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.820117 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83822,"prepare.queue_time_us":145,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":158852,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":377451,"threads_started":2,"wal-append.queue_time_us":406815}
W20260709 12:10:13.822532  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 178310us
I20260709 12:10:13.785559  4876 rpcz_store.cc:276] 0709 12:10:12.601668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.601760 (+    92us) service_pool.cc:224] Handling call
0709 12:10:12.602036 (+   276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:13.056367 (+454331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.056398 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:13.056959 (+   561us) log.cc:844] Serialized 52 byte log entry
0709 12:10:13.251015 (+194056us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:13.308794 (+ 57779us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.772801 (+464007us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b180037ff60. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a5a4924bc 00007f2a577e048b 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fa455 00007f2a5a8e2060 00007f2a5a8f4716 00007f2a5a905287
0709 12:10:13.772944 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.773021 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.773063 (+    42us) raft_consensus.cc:1685] finished
0709 12:10:13.773152 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.773301 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34693,"prepare.queue_time_us":63275,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":164770,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":34187,"spinlock_wait_cycles":18330368,"thread_start_us":625793,"threads_started":3,"wal-append.queue_time_us":262489}
W20260709 12:10:13.852785  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 162309us
I20260709 12:10:13.854359  4839 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:13.816465  7080 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.864717  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:13.866827  7073 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:13.869390  7097 log.cc:927] Time spent T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:10:13.870333  7022 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.855846  6632 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.864578  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 126532us
I20260709 12:10:13.855822  5567 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
W20260709 12:10:13.859297  6737 consensus_meta.cc:287] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.001s
I20260709 12:10:13.879298  7073 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:13.885257  6737 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.886672  4946 raft_consensus.cc:2393] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:13.887207  6737 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.885370  6632 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.855690  6849 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.857368  6895 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:13.885028  7073 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.890988  4951 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.896420  5016 raft_consensus.cc:2393] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:13.884989  7022 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:13.895243  7072 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.670s	user 0.002s	sys 0.000s
W20260709 12:10:13.896862  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 157383us
I20260709 12:10:13.899848  6632 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.900426  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.901386  6849 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:13.902572  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.905413  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.906003  4950 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:13.906406  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 170) took 1108 ms. Trace:
I20260709 12:10:13.906466  4988 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.906780  4950 rpcz_store.cc:276] 0709 12:10:12.798363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.798482 (+   119us) service_pool.cc:224] Handling call
0709 12:10:13.905283 (+1106801us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:10:13.906362 (+  1079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22478080}
I20260709 12:10:13.897178  7022 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:13.908267  7120 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.924702  7120 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.925051  7120 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.926332  7071 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.928552  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2119) took 1308 ms. Trace:
I20260709 12:10:13.928911  4872 rpcz_store.cc:276] 0709 12:10:12.620012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.160395 (+540383us) service_pool.cc:224] Handling call
0709 12:10:13.160699 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.427527 (+266828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.928341 (+500814us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003e3ad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:13.928501 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526154496}
I20260709 12:10:13.909624  5017 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:13.930115  5017 pending_rounds.cc:85] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 5
I20260709 12:10:13.930326  5017 pending_rounds.cc:107] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:13.930536  5017 raft_consensus.cc:2889] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:13.931658  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.932235  5017 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:13.910259  7022 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.910465  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:13.934239  5023 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.910658  7103 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:13.935529  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.913395  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1030) took 1307 ms. Trace:
I20260709 12:10:13.917052  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:13.937234  5602 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.937669  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:13.938520  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:13.939793  4839 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:13.940559  4839 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:13.936758  4868 rpcz_store.cc:276] 0709 12:10:12.605722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.605894 (+   172us) service_pool.cc:224] Handling call
0709 12:10:12.606194 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:12.610437 (+  4243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.610464 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:12.613453 (+  2989us) log.cc:844] Serialized 52 byte log entry
0709 12:10:13.069399 (+455946us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:13.069440 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.069516 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.894734 (+825218us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:13.913090 (+ 18356us) raft_consensus.cc:1685] finished
0709 12:10:13.913112 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.913337 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60606,"raft.queue_time_us":161923,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":20941568,"thread_start_us":419923,"threads_started":1,"wal-append.queue_time_us":594921}
I20260709 12:10:13.909446  4988 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.916071  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.949903  4988 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:10:13.923759  7098 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
I20260709 12:10:13.951098  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.952368  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:13.951066  5021 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:13.914112  7100 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.936720  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:13.919447  7005 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.955107  7096 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:13.952280  7117 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.910794  7119 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.908272  6849 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:13.952378  7002 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.965294  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:13.966360  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.967288  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:13.967042  7023 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.955443  5602 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:13.948522  7085 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.968046  7023 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.968134  7085 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:13.968566  7085 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.969307  6849 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.970207  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.970781  4942 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:13.971189  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 169) took 1176 ms. Trace:
I20260709 12:10:13.971469  4942 rpcz_store.cc:276] 0709 12:10:12.794956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.795072 (+   116us) service_pool.cc:224] Handling call
0709 12:10:13.970080 (+1175008us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:10:13.971141 (+  1061us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15686016}
I20260709 12:10:13.971925  6849 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:13.950822  7071 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:13.972967  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.974576  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:13.975123  7100 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.977005  7096 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.977574  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.978044  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:13.978708  4948 raft_consensus.cc:2393] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:13.916716  6985 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:13.963956  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:13.952227  7062 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:13.952607  7103 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.959642  7117 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:13.917488  7073 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.984431  7117 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.955782  7054 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:13.984726  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:13.968763  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 171) took 1143 ms. Trace:
I20260709 12:10:13.985421  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 1013) took 1179 ms. Trace:
I20260709 12:10:13.985735  5019 rpcz_store.cc:276] 0709 12:10:12.805774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.407083 (+601309us) service_pool.cc:224] Handling call
0709 12:10:13.984598 (+577515us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b5800185798. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:10:13.985371 (+   773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11093376}
I20260709 12:10:13.986114  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.954160  4988 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.979610  5023 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:13.980677  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:13.981338  7062 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:13.977641  7096 raft_consensus.cc:3055] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:13.983597  7071 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:13.982256  7103 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:13.989814  7073 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:13.990410  7096 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:13.990613  7071 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:13.991287  7096 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:13.989913  7103 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.992354  7096 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.988211  7054 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:13.993448  4948 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:13.994287  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:13.995138  5023 pending_rounds.cc:85] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 5
I20260709 12:10:13.986744  4950 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:13.996266  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 1019) took 1189 ms. Trace:
I20260709 12:10:13.968503  7065 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.996663  7067 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.997540  4950 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:13.997745  7039 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:13.998302  7062 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.003528  7067 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.995301  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.995687  4948 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:13.995759  6739 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:13.986737  4944 rpcz_store.cc:276] 0709 12:10:12.825809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.825927 (+   118us) service_pool.cc:224] Handling call
0709 12:10:13.968621 (+1142694us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400118ad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:13.968714 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493468544}
I20260709 12:10:13.996614  5024 rpcz_store.cc:276] 0709 12:10:12.807053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.527260 (+720207us) service_pool.cc:224] Handling call
0709 12:10:13.527510 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.550610 (+ 23100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.550641 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.550683 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:13.550712 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.996056 (+445344us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b54001414d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:13.996098 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:13.996216 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52705536}
I20260709 12:10:14.006978  5023 pending_rounds.cc:107] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:14.051079  5023 raft_consensus.cc:2889] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:14.052095  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:13.988339  4988 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:14.015515  7019 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.987026  4839 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:10:14.055531  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 68573.8us
I20260709 12:10:14.056110  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:10:14.024641  4871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 2116) took 1405 ms (client timeout 1694 ms). Trace:
W20260709 12:10:14.057058  4871 rpcz_store.cc:269] 0709 12:10:12.619362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.679629 (+ 60267us) service_pool.cc:224] Handling call
0709 12:10:14.012134 (+1332505us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54003377d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:14.024588 (+ 12454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570769152}
I20260709 12:10:14.000698  7085 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:14.060958  6293 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.061352  6293 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:14.061817  6293 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.059417  7073 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.061369  7019 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.062731  7073 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:14.063123  7073 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.036278  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 1022) took 1227 ms. Trace:
I20260709 12:10:14.061400  7065 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.053892  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:14.058612  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 70583.6us
I20260709 12:10:14.008378  7022 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:14.064002  5020 rpcz_store.cc:276] 0709 12:10:12.797349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.797526 (+   177us) service_pool.cc:224] Handling call
0709 12:10:14.011860 (+1214334us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003b51d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:14.025061 (+ 13201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347276672}
I20260709 12:10:14.067608  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:14.073278  7118 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.063634  6849 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.074331  6849 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:14.074704  6849 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:14.078634  7129 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 12:10:14.040313  7103 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.066066  7122 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.081362  7122 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:14.081773  7122 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.069828  7078 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.085603  5604 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.088393  7022 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:14.091070  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.092640  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.093345  4951 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 6: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:14.094488  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.099174  6293 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.101265  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.103276  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:14.103925  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.103852  4949 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:14.101868  4948 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:14.105369  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.065163  7065 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:14.106680  4948 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:14.109692  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.109877  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.110810  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.111323  4949 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.107745  4988 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:14.112571  6293 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.108704  4840 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:14.113417  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.113957  4951 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:14.115872  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:14.115833  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.116709  4951 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.118180  4840 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:14.114058  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:14.120313  6995 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.122035  4840 leader_election.cc:400] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:14.120700  4988 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:14.123530  6293 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.124593  6238 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.122604  4840 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:14.109222  7024 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.110764  7065 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.136490  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.130826  7062 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.142555  4944 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:14.144219  4949 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:14.145084  5017 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:14.126937  4840 leader_election.cc:400] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:14.127524  4988 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:14.115057  7010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.009s	sys 0.021s
I20260709 12:10:14.110924  7016 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:14.114584  7054 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.152479  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:14.123337  6890 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:14.161696  6890 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:14.162075  6890 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:14.162446  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.163013  4949 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:14.143777  7071 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.164899  7096 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.165174  7071 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.165557  7071 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.166217  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:14.167860  4951 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:10:14.168447  4949 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:14.168792  5567 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:14.159200  6293 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:14.150730  7010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.009s	sys 0.021s
I20260709 12:10:14.124176  7019 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.125315  6936 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.171010  6293 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:14.170469  7080 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.172610  4943 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.175403  7119 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.176106  6238 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.182687  7080 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:14.183086  6238 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.187441  6238 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:14.187090  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:14.191682  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:14.171850  4840 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:14.185652  5599 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:14.253037  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.256268  6293 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:14.256392  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 84604.9us
I20260709 12:10:14.186345  7037 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 12:10:14.259281  7103 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.280968  7104 consensus_queue.cc:1059] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:14.483076  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:14.484155  7024 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.484503  7024 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:14.485281  7024 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.485909  7065 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.486582  7024 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.487425  7023 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.468531  7131 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.156s	user 0.004s	sys 0.003s
I20260709 12:10:14.487893  7023 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.492175  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:14.492748  4867 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:14.493048  7023 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:14.494056  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.494585  4949 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.487907  7065 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.497233  4872 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:14.257647  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 64437us
I20260709 12:10:14.501613  7023 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:14.149521  7120 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.503816  7120 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:14.257709  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 66083.2us
W20260709 12:10:14.422935  5021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 1012) took 1839 ms (client timeout 1535 ms). Trace:
I20260709 12:10:14.428395  4839 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:14.504592  5021 rpcz_store.cc:269] 0709 12:10:12.583382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.583481 (+    99us) service_pool.cc:224] Handling call
0709 12:10:14.358275 (+1774794us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540011eed4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:14.422868 (+ 64593us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3090536192}
I20260709 12:10:14.332424  7075 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:14.505136  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 76943.8us
I20260709 12:10:14.505503  7075 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.197719  7117 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.505836  4839 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:14.506903  4839 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:14.507546  7117 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.319305  7085 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:14.189186  7045 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 12:10:14.324848  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:14.418248  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:14.508801  4945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 167) took 1748 ms (client timeout 1860 ms). Trace:
W20260709 12:10:14.509145  4945 rpcz_store.cc:269] 0709 12:10:12.760336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.033433 (+273097us) service_pool.cc:224] Handling call
0709 12:10:14.373569 (+1340136us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:10:14.508744 (+135175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7000448}
I20260709 12:10:14.277002  6902 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:14.329689  5025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 1024) took 1521 ms (client timeout 1518 ms). Trace:
I20260709 12:10:14.328236  7066 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:14.193373  6737 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:14.335528  7122 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.444412  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2049) took 1318 ms. Trace:
I20260709 12:10:14.441967  4948 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:14.303558  6890 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:14.521498  7122 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.516433  6902 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:14.521976  6890 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:14.303198  7012 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:14.522258  6902 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.522594  5602 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:14.183320  6936 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:14.523561  6936 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.526302  7071 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.528258  7071 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.183086  7080 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.461771  5603 raft_consensus.cc:1217] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:10:14.529244  5603 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:14.443063  7073 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.193598  7021 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.235s
I20260709 12:10:14.474591  4871 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.531023  7073 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.474809  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:14.474951  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:14.476069  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:14.480628  5604 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:14.425485  7062 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.481532  4869 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.482933  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:14.533727  4867 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:14.533983  5603 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:14.534265  4875 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:14.533871  4874 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:14.535030  7012 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:14.535894  7012 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:14.536499  7021 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:14.537310  6849 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.537873  7021 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:14.539660  6849 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:14.432310  7083 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.549602  7083 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:14.552955  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:14.509969  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:14.507712  7103 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.508461  4915 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:14.511014  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:10:14.560173  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 51787.3us
I20260709 12:10:14.561757  4839 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:14.564646  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:14.513599  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:14.565575  4872 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.515197  4949 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:14.515878  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:14.516738  5025 rpcz_store.cc:269] 0709 12:10:12.808097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.056287 (+248190us) service_pool.cc:224] Handling call
0709 12:10:14.329517 (+1273230us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400161cd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:14.329633 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571258752}
I20260709 12:10:14.519141  4943 rpcz_store.cc:276] 0709 12:10:13.125954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.126201 (+   247us) service_pool.cc:224] Handling call
0709 12:10:13.126451 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.178966 (+1052515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.444210 (+265244us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540011b7d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:14.444359 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405557632}
I20260709 12:10:14.520232  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.570348  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.571307  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.531931  4876 raft_consensus.cc:2410] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:14.532284  6902 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.508095  7065 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.543100  6936 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.543778  7080 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:14.558851  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 48967us
I20260709 12:10:14.579232  4988 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:14.582172  4874 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.584227  4872 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
W20260709 12:10:14.574332  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 69552.2us
I20260709 12:10:14.575244  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.585350  4943 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.576191  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.576936  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:14.584873  4874 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.587713  4869 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:14.588464  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:14.589689  4875 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.589941  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:14.590675  4876 raft_consensus.cc:2410] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:14.590492  6238 consensus_queue.cc:1059] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:14.591689  4869 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:14.591864  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.592396  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.594343  4915 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:14.554149  7083 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:14.603708  6238 consensus_queue.cc:1243] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:10:14.604031  4950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.018s	sys 0.030s
I20260709 12:10:14.604225  6238 raft_consensus.cc:3055] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:14.604302  4950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.018s	sys 0.030s
I20260709 12:10:14.573630  7120 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:14.620059  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:14.619745  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:14.651304  5024 raft_consensus.cc:2368] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5.
I20260709 12:10:14.604596  6238 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:14.634828  4943 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:14.598057  5568 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:14.653614  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 55637.4us
I20260709 12:10:14.654426  5568 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:14.650295  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:14.640712  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:14.573743  7104 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:14.639537  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45258.1us
I20260709 12:10:14.573630  7065 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.609308  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:14.672163  6293 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.650712  5018 raft_consensus.cc:2393] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:14.656087  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:14.610060  5016 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.622918  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:14.657469  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:14.656106  4872 raft_consensus.cc:2410] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:14.661268  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.661746  4915 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:14.656769  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.662505  6238 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.595435  7023 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.728554  6238 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.729043  4873 raft_consensus.cc:2410] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:14.646696  6995 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.649766  7010 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:14.649915  7071 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:14.676647  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.607393  7073 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:14.605072  7021 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.646090  7039 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.730867  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.649243  7014 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.730355  5019 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:14.604143  7062 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 12:10:14.777280  6902 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.645742  7022 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:10:14.731148  7023 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.784186  5604 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:14.790148  7080 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:14.791663  6936 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:14.730993  7075 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:14.667927  7065 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.660212  7120 raft_consensus.cc:697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:14.664451  7013 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:14.676272  5598 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:14.821204  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:14.730551  7083 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:14.842805  4945 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:14.919440  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.844761  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:14.734406  7104 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.921032  7104 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:14.892379  7039 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.923049  7104 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:14.847106  4872 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:14.600411  7119 consensus_queue.cc:1059] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:10:14.893795  7014 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.925259  7119 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:14.925627  7119 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:14.896308  7023 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.926432  7119 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.664012  7078 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.927650  7078 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:14.928026  7078 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.595542  7024 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:10:14.928730  7024 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:14.929124  7024 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:14.892753  7073 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:14.929878  7024 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:14.850304  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 419383us
I20260709 12:10:14.930787  7073 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.931852  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.932895  7083 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:14.912356  7075 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:14.849462  7071 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:14.898684  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.900198  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:14.889113  7045 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.927258  7120 consensus_queue.cc:237] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:14.849602  6995 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:14.896436  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 241244us
I20260709 12:10:14.971247  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:14.932889  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:15.030344  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.034672  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:15.034214  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.028281  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:15.028330  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:15.036310  5604 raft_consensus.cc:2393] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:15.036509  4945 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.043884  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:15.044528  4874 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:15.047773  4942 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.950837  7052 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.048643  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:14.923187  7039 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:15.050848  4874 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:14.964562  7104 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:15.031224  7024 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.031350  7119 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.966835  7103 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:14.976433  7075 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:14.964443  7083 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:15.054463  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 392751us
I20260709 12:10:15.055749  7020 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.056618  7010 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:15.058627  7012 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:15.059947  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 174) took 1169 ms. Trace:
I20260709 12:10:15.062954  6238 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:15.088696  6238 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.063651  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.089134  4868 raft_consensus.cc:2410] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:15.051057  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:15.074812  4949 raft_consensus.cc:2393] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:15.076995  4942 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.077750  4951 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:15.079517  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:15.080034  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.087915  4950 rpcz_store.cc:276] 0709 12:10:13.890303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.001477 (+111174us) service_pool.cc:224] Handling call
0709 12:10:14.001735 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.001900 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:14.103153 (+101253us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.046356 (+943203us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.059634 (+ 13278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.059682 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:15.059729 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.059786 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.059890 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54254,"prepare.queue_time_us":286436,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":13121,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":998633,"threads_started":3,"wal-append.queue_time_us":790389}
I20260709 12:10:15.091472  4874 raft_consensus.cc:2368] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5.
W20260709 12:10:15.091634  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.092047  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.094373  6238 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:15.080454  4945 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:15.085245  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.093946  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:15.076985  6849 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:15.089941  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:15.081323  7039 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.086697  4841 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:15.095492  4915 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.102784  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:15.096827  7010 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.086688  7014 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:15.110814  4872 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:15.115371  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:15.120466  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.122395  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.109057  6902 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.113416  7039 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.081090  7104 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.130702  4988 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:15.131183  7118 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:15.135691  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:15.143194  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:15.151782  4839 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:15.138288  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:15.152583  5019 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:15.113178  6849 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.139261  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.157279  5016 raft_consensus.cc:2393] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:15.140056  5024 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.158354  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:15.158898  5024 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:15.159619  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.160125  5024 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.142799  4875 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:15.143985  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:15.147071  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.162462  7062 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.162949  7062 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:15.163741  7062 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:15.164932  7147 log.cc:927] Time spent T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:10:15.134016  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:15.150430  4876 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.153414  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.167127  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.138924  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:15.113628  7037 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.098631  7020 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.164052  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:15.184607  5021 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.008s	sys 0.039s
I20260709 12:10:15.138832  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.142498  7077 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.167845  5020 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:15.168833  4874 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:15.151357  7014 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.171753  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:15.112016  7103 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.172523  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.156085  6902 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.174500  4945 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.195784  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:15.196846  4874 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.197152  4874 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:15.197597  4945 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:15.176478  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.178378  4915 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:15.171483  7037 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:15.183727  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.135156  7015 raft_consensus.cc:2764] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:15.081612  7071 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.167755  5022 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:15.186820  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.163677  7154 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:15.188027  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:15.189043  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.163998  6936 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:15.169896  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:15.189915  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.222973  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:15.192814  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.194306  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:15.197949  4874 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.166016  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:15.120028  7075 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:10:15.225292  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.225986  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.226531  5020 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.227197  4867 raft_consensus.cc:2410] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:15.216640  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 177649us
I20260709 12:10:15.217864  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.228827  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.229496  5022 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 4: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:15.217088  5018 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.199193  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.203491  5024 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:15.155864  7080 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:10:15.162961  7153 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:15.215804  7037 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.230975  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:15.236702  5024 raft_consensus.cc:2410] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:10:15.233127  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 80593.5us
I20260709 12:10:15.252121  5018 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:15.254817  5020 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:15.193656  7054 consensus_queue.cc:1059] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:10:15.238296  4915 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:15.222164  6936 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:15.267154  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.221167  7014 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:10:15.273012  4915 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:15.249236  6902 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.261590  7155 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.277455  5024 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:15.261307  6995 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:15.219762  7013 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:15.285080  5020 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.238432  7015 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:15.280489  6902 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:15.275209  7080 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.277592  7153 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:15.298547  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1109) took 1202 ms. Trace:
I20260709 12:10:15.321270  4944 rpcz_store.cc:276] 0709 12:10:14.096502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.152259 (+ 55757us) service_pool.cc:224] Handling call
0709 12:10:14.152533 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.158215 (+  5682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.158244 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.158664 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.478276 (+319612us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b18001da5e0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a0d1 00007f2a5a8a5a0f
0709 12:10:14.890120 (+411844us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:14.892086 (+  1966us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.057166 (+165080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.057230 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.283237 (+226007us) raft_consensus.cc:1685] finished
0709 12:10:15.298356 (+ 15119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.298485 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172950,"prepare.queue_time_us":1700,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":170651,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":9263,"spinlock_wait_cycles":18713472,"thread_start_us":411666,"threads_started":1,"wal-append.queue_time_us":916358}
I20260709 12:10:15.278192  7109 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:15.323400  6902 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.326330  7104 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:15.327463  7052 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.327836  7052 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:15.328212  7052 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.329200  4947 raft_consensus.cc:2410] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:15.284873  7155 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:15.337918  4947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2058) took 2201 ms (client timeout 2899 ms). Trace:
W20260709 12:10:15.341665  4947 rpcz_store.cc:269] 0709 12:10:13.136747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.447029 (+310282us) service_pool.cc:224] Handling call
0709 12:10:15.337728 (+1890699us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540032d054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:15.337858 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4326349184}
I20260709 12:10:15.340756  4874 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.337565  6902 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.301550  6995 raft_consensus.cc:3055] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.322897  7080 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:15.324000  7153 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:15.350580  6995 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:15.353994  7078 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.369747  7153 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.370831  7078 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:15.371068  7153 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.356071  7037 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.373860  7037 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:15.374233  7152 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:10:15.374396  7037 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.375082  7037 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.375382  7037 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:15.375694  7037 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.371759  6995 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.377355  6995 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.357594  4874 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:15.333216  7028 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.358104  7013 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.346253  7155 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.334487  7109 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:15.360158  6902 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:15.368614  5599 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.333899  6936 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.387075  7039 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:15.424378  6238 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:15.427763  5603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.001s	sys 0.017s
W20260709 12:10:15.428105  5603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.001s	sys 0.017s
W20260709 12:10:15.431455  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 269548us
I20260709 12:10:15.431689  7168 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:15.432250  7168 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:15.433647  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 290507us
W20260709 12:10:15.435627  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 280054us
W20260709 12:10:15.436913  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 258465us
W20260709 12:10:15.437637  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 288006us
I20260709 12:10:15.450884  7161 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:15.452708  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:15.453455  7165 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.459576  7165 consensus_queue.cc:1059] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:15.462056  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:15.462368  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.462700  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.461943  7039 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:15.464155  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.464534  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:15.465256  7156 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:15.465410  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:15.466264  7156 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:15.466624  7156 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:15.467231  7165 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:15.467849  7165 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:15.467411  7156 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.468926  7156 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.468907  7165 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.470536  7165 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:15.477669  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 204721us
I20260709 12:10:15.478463  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:15.485952  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.486543  4942 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:15.488771  4872 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.478396  4915 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.382573  7028 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.418159  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:15.389099  7080 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.412590  6849 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:15.502461  4991 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:15.504796  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.504990  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:15.517791  4948 raft_consensus.cc:2410] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:10:15.521080  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 334775us
I20260709 12:10:15.505599  7021 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.506912  6936 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:15.535943  7014 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.514469  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:15.528997  4839 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:15.505818  7166 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:15.540663  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 373935us
I20260709 12:10:15.527179  7039 raft_consensus.cc:2764] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:15.502650  7065 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.528224  7080 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.525336  7044 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:10:15.568384  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 63540us
I20260709 12:10:15.573338  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:15.569161  4915 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.578366  4915 leader_election.cc:400] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4.
I20260709 12:10:15.579020  7168 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:15.581104  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:15.589392  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 85373.7us
I20260709 12:10:15.597461  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.582562  7021 raft_consensus.cc:3055] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.584044  7010 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.513027  7109 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.576210  7071 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:15.610298  6293 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:15.611061  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.611574  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:15.574733  7181 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
W20260709 12:10:15.664278  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 85154.2us
I20260709 12:10:15.695123  4915 leader_election.cc:400] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5.
I20260709 12:10:15.695492  4915 leader_election.cc:403] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.613984  4839 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:10:15.695916  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 84460.2us
W20260709 12:10:15.695199  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.600447  6895 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:15.697607  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.701428  6293 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.701781  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:15.702427  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 88613.6us
I20260709 12:10:15.706169  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.709890  6293 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:15.686827  7119 consensus_meta.cc:287] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
W20260709 12:10:15.649329  7172 log.cc:927] Time spent T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:15.713754  4943 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:15.646207  7028 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:15.607861  7021 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:15.711766  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.733485  5603 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.644678  7193 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.697253  7103 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:15.800526  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 86029.9us
I20260709 12:10:15.805943  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 2145) took 1288 ms. Trace:
W20260709 12:10:15.819360  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 124383us
I20260709 12:10:15.819928  4870 rpcz_store.cc:276] 0709 12:10:14.517330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.557244 (+ 39914us) service_pool.cc:224] Handling call
0709 12:10:15.800103 (+1242859us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54002b5cd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:15.805868 (+  5765us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946418560}
I20260709 12:10:15.714154  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:15.700981  6895 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:15.701086  7071 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:15.711851  7120 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.714619  7066 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:15.822597  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.824038  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 112338us
I20260709 12:10:15.831079  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:15.698019  7010 consensus_queue.cc:1059] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.120s
I20260709 12:10:15.832209  6293 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:15.832621  4840 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.832664  6293 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:15.832405  4915 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:15.835582  5570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.747s (SENT) [suppressed 55 similar messages]
I20260709 12:10:15.817444  7109 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.799682  7118 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:15.830353  7164 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:10:15.818970  7103 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.835194  7197 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5.
I20260709 12:10:15.827808  5602 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:15.898061  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:15.828825  7073 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.825438  7191 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:15.901598  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:15.903976  7020 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:15.904376  7020 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.904695  7020 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.827137  6895 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:15.881318  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 48971.6us
I20260709 12:10:15.888742  7193 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:15.844559  7065 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:15.915542  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:15.877454  7120 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.885797  7103 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.845976  6293 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.918210  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:15.919091  4948 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.912753  7020 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.927687  6238 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:15.929832  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.933995  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:15.936156  5025 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:15.936506  5025 pending_rounds.cc:85] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 2
I20260709 12:10:15.936723  5025 pending_rounds.cc:107] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:15.936970  5025 raft_consensus.cc:2889] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:15.940474  4948 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:15.940692  4951 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:15.942921  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 110365us
I20260709 12:10:15.946760  7020 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:15.947736  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:15.947943  7188 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 12:10:15.948482  7187 log.cc:927] Time spent T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 12:10:15.918776  7193 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:15.953286  7192 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:10:15.880890  7021 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.953446  7083 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:15.923189  7071 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:15.954046  7062 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:15.966478  5021 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:10:15.935745  7175 log.cc:927] Time spent T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
W20260709 12:10:15.968976  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 133409us
I20260709 12:10:15.900465  7191 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:15.932677  7039 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.938174  7168 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:15.955610  7065 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.955057  7073 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:15.927157  7198 consensus_queue.cc:1059] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:10:15.967582  7193 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.973042  5602 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.070415  5025 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:10:16.007529  7182 log.cc:927] Time spent T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 12:10:16.073580  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:16.083101  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:16.083747  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:16.084088  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:16.084414  5016 raft_consensus.cc:2368] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5.
I20260709 12:10:16.087688  4944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:16.088249  4944 raft_consensus.cc:606] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:16.088557  4944 raft_consensus.cc:614] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:16.078393  7021 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.101495  4840 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.072266  7207 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:16.107812  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:16.099680  7023 consensus_meta.cc:287] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 1.066s	user 0.008s	sys 0.002s
I20260709 12:10:16.115099  4840 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.069584  7065 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.118793  4915 leader_election.cc:400] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5.
I20260709 12:10:16.119086  4915 leader_election.cc:403] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:10:16.125562  7190 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:10:16.125774  7169 consensus_queue.cc:1059] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:16.126529  7169 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.126857  7169 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:16.127308  7189 log.cc:927] Time spent T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:10:16.117869  7120 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.101260  7039 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.135058  7039 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.129226  7044 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:10:16.134204  7014 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.110674  7083 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:16.115996  7195 log.cc:927] Time spent T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:10:16.149860  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:16.126641  7194 log.cc:927] Time spent T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 12:10:16.150805  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:16.118506  7174 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:16.157819  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.152724  7075 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:16.154763  7197 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.163467  7174 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:16.176079  5602 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:16.127574  7169 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.159564  7157 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.168097  7028 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.121734  7023 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.186647  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.189411  5021 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:16.189759  5021 pending_rounds.cc:85] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 2
I20260709 12:10:16.113023  7207 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.187937  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.191670  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.192387  4870 raft_consensus.cc:2410] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:16.185714  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.186299  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.189692  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.190196  5021 pending_rounds.cc:107] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:16.186781  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.190750  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.153721  7109 consensus_queue.cc:1059] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:16.206840  5021 raft_consensus.cc:2889] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:16.193434  4872 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:16.160543  7178 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.155059  7014 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.209066  5021 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.156142  6895 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:16.209599  4873 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:10:16.209836  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 105617us
W20260709 12:10:16.210171  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.006s	sys 0.010s
W20260709 12:10:16.211319  7052 consensus_meta.cc:287] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.883s	user 0.008s	sys 0.001s
I20260709 12:10:16.211246  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.211930  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.278308  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:16.278796  4872 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.279093  4872 raft_consensus.cc:614] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:16.214802  7207 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.212734  7203 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:16.285698  7197 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5.
I20260709 12:10:16.213785  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.290668  4868 raft_consensus.cc:2376] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5. Re-sending same reply.
I20260709 12:10:16.214735  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.291774  4876 raft_consensus.cc:2410] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:16.215721  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 196) took 7261 ms. Trace:
I20260709 12:10:16.216547  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.293403  4870 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:16.216869  7045 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.217533  7012 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:16.190352  7028 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.280516  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.219727  7065 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.221673  7191 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.222190  7109 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:16.225302  7153 consensus_meta.cc:287] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.000s
I20260709 12:10:16.225754  6238 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:16.305553  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.305405  6238 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.227262  7023 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.227794  5019 raft_consensus.cc:2368] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6.
I20260709 12:10:16.204689  7119 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:16.232163  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.193837  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.234807  5023 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.216476  4875 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.235289  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.267580  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1051) took 1121 ms. Trace:
I20260709 12:10:16.281410  7052 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.266892  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.309744  5018 rpcz_store.cc:276] 0709 12:10:15.145943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.252963 (+107020us) service_pool.cc:224] Handling call
0709 12:10:15.253265 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:15.301221 (+ 47956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.301252 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:15.323093 (+ 21841us) log.cc:844] Serialized 52 byte log entry
0709 12:10:15.599242 (+276149us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.972250 (+373008us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.972494 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.972561 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.267375 (+294814us) raft_consensus.cc:1685] finished
0709 12:10:16.267394 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.267525 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71170,"prepare.queue_time_us":336078,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":50522,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":46149,"thread_start_us":630047,"threads_started":2,"wal-append.queue_time_us":310533}
W20260709 12:10:16.315428  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 48647.5us
I20260709 12:10:16.316457  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.317515  4991 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.317941  4876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:16.211997  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.318492  4876 raft_consensus.cc:606] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
W20260709 12:10:16.280897  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.006s	sys 0.010s
W20260709 12:10:16.319166  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 729125us
I20260709 12:10:16.237854  7039 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.282233  5017 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:16.188578  7157 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:16.292168  4770 rpcz_store.cc:276] 0709 12:10:09.016922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.023593 (+  6671us) service_pool.cc:224] Handling call
0709 12:10:16.215660 (+7192067us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:13.371836 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:13.687963 (+316127us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:13.690874 (+  2911us) write_op.cc:435] Acquired schema lock
0709 12:10:13.693333 (+  2459us) tablet.cc:662] Decoding operations
0709 12:10:13.888593 (+195260us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:13.893101 (+  4508us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:13.893132 (+    31us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:10:13.894666 (+  1534us) tablet.cc:701] Row locks acquired
0709 12:10:13.894686 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:10:13.894825 (+   139us) write_op.cc:270] Start()
0709 12:10:13.894958 (+   133us) write_op.cc:276] Timestamp: P: 1783599013894778 usec, L: 0
0709 12:10:13.894985 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:10:13.915252 (+ 20267us) log.cc:844] Serialized 8513 byte log entry
0709 12:10:14.285359 (+370107us) op_driver.cc:464] REPLICATION: finished
0709 12:10:14.423898 (+138539us) write_op.cc:301] APPLY: starting
0709 12:10:14.425660 (+  1762us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:14.431770 (+  6110us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:14.431901 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:14.434140 (+  2239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:14.434402 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:10:14.434445 (+    43us) write_op.cc:312] APPLY: finished
0709 12:10:14.434768 (+   323us) log.cc:844] Serialized 145 byte log entry
0709 12:10:14.435471 (+   703us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.435634 (+   163us) write_op.cc:454] Released schema lock
0709 12:10:14.435690 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:14.436030 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:14.436055 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1292,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":87301,"apply.run_cpu_time_us":4264,"apply.run_wall_time_us":47975,"num_ops":21,"prepare.queue_time_us":299111,"prepare.run_cpu_time_us":15136,"prepare.run_wall_time_us":615511,"raft.queue_time_us":177752,"raft.run_cpu_time_us":4147,"raft.run_wall_time_us":26969,"replication_time_us":390246,"thread_start_us":404467,"threads_started":4,"wal-append.queue_time_us":109005,"wal-append.run_cpu_time_us":24429,"wal-append.run_wall_time_us":1411445}]]}
I20260709 12:10:16.218746  7169 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.295209  7045 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:16.271993  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:16.323076  5025 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.312878  7119 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:16.312350  7211 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:10:16.306977  7109 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:16.313097  6995 consensus_meta.cc:287] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.926s	user 0.006s	sys 0.003s
I20260709 12:10:16.337694  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:16.301721  7103 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.274466  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.311465  6238 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.329248  4947 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.305951  5602 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:16.327785  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.325656  6293 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:16.343694  6293 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.334846  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.344789  4874 raft_consensus.cc:2376] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4. Re-sending same reply.
I20260709 12:10:16.335493  5025 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:16.324980  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:16.313791  6936 consensus_meta.cc:287] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.774s	user 0.006s	sys 0.003s
I20260709 12:10:16.349380  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.316787  7197 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.337790  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:16.341668  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 67262.8us
I20260709 12:10:16.317340  7207 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:16.346282  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:16.321527  7023 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.347363  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.347709  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.323189  7153 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.347267  4917 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.359319  4917 leader_election.cc:400] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5.
I20260709 12:10:16.299890  7174 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.294555  7216 consensus_queue.cc:1059] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:16.349074  6238 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.349656  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:16.340507  7037 consensus_meta.cc:287] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.964s	user 0.011s	sys 0.000s
I20260709 12:10:16.354377  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:16.355221  5025 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:16.352429  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.356143  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:16.348927  7154 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:16.363247  4873 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:16.366401  4869 raft_consensus.cc:606] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.360486  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.367580  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:16.367903  6238 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.367957  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.369606  4869 raft_consensus.cc:614] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:16.351271  7039 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.354013  6902 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:16.357921  7118 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:16.378618  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.381628  4991 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.364710  7206 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.382921  6238 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.383916  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.385325  4875 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:10:16.367204  6936 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:16.370666  7161 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.390947  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:16.369874  7023 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.393235  4991 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.370729  7014 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.372676  7173 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:16.412147  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.413177  4871 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:16.362877  7207 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.364387  7020 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:10:16.417928  4917 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.418515  4871 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.364635  7219 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:10:16.404471  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:16.358109  7197 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.378018  7191 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.413618  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.400285  7062 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:16.416342  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.380312  7012 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.378273  6739 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:16.404445  6238 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.429226  6238 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:16.419644  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.430308  4991 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.380281  6895 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.420784  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.437412  4871 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:16.438186  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.438758  4871 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:16.391882  7153 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.371846  7037 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.396329  7054 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:16.415589  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47702us
I20260709 12:10:16.427593  4869 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:16.431470  6995 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.432045  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:16.414213  7071 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.443192  4871 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.420509  7044 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.423429  7023 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:16.445645  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.368940  7045 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.442414  6238 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.388525  7109 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.388259  7118 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.372745  7157 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.398567  6936 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.422765  7206 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:16.466177  7206 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:16.450129  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:16.464835  7062 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:16.448796  7014 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.470531  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:16.471153  5023 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:16.472344  5023 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:16.441736  7153 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:10:16.461547  7223 log.cc:927] Time spent T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:10:16.420296  7173 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.457250  7023 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.457036  7028 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.449018  7071 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:16.459828  7171 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:16.457621  7012 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.466648  7206 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:16.443027  6739 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.487707  5023 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:16.480592  7109 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.442471  7193 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.461328  7203 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 12:10:16.486022  7080 consensus_meta.cc:287] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.920s	user 0.010s	sys 0.000s
I20260709 12:10:16.486666  7071 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.511854  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.494833  5023 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:16.504257  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:16.477304  7153 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.469245  7052 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.514341  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:16.486446  6936 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.516716  4871 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:16.486783  7119 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:16.506980  7155 consensus_meta.cc:287] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 1.117s	user 0.009s	sys 0.001s
I20260709 12:10:16.473780  7228 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:16.491582  7023 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:16.493892  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 52644.3us
I20260709 12:10:16.532899  4991 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.493532  7103 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.531415  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:16.537190  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:16.537766  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.539718  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.540869  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.543613  7065 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:16.493625  7171 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.489403  7224 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:16.550756  7022 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.553103  7207 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.531997  6902 consensus_queue.cc:1059] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:16.518739  7044 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:16.518697  7021 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:16.556749  4991 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:16.565954  6238 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:16.566326  6238 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.501722  7028 consensus_queue.cc:1059] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:16.560019  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.566642  6238 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.568032  7028 raft_consensus.cc:3055] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.568393  7028 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:16.569132  7028 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:16.543911  7227 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:10:16.543619  6936 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:16.574796  6238 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.578567  5599 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:16.578696  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:16.579715  7037 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.563606  7054 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.580655  6238 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.563831  7022 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:16.582638  7224 consensus_queue.cc:1243] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:16.583861  7014 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.585408  7193 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.590821  4841 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.595932  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.580273  7153 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.599372  7232 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.557920  7206 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:16.600889  7206 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.601579  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.608623  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.606946  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:16.611245  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.611922  5603 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:16.565409  7044 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:16.581089  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.613538  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:16.565635  7021 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.618613  4944 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:16.620522  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.621503  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:16.622488  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:16.623360  4948 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.634119  4943 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:16.536304  7155 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.624442  4945 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:16.529500  7062 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.641726  5022 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.626173  6739 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.626431  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:16.627782  5019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 1052) took 1481 ms (client timeout 1809 ms). Trace:
I20260709 12:10:16.565013  7233 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.645670  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:16.630048  4950 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:16.647312  5019 rpcz_store.cc:269] 0709 12:10:15.146183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.166917 (+ 20734us) service_pool.cc:224] Handling call
0709 12:10:16.627602 (+1460685us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003cd554. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:16.627730 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437825408}
I20260709 12:10:16.623466  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:16.633299  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:16.609738  7028 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.637776  4988 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:16.625319  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:16.651633  4949 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.591531  7109 consensus_queue.cc:1059] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:16.597098  7171 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.651659  6238 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.629580  7044 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.626456  7153 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.630527  6902 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:16.657585  5020 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:10:16.636585  7021 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.654541  7224 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.661682  7155 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:16.659374  7230 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:16.664031  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:16.668068  7071 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.676702  7071 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.676916  6902 raft_consensus.cc:697] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:16.678798  6902 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.684906  7173 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.680116  7224 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.691116  7224 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.682029  7157 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.699299  7199 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.700371  7199 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:16.701331  7199 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.702613  7199 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.702905  7045 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.697613  7023 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.705242  7197 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.706737  7023 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.710156  7044 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.711565  7201 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.711934  7201 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:16.712628  7201 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.713773  7201 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.718324  7181 raft_consensus.cc:3055] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:16.718709  7181 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:16.724134  7181 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.725379  7181 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:16.766958  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.766743  4872 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:16.773125  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 167777us
I20260709 12:10:16.779731  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.782406  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.788331  4840 leader_election.cc:400] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6.
I20260709 12:10:16.788538  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.783839  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:16.789644  4873 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.712620  7021 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.794863  7044 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.797598  7023 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:16.798794  7023 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.805680  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.806691  4870 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:16.807634  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.808321  4870 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.821269  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:16.821966  7155 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:16.822536  5601 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:16.823330  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:16.824476  5017 raft_consensus.cc:2368] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6.
I20260709 12:10:16.822321  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:16.813445  7083 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:16.839740  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 211036us
I20260709 12:10:16.845342  7123 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:16.845279  4871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:16.847026  4871 raft_consensus.cc:606] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.847297  7154 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.847838  7154 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:16.848423  4869 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.849534  7154 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.850250  7039 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:16.850924  7154 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.851166  7039 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.853132  7224 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.853991  7224 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.859081  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 208) took 1410 ms. Trace:
I20260709 12:10:16.859373  7023 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.859608  4870 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:16.795481  7062 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:16.860574  7062 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.863071  7062 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.864596  5024 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:16.856550  7224 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.865622  4867 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:16.873780  4947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1138) took 1153 ms. Trace:
I20260709 12:10:16.879560  7155 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.881881  7155 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.882228  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.882696  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:16.872571  7021 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.883831  7109 consensus_queue.cc:1059] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:16.885492  7109 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:16.888159  7232 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.888654  7232 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:16.889899  7232 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.891283  7232 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.883450  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:16.865942  5020 rpcz_store.cc:276] 0709 12:10:15.448243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.448945 (+   702us) service_pool.cc:224] Handling call
0709 12:10:15.449237 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.662471 (+1213234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.858610 (+196139us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54004001d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:16.858923 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778362240}
I20260709 12:10:16.876230  4947 rpcz_store.cc:276] 0709 12:10:15.712350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.712462 (+   112us) service_pool.cc:224] Handling call
0709 12:10:15.712727 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.341308 (+628581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.841794 (+500486us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b540007b054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:16.866073 (+ 24279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417489280}
W20260709 12:10:16.902226  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 111979us
I20260709 12:10:16.904317  5602 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.883482  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.906108  6890 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:16.907279  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 316484us
I20260709 12:10:16.906119  5604 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:16.918190  7120 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:16.927032  4949 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:16.929657  7255 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:16.930341  7039 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:16.930855  7217 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:16.931530  7217 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.932443  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:16.932823  5601 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:16.930877  7255 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.935704  7255 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:16.937623  7255 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.939642  7255 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.941635  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c480da15ff054400bdd09744d494717c"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:16.942291  4867 raft_consensus.cc:606] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.944485  7073 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.944927  7073 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:16.937562  7157 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.952852  7157 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:16.954315  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.955476  7157 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.957206  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.958307  6936 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.959013  4841 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:16.959462  5023 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:16.960673  6936 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.942764  4867 raft_consensus.cc:614] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:16.967199  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 50066.5us
I20260709 12:10:16.969290  7073 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:16.970312  6293 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:16.971086  7073 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.972869  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:16.927656  7012 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.981228  7012 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:16.983541  7012 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:16.989392  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:10:16.990478  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 144043us
I20260709 12:10:16.992576  7123 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:16.993499  7123 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.993880  7123 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:17.002861  7123 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.004375  7123 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.010015  4873 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:17.011631  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.015049  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.015858  7039 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:17.017836  7262 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.020088  7039 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.020212  7262 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.022294  7039 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.022466  7262 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.018118  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.025278  4946 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:17.011886  7155 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:17.029699  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:17.031812  4988 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.036213  7039 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:17.037088  7039 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:17.025331  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.048051  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:17.049379  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:17.050348  4943 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:17.039726  7217 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.019546  7118 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.052019  4945 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:17.054595  4947 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:17.054975  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.055817  7155 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.056538  7155 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.059734  7155 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.060354  4840 leader_election.cc:400] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6.
I20260709 12:10:17.060685  4840 leader_election.cc:403] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:17.059731  6895 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:17.062270  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:17.063117  5603 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:17.067184  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:17.055945  6739 raft_consensus.cc:3055] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.069638  6739 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:17.069924  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:17.070132  6293 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.053755  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.071053  5017 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:17.077597  4947 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:17.077868  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:17.081153  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.053290  5602 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
W20260709 12:10:17.085983  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.089946  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:17.090478  5017 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.094228  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.096920  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:17.097163  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.098181  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.098366  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.100521  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.101540  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.102329  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.102491  7157 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:17.102947  7157 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.103402  7157 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.100193  4773 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 1 to 4, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:17.105386  5019 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:17.105609  4773 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 3 to 4, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 4 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:17.106612  7155 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:17.108055  7155 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:10:17.109450  7267 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:17.102905  7120 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:17.109166  7155 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.114472  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:17.115463  7118 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.115680  7224 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.117123  7039 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.114094  6739 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.119621  6739 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.127537  4951 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:17.122742  4773 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 2 to 3, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:17.129462  4773 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 3 to 4, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } }
I20260709 12:10:17.131786  4773 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 1 to 2, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:17.122195  4917 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:17.085340  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:17.123576  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.123974  7118 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:17.136533  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:17.137192  5023 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.125764  4946 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.126663  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:17.138315  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 63241.5us
I20260709 12:10:17.121030  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.136572  7199 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.137249  7118 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.140525  7118 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.141786  7203 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:17.142899  7203 consensus_queue.cc:1243] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:17.143425  7203 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:17.143836  7203 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:17.141958  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:17.144555  5025 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.144848  7203 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.146024  7203 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.120954  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:17.143047  5021 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:17.139077  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:17.152998  5025 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:17.153613  5023 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:17.157662  5017 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:17.127532  6293 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6.
I20260709 12:10:17.157449  7199 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:17.159825  7199 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.165903  7233 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.167557  7120 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:17.167929  7120 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.168257  7120 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:17.181228  5021 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:17.187592  4943 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:17.191808  5023 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.181108  7157 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.199249  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:17.208943  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 143758us
I20260709 12:10:17.210415  4915 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.211678  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.198143  7118 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.218703  7118 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.219748  7045 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.221215  5021 raft_consensus.cc:2368] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7.
I20260709 12:10:17.222170  7157 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.222968  5022 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.223920  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:17.224323  4915 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.224457  5605 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.221091  7044 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.218703  4945 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:10:17.230180  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 109355us
I20260709 12:10:17.231242  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.233686  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.234325  4948 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:17.233966  7181 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:17.234947  7181 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:17.236088  4915 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:17.220752  7118 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.237193  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.228977  7044 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:17.248615  4870 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:17.250181  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.255600  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.256798  4874 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:17.257813  4991 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:17.258173  4945 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:17.250768  7044 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.276520  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.282212  4951 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:17.255695  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.281119  4948 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:17.237844  7217 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:10:17.285048  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.283274  4948 pending_rounds.cc:85] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 3
I20260709 12:10:17.287483  4948 pending_rounds.cc:107] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:17.287890  4948 raft_consensus.cc:2889] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:17.288141  4943 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:17.287897  7170 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.247731  7181 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.290751  7023 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.291154  7023 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:17.291502  7023 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.293419  4839 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.294625  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:17.295728  4839 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.285120  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:17.290283  7170 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:17.297348  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.287498  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:17.299189  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 67038.4us
I20260709 12:10:17.300683  6293 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:17.302461  4759 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica baa50eb5ed704004b7f391934a59d010 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:17.303349  7170 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.305183  7228 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.305576  7228 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:17.306021  4945 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:17.306529  7228 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.307977  7228 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.300884  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.310804  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.299090  7118 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.296676  6739 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:17.318832  7044 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.322947  4988 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:17.301890  6895 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.333726  7224 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:17.335026  7224 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.286278  7120 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.337174  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.337924  7120 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.308602  7012 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.340550  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.340744  7012 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:17.341202  7153 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.341744  7153 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.342787  4874 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:17.343811  7153 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.345533  4870 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:17.346148  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.346331  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.346735  4876 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:17.343752  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.352103  4839 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.353621  5605 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:17.354418  4875 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:17.355269  4869 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.355417  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.355566  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.356024  5019 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:17.359606  7233 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:17.360111  7233 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:17.361042  7233 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.365998  4869 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:17.367045  4840 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.368433  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.369156  6293 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:17.360992  5017 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:17.371143  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.371644  4873 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 6: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:17.341213  7012 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.374415  4840 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.378113  6293 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.378496  6293 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.378796  6293 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.378314  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:17.380764  4839 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.396860  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:17.346328  7044 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.355237  6739 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:17.400102  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.400548  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.373914  6895 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.417759  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.480937  4875 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.460028  4873 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:17.403218  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:10:17.482729  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 79577.9us
I20260709 12:10:17.494398  4869 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:17.496856  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.497841  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:10:17.405367  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.494678  7120 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:17.416229  7275 log.cc:927] Time spent T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 12:10:17.429069  7224 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.511906  4871 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:17.415964  7153 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.416370  7065 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.417490  7103 raft_consensus.cc:993] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
W20260709 12:10:17.514575  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 96896.5us
I20260709 12:10:17.408221  7203 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:17.416518  7234 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.143s
I20260709 12:10:17.523366  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.416785  7201 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.417188  7118 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.513360  7157 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.416653  7231 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.151s
I20260709 12:10:17.530916  7224 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.551785  6293 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.537353  7153 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:17.542150  7199 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:17.580333  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 61238.9us
I20260709 12:10:17.534402  7203 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:17.585548  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 262668us
I20260709 12:10:17.587198  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:17.587805  4943 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:17.586920  4988 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:17.552634  7255 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:17.540102  7120 raft_consensus.cc:1081] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:17.594748  6293 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.417673  7232 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
W20260709 12:10:17.592728  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 76786.7us
I20260709 12:10:17.556465  7021 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.575479  7224 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.577090  7157 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.605712  4875 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:17.583096  7153 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.539059  7201 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.556277  6936 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:10:17.614995  4943 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
W20260709 12:10:17.621883  7280 log.cc:927] Time spent T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:10:17.622329  6902 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:17.622903  6902 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.607055  7118 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:17.630841  7203 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.631040  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.631639  4944 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:17.631740  5568 leader_election.cc:400] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7.
I20260709 12:10:17.634275  5568 leader_election.cc:403] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:17.605969  7157 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:17.610831  7153 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.595036  7234 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:17.633877  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:17.617956  7233 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.639539  5604 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:17.601513  7065 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:10:17.644078  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:17.645807  5603 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:17.608299  7199 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.619895  7021 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.651238  7012 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.620720  6895 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.630796  7201 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.658129  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:17.640297  7157 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.644376  7154 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7.
I20260709 12:10:17.667025  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:17.669744  4944 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.658255  7118 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.675190  7118 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.670567  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:17.679638  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.685052  5025 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.679893  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:17.689319  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.669410  7073 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:17.662194  7044 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:17.708323  7295 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.689706  7155 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:17.690412  6902 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.712754  7295 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.719324  7295 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.709863  7073 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:17.685702  6895 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.739786  7073 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.740653  6895 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.741852  7118 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.722395  5025 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:17.726748  7012 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.729465  7023 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.714869  7155 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.730078  4944 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:17.748749  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:17.750792  4945 raft_consensus.cc:2410] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:17.760317  5017 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:17.766053  7120 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.766623  7120 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.768522  7120 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.748548  7155 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.774931  7023 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.775739  7286 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.789389  7286 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.791523  7286 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.793431  7021 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.794071  7224 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.794292  7155 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.796200  7155 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.798218  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:17.798834  5602 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:17.798942  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:17.800865  5599 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:17.778636  7294 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.781574  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:17.802634  5604 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:17.781818  5603 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:17.801136  7171 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.805299  7171 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.807462  7171 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.808482  7295 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.809813  7039 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:17.811232  7153 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.814220  7103 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.814636  7103 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:17.815536  7023 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:17.816391  7023 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:17.815546  7103 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.818344  7023 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.818682  7103 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.801733  4841 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:17.821898  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 114087us
I20260709 12:10:17.819330  7023 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:17.814510  7199 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.831583  5025 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:17.820847  7170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.017s	sys 0.021s
I20260709 12:10:17.824625  7171 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:17.845535  7171 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.845916  7171 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:17.837528  7170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.017s	sys 0.021s
I20260709 12:10:17.853423  7023 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.855554  7023 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.861109  7224 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:17.861656  7224 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.863021  7157 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.863636  7224 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.865278  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.866060  5022 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:17.867697  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.868350  5021 raft_consensus.cc:2368] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
I20260709 12:10:17.834309  7153 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:17.835595  7294 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:17.842713  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.871168  5024 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:17.874538  5604 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
W20260709 12:10:17.878736  7181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.006s	sys 0.006s
I20260709 12:10:17.882409  4915 leader_election.cc:400] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
I20260709 12:10:17.884146  4915 leader_election.cc:403] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:17.881804  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:17.890064  5604 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:17.888686  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:17.890882  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.877791  7295 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:17.883957  7181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.006s	sys 0.006s
I20260709 12:10:17.891911  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:17.904923  6895 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:17.909402  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:17.913748  5025 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.888259  7203 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:17.910537  7073 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:17.882179  7157 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.891803  7153 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:17.925098  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.915833  7171 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:17.929625  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.930124  4874 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:17.930768  7171 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:17.915939  7255 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:17.932022  7255 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:17.932780  4867 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:17.933313  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.933718  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.934010  4868 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:17.934396  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.934785  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.935827  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.936657  4874 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:17.915544  7065 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.937532  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.937337  7065 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:17.938177  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:17.938702  5605 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.939296  7065 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:17.940362  4874 raft_consensus.cc:2393] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:17.934901  4871 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:17.942760  5025 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:17.940411  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.944764  5023 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:17.936797  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.947606  4867 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:17.948359  5605 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:17.949479  4841 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:17.963361  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.965313  4876 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:17.976416  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.978466  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.985162  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:17.960868  7120 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.991621  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.992594  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:17.992952  5023 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:17.994902  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:17.995493  4867 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:17.997906  5020 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:17.998202  4867 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:18.002288  7023 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:18.011380  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.015694  4840 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.016256  4871 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:17.996199  7120 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:18.020568  7065 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.021302  4840 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.021083  7155 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:18.028872  7291 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:10:18.029402  7118 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:18.029779  7118 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:18.026219  6739 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.030432  6739 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.030787  6739 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.030645  7118 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.031805  7118 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.033366  5604 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:18.035079  7155 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:18.020020  7023 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:18.037700  7023 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:18.019625  5016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:18.038838  5016 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:18.038568  7023 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.039181  5016 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.046775  4840 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.018931  7262 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.049397  7232 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.052538  7232 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.052942  7232 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.052476  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:18.060079  4991 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.026332  7065 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:18.068075  5025 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:18.084988  4874 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:18.050415  7171 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:10:18.083873  7155 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:18.116667  7155 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:18.117558  7155 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.066968  7262 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.123126  7262 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.123327  7294 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.103183  7120 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.102834  6890 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.109138  7022 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.112887  7157 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:18.126030  4840 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.131234  4868 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:18.141724  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:10:18.145058  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 253197us
W20260709 12:10:18.146817  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 258193us
I20260709 12:10:18.149461  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:18.150092  5023 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:18.163574  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.146334  6936 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.156045  7286 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.156220  7295 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:18.177205  4917 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:18.186193  5023 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:18.187197  7293 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:18.187539  7309 log.cc:927] Time spent T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:10:18.151059  7233 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:18.139596  7022 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.170969  6936 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.175730  7103 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:18.148895  6890 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:18.232270  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.180692  7295 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.168177  7157 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.186486  7286 raft_consensus.cc:697] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:18.260509  5016 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.276206  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:18.282060  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 58209.3us
I20260709 12:10:18.239084  6936 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.219347  7170 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:18.220485  7293 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:18.239923  7103 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.265998  7295 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.175130  7065 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.219583  7021 consensus_queue.cc:1059] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:10:18.315651  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:18.318614  4875 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:18.318943  4875 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:18.311851  7103 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.319619  4875 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.315758  7037 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.332103  4875 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:18.349977  7316 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:10:18.350098  4876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39302
I20260709 12:10:18.350492  7297 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.350644  4876 raft_consensus.cc:606] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:10:18.350961  7297 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.356899  7296 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:10:18.330196  6739 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.363726  4875 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:18.363214  7297 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.343555  7037 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:18.402040  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 90077.9us
W20260709 12:10:18.460914  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 147630us
I20260709 12:10:18.464474  4917 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:10:18.464916  7323 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:10:18.465355  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:18.359211  7286 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.402274  7201 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.396261  7293 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.481281  7296 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.481478  7021 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.470214  7120 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.482196  7333 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.482051  7021 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.482636  7333 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:18.483067  7333 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.482612  7120 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.481786  7044 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.484776  7044 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.485769  7021 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.488775  7044 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.486770  7157 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:18.459452  7232 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.488897  7037 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:18.531936  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:18.532528  4876 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:18.534050  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:18.535415  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:18.551668  5022 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
W20260709 12:10:18.537523  7322 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:10:18.527777  7338 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:18.538019  7170 raft_consensus.cc:3055] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:18.568967  7170 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:18.570808  7118 consensus_meta.cc:287] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.000s
I20260709 12:10:18.484200  7296 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.573119  7296 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.575258  7022 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.540230  6890 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:18.551735  5023 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:18.536782  7217 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.577673  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:18.582679  5024 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
W20260709 12:10:18.590619  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 100266us
I20260709 12:10:18.590130  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.603488  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:18.521952  7201 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.606799  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:18.578756  7233 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:18.581754  7153 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:18.603157  7338 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.581907  7039 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.611764  7023 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:18.629171  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:18.629851  4943 raft_consensus.cc:2393] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:18.629534  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:18.625665  7039 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:18.675634  7319 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:10:18.676551  7327 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:10:18.618255  7153 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.625985  7338 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:18.685288  7307 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:18.627017  7022 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.588603  7217 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.614880  7045 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:18.686902  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:18.626151  7023 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:18.631933  4948 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:18.626410  7233 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.681013  7337 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.696349  5025 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:18.707948  4943 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:18.692636  5016 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:18.757761  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:18.761597  4948 raft_consensus.cc:2393] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:10:18.681025  7339 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:10:18.763932  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 144892us
I20260709 12:10:18.764987  4876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39302
I20260709 12:10:18.765868  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:18.769465  4945 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:18.769104  4915 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.769070  4876 raft_consensus.cc:606] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:10:18.695864  7153 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:18.705340  7233 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:18.698783  7217 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.690151  7232 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.688760  6936 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.691926  7103 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:18.697249  7022 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:18.770771  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:19.019829  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 250796us
W20260709 12:10:18.783669  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.958280  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:18.987149  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 225308us
I20260709 12:10:18.700285  7023 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.027882  4951 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:19.028234  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:19.040400  4915 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:18.691210  7343 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.880467  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:19.041363  5016 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:18.926051  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:19.042204  5019 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.704450  7039 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:18.763684  7338 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:18.928272  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:18.931131  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:18.930596  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:18.699396  7045 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.080879  5602 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:19.082070  5600 raft_consensus.cc:2393] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:18.877190  7203 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:19.047123  7333 consensus_meta.cc:287] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.004s
I20260709 12:10:19.074450  7344 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:18.839766  5599 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:18.769672  7155 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.077039  7262 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.849045  7283 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:19.079773  5601 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:18.927605  7157 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:18.926211  7075 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.046440  7342 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:19.193255  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.171154  5016 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:19.083472  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:19.211583  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 177542us
I20260709 12:10:19.212435  7233 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.212872  7233 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:19.213279  7233 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.220374  7233 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:19.221993  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 138311us
W20260709 12:10:19.224978  7065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.000s	sys 0.004s
W20260709 12:10:19.225346  7065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.000s	sys 0.004s
W20260709 12:10:19.080914  7295 consensus_meta.cc:287] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.749s	user 0.008s	sys 0.000s
I20260709 12:10:18.933048  7013 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:19.235598  5019 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
W20260709 12:10:19.203161  7321 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.887s	user 0.003s	sys 0.000s
W20260709 12:10:19.233923  7294 consensus_meta.cc:287] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 1.110s	user 0.010s	sys 0.008s
I20260709 12:10:19.082643  7045 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.202183  7335 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:19.093483  7338 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.247994  4951 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:19.091898  7103 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.083913  7118 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:19.207285  7344 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.208061  7342 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.249876  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:19.090652  6936 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:19.250485  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.007s	sys 0.011s
W20260709 12:10:19.255113  4991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.030s	sys 0.078s
I20260709 12:10:19.065245  7343 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.207144  7333 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.207901  7157 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:19.261910  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.007s	sys 0.011s
W20260709 12:10:19.261973  4991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.030s	sys 0.079s
I20260709 12:10:19.260238  4950 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:19.248355  7203 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.234301  7262 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.254381  7338 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.234397  7283 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.255430  7294 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
W20260709 12:10:19.265659  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 646485us
I20260709 12:10:19.241149  7155 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.207793  7075 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.245452  7295 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.243852  7023 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.260612  7344 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.272753  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:19.278657  4875 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:19.257196  7353 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:19.322947  7353 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.262938  7335 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.325124  7353 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.249188  7013 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.325853  7335 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.326524  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2203) took 1237 ms. Trace:
W20260709 12:10:19.326853  7340 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.632s	user 0.000s	sys 0.001s
I20260709 12:10:19.284101  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.327459  4868 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:19.328027  7348 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:19.262070  7342 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.286098  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:19.328548  7348 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.329144  4950 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.286417  4951 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:19.330550  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:19.266058  7045 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:19.290237  7357 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.335665  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:19.335747  7357 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.337466  7333 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.338019  7357 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:19.283046  7022 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.292662  4947 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:19.293586  7295 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.295761  7203 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:19.298382  7358 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:19.299314  7157 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:19.300787  7343 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.301717  7039 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.301755  7233 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:19.302161  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.325598  5605 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:19.290570  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:19.384644  4870 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:19.385064  4942 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.266469  7118 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.345630  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:19.346536  7283 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:19.349520  7366 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:10:19.350176  7155 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:19.351540  4874 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:19.358227  7348 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:19.326890  4871 rpcz_store.cc:276] 0709 12:10:18.051923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.052032 (+   109us) service_pool.cc:224] Handling call
0709 12:10:18.059608 (+  7576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.068837 (+  9229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.068867 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.077556 (+  8689us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.154240 (+ 76684us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:18.154279 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.154347 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.202524 (+1048177us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:19.280111 (+ 77587us) raft_consensus.cc:1685] finished
0709 12:10:19.280130 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.289348 (+  9218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86,"raft.queue_time_us":7482,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":8192,"spinlock_wait_cycles":5949824,"thread_start_us":9272,"threads_started":1,"wal-append.queue_time_us":104905}
I20260709 12:10:19.359306  5024 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.384364  7203 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:19.323755  7023 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:19.332901  7045 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.327116  7013 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:19.360634  4915 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:19.339666  7365 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:19.421746  7365 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.422106  7021 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.422524  7021 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.422860  7021 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.423871  7365 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:19.363842  7341 log.cc:927] Time spent T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.679s	user 0.000s	sys 0.001s
I20260709 12:10:19.368672  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:19.424660  7368 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:19.370975  5601 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:19.362581  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:19.356518  4950 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:19.426362  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:19.426929  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:19.339322  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.427367  7075 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.374831  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:19.376888  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:19.428478  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51686.3us
I20260709 12:10:19.429090  4990 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:19.429896  7023 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:19.426385  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:19.430400  7023 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:19.431047  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:19.381600  7357 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:10:19.410300  7233 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.359190  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:19.414197  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:19.408841  5598 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:19.415779  7355 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:19.391861  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:19.422013  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 61447.1us
I20260709 12:10:19.391659  7039 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.425249  7368 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.378185  4839 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:19.380290  7358 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.358505  7342 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.409703  7283 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:19.431931  7364 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 12:10:19.447291  4950 raft_consensus.cc:2410] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:19.464963  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:19.281867  7338 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:19.461925  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 83807.3us
I20260709 12:10:19.463301  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:19.412066  7362 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 12:10:19.450897  7286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.006s	sys 0.010s
W20260709 12:10:19.451627  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 169134us
I20260709 12:10:19.469460  5601 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:19.445676  7231 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:19.431370  7023 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:19.466125  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 132114us
I20260709 12:10:19.450052  7333 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.421155  7203 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.470750  5019 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:19.472185  4991 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:19.475762  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.480235  4943 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:19.481387  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.482050  4875 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:19.479688  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:19.465430  7075 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:19.485628  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.487102  4991 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:19.488446  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.489241  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.489820  4869 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
W20260709 12:10:19.474467  7286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.006s	sys 0.010s
I20260709 12:10:19.492981  4871 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:19.492869  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.446038  7233 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.493744  4874 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:19.497048  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.502234  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:19.469470  7355 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:19.479333  7234 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:19.469604  7283 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.479516  7231 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.482671  7333 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.028891  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.578485  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:20.030925  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.031243  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:19.710057  7103 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:19.807325  7334 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:19.488823  7304 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.494081  7348 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.032642  7329 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:19.815213  7044 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:20.033397  7329 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.900693  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:19.561156  5020 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:19.915284  7354 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:19.543154  7153 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:20.035135  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.814003  5599 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:20.034578  7387 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:20.035482  7329 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:19.582844  7326 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 1.224s	user 0.000s	sys 0.003s
I20260709 12:10:19.778638  5024 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:19.804998  7342 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.569097  7357 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:19.594137  7233 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.036922  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1136) took 1145 ms. Trace:
I20260709 12:10:20.037551  5024 rpcz_store.cc:276] 0709 12:10:18.891079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.343974 (+452895us) service_pool.cc:224] Handling call
0709 12:10:19.359202 (+ 15228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.036670 (+677468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.036867 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:19.505265  7155 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.535s
W20260709 12:10:19.710577  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 226036us
I20260709 12:10:20.036150  7387 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:19.545413  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:19.578866  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 89438.8us
W20260709 12:10:20.041638  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 496273us
I20260709 12:10:20.042022  7329 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:20.042316  7387 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:19.503587  6895 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.541s
I20260709 12:10:20.042706  7285 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:20.044847  7355 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:19.812486  4942 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:20.044956  7285 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.044234  7329 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.045950  7228 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:19.590322  7344 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.045660  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 493) took 2004 ms. Trace:
I20260709 12:10:20.033558  7044 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.046819  4946 raft_consensus.cc:2368] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:10:20.047025  7285 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.048007  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.048740  4942 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:20.046628  5604 rpcz_store.cc:276] 0709 12:10:18.041627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.042113 (+   486us) service_pool.cc:224] Handling call
0709 12:10:18.051740 (+  9627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:18.057935 (+  6195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:18.057962 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:18.058401 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:10:18.276761 (+218360us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:18.276797 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:18.276870 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:19.503732 (+1226862us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:20.045355 (+541623us) raft_consensus.cc:1685] finished
0709 12:10:20.045379 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.045582 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5880,"raft.queue_time_us":6103,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":3305856,"thread_start_us":218044,"threads_started":1,"wal-append.queue_time_us":286015}
I20260709 12:10:19.625180  4867 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:19.802485  7296 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.505630  7037 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.031877  7283 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:19.504015  7365 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.505450  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:19.910378  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.040688  4839 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:20.032737  7334 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.048733  7329 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.012225  7039 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:19.580662  7362 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:19.904218  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:20.037168  7357 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.049256  7344 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:19.811391  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1128) took 1227 ms. Trace:
I20260709 12:10:19.813206  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1189) took 1184 ms. Trace:
I20260709 12:10:20.066959  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.059755  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:19.895119  7325 log.cc:927] Time spent T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 1.494s	user 0.000s	sys 0.002s
I20260709 12:10:20.068259  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.031759  7231 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.045496  7153 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.066299  5023 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:19.967348  7336 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:19.884224  6936 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.060935  7368 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:19.805068  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.104652  7065 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:20.105134  5017 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:20.104950  7336 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.106026  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:20.106504  5017 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.106760  7357 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.068965  5019 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.066315  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.058442  7355 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:19.589977  7045 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.040059  7348 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.038919  7333 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.042856  7387 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.068279  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:20.118119  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.118474  5016 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.118927  5025 raft_consensus.cc:2410] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:20.090742  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:20.050633  7037 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:19.817250  7294 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:19.562548  7360 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:20.035733  7385 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:20.068176  4949 rpcz_store.cc:276] 0709 12:10:18.628563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.628662 (+    99us) service_pool.cc:224] Handling call
0709 12:10:18.628915 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:19.082929 (+454014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.082957 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:19.082995 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:19.083021 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.812988 (+729967us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54002756d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:19.813030 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.813149 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043737984}
I20260709 12:10:20.061944  7296 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.035028  7354 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.101475  7203 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.032645  7103 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.101696  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.146728  5023 raft_consensus.cc:2393] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:20.115595  7155 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:20.123221  7157 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:20.103255  7384 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:20.090478  7342 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:20.062080  7365 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.104277  6936 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.105289  7381 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.595719  6739 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.043033  7304 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.133358  7385 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:20.117466  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.067917  5021 rpcz_store.cc:276] 0709 12:10:18.584008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.601527 (+ 17519us) service_pool.cc:224] Handling call
0709 12:10:18.601754 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:18.601932 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:18.609647 (+  7715us) log.cc:844] Serialized 14 byte log entry
0709 12:10:19.810962 (+1201315us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b180008ede0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a5a4924bc 00007f2a577e048b 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fa455 00007f2a5a8e2060 00007f2a5a8f4716 00007f2a5a905287
0709 12:10:19.811066 (+   104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:19.811114 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:19.811160 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:19.811223 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:19.811335 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2745,"prepare.queue_time_us":8020,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":104,"raft.queue_time_us":16422,"raft.run_cpu_time_us":7064,"raft.run_wall_time_us":127271,"spinlock_wait_cycles":3284736,"thread_start_us":16474,"threads_started":1}
I20260709 12:10:20.205051  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:20.106302  7171 raft_consensus.cc:993] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:10:20.123776  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.097410  7153 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:20.102017  7358 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.128476  5017 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:20.103479  7329 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:20.100086  4868 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:20.212721  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:20.133982  6293 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:20.067157  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.113252  7044 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.141641  5019 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:20.115408  7348 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.113222  7285 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:20.101929  7231 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.147504  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:20.150290  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 84417.7us
I20260709 12:10:20.150604  4945 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:20.201537  7203 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.220710  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:20.171497  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:20.221516  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 151523us
I20260709 12:10:20.170969  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:19.735013  7118 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:20.201303  4872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 1084) took 2191 ms (client timeout 1924 ms). Trace:
I20260709 12:10:20.124192  7355 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:20.206341  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 142381us
I20260709 12:10:20.209923  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:20.223800  4872 rpcz_store.cc:269] 0709 12:10:17.980411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.985257 (+  4846us) service_pool.cc:224] Handling call
0709 12:10:20.171425 (+2186168us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54001b2954. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:20.171566 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087389568}
I20260709 12:10:20.185791  5016 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:20.154731  7120 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.213148  4875 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:20.213379  4868 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:20.213665  6293 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.226629  4839 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:20.215224  4944 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:20.090696  7362 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.205096  7304 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.216996  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:20.208474  7297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.527s	user 0.004s	sys 0.018s
I20260709 12:10:20.064132  7283 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.217770  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.218585  5023 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 6: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:20.218719  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.201897  7233 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.220278  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.252831  5604 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:20.219472  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:19.806655  7170 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.210295  7286 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.265806  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.268260  5605 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:20.268911  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:20.269816  7021 consensus_meta.cc:287] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.847s	user 0.008s	sys 0.000s
I20260709 12:10:20.270188  7021 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.273488  7362 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.225705  7203 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.276167  7203 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.202168  7384 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.277503  4949 raft_consensus.cc:2368] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
W20260709 12:10:20.244845  7297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.563s	user 0.004s	sys 0.018s
I20260709 12:10:20.140054  7294 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.224148  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.223855  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.173305  7155 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.220402  7231 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.230399  4839 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:20.233528  6293 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.205833  7342 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:20.295397  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 65038.5us
I20260709 12:10:20.234325  7383 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:20.234436  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.234566  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.235023  7386 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:20.235178  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.301440  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.297439  4915 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:20.302125  5605 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:20.238848  7365 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.239894  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:20.241218  4947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1188) took 1612 ms. Trace:
I20260709 12:10:20.242388  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.206422  7381 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.278677  7384 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.244052  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:20.250415  4942 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:20.150070  7360 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.261453  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.263198  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.233301  7368 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.265875  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.289299  7354 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.266371  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.266906  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:20.262866  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 43479us
I20260709 12:10:20.252158  7385 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.262982  7039 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.293304  7348 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.260728  7283 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.288614  7355 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:20.272581  7338 consensus_meta.cc:287] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.800s	user 0.005s	sys 0.000s
I20260709 12:10:20.289554  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.339956  4840 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:20.290329  5599 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:20.291095  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:20.291560  7013 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.285315  7233 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.292361  7294 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.268153  7286 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:20.349223  7357 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.233469  7334 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.351794  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.272107  7021 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.293706  5568 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:20.359464  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 65855.1us
I20260709 12:10:20.340718  7120 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:20.342196  7384 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:20.222115  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 131448us
I20260709 12:10:20.295468  6293 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.360738  6293 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:20.185135  7157 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.297207  4868 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:20.361527  6293 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.361944  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.235450  7394 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.301971  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.236433  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.363458  4872 raft_consensus.cc:2368] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6.
I20260709 12:10:20.243088  5601 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:20.305974  4947 rpcz_store.cc:276] 0709 12:10:18.628301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.628389 (+    88us) service_pool.cc:224] Handling call
0709 12:10:18.694562 (+ 66173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.344910 (+650348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.240988 (+896078us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54000f14d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:20.241161 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374900096}
I20260709 12:10:20.311367  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:20.268190  7103 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.364456  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:20.243547  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.297549  7231 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.295718  7170 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:20.338343  4870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.004s	sys 0.003s
I20260709 12:10:20.223479  7285 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.301236  7386 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.340613  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.341606  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.333743  7365 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:20.343602  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 68408.4us
I20260709 12:10:20.348145  5602 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.348500  7013 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.349713  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.350416  5025 raft_consensus.cc:2368] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
I20260709 12:10:20.349316  5024 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:20.344195  7039 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:20.352468  4869 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:20.357795  7360 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.357498  7286 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.339082  7368 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:20.345742  4990 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:20.362967  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.314815  5021 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:20.301112  7383 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.349776  7357 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:20.561524  4870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.009s	sys 0.006s
I20260709 12:10:20.560600  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.369910  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2143) took 1021 ms. Trace:
I20260709 12:10:20.563975  4949 rpcz_store.cc:276] 0709 12:10:19.348338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.149708 (+801370us) service_pool.cc:224] Handling call
0709 12:10:20.369722 (+220014us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b54000f0d54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:20.369851 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126936832}
I20260709 12:10:20.430912  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:20.419893  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 108604us
I20260709 12:10:20.566821  4915 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:20.567071  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.562994  4944 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:20.561007  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:20.567870  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2142) took 1219 ms. Trace:
W20260709 12:10:20.421830  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 61036.2us
I20260709 12:10:20.562238  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1092) took 1085 ms. Trace:
I20260709 12:10:20.569219  4942 raft_consensus.cc:2393] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:20.410748  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:20.364956  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:20.424985  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39302 (request call id 73) took 1749 ms. Trace:
W20260709 12:10:20.569741  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 224059us
W20260709 12:10:20.571002  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 211004us
I20260709 12:10:20.545161  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 1108) took 1001 ms. Trace:
I20260709 12:10:20.570598  4947 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.568041  4946 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.365339  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2133) took 1019 ms. Trace:
I20260709 12:10:20.570715  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:20.572870  4988 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:20.412192  5018 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.571846  4875 rpcz_store.cc:276] 0709 12:10:19.543921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.030721 (+486800us) service_pool.cc:224] Handling call
0709 12:10:20.545003 (+514282us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54002c24d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:20.545105 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417703168}
I20260709 12:10:20.575606  4950 rpcz_store.cc:276] 0709 12:10:19.345752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.243331 (+897579us) service_pool.cc:224] Handling call
0709 12:10:20.365280 (+121949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.576998  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52376 (request call id 1211) took 1184 ms. Trace:
I20260709 12:10:20.514647  7395 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:20.365031  4872 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:20.561064  7389 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:10:20.427603  7396 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:10:20.579061  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:20.577292  4942 rpcz_store.cc:276] 0709 12:10:19.392498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.333044 (+940546us) service_pool.cc:224] Handling call
0709 12:10:20.576953 (+243909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.593525  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.570794  4876 rpcz_store.cc:276] 0709 12:10:18.686853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.708691 (+ 21838us) service_pool.cc:224] Handling call
0709 12:10:20.424673 (+1715982us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54000247a0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a867520 00007f2a5a8e4652 00007f2a5f8b260a 00007f2a58e387d4 00007f2a58e38762 00007f2a58e38691 00007f2a58e3860c 00007f2a58e378c2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:20.424896 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":513466752}
W20260709 12:10:20.544423  7370 log.cc:927] Time spent T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.983s	user 0.000s	sys 0.003s
I20260709 12:10:20.585757  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1205) took 1338 ms. Trace:
I20260709 12:10:20.568656  4870 rpcz_store.cc:276] 0709 12:10:19.476317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.476437 (+   120us) service_pool.cc:224] Handling call
0709 12:10:19.490933 (+ 14496us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:19.734993 (+244060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:19.735025 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:19.750638 (+ 15613us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.561936 (+811298us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:20.561972 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.562032 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:20.562067 (+    35us) raft_consensus.cc:1685] finished
0709 12:10:20.562078 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.562188 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11217,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":40358,"thread_start_us":1033253,"threads_started":2,"wal-append.queue_time_us":598834}
I20260709 12:10:20.586907  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1107) took 1043 ms. Trace:
I20260709 12:10:20.598191  4945 rpcz_store.cc:276] 0709 12:10:19.247093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.899653 (+652560us) service_pool.cc:224] Handling call
0709 12:10:19.899993 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.218050 (+318057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.585560 (+367510us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540016b054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:20.585706 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575629568}
I20260709 12:10:20.493498  7381 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.588093  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.583570  7344 raft_consensus.cc:2764] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:20.589128  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.589630  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.505848  6936 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.424959  7171 raft_consensus.cc:1081] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Signalling peer ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:10:20.527369  7345 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.592561  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52376 (request call id 1210) took 1314 ms. Trace:
I20260709 12:10:20.609712  4943 rpcz_store.cc:276] 0709 12:10:19.272417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.272526 (+   109us) service_pool.cc:224] Handling call
0709 12:10:20.586227 (+1313701us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540011b2d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:20.586334 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342619392}
I20260709 12:10:20.610638  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.611045  4943 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:20.593219  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.574659  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.362883  7157 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:20.570266  4944 rpcz_store.cc:276] 0709 12:10:19.348065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.349471 (+1001406us) service_pool.cc:224] Handling call
0709 12:10:20.567770 (+218299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.363893  7201 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.596426  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.619655  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.594168  7374 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.514564  7012 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.371017  7037 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.597496  4915 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:20.427382  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.418226  7262 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.430873  7296 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.347168  7338 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.424108  7073 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:20.594698  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 224) took 1211 ms. Trace:
I20260709 12:10:20.587674  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:20.644038  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 56446.2us
I20260709 12:10:20.344120  7398 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.251s
I20260709 12:10:20.603233  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.645763  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.560858  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.598968  4867 rpcz_store.cc:276] 0709 12:10:19.543650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.082429 (+538779us) service_pool.cc:224] Handling call
0709 12:10:20.104488 (+ 22059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.260952 (+156464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.260983 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.261024 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:20.261057 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.586715 (+325658us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400136854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:20.586755 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.586858 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359353088}
I20260709 12:10:20.428324  7336 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.602465  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:20.583916  7023 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.583424  7391 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:20.611613  4869 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:20.611660  4868 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:20.613155  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.613966  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2151) took 1164 ms. Trace:
I20260709 12:10:20.528463  7348 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:20.595993  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.595860  7255 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:20.589632  7393 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:20.457242  7384 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.599474  7294 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.588618  7395 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.586736  7120 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.644959  7374 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.643232  4949 rpcz_store.cc:276] 0709 12:10:19.383186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.592183 (+1208997us) service_pool.cc:224] Handling call
0709 12:10:20.594645 (+  2462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.612112  7345 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:20.648797  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 172735us
W20260709 12:10:20.649964  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47534.9us
I20260709 12:10:20.698275  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.699079  5021 raft_consensus.cc:2410] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:20.659446  7391 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.656852  4988 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:20.658629  4945 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:20.659255  4950 rpcz_store.cc:276] 0709 12:10:19.449353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.587872 (+1138519us) service_pool.cc:224] Handling call
0709 12:10:20.613914 (+ 26042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.641564  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.664115  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:20.704201  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 47450.8us
I20260709 12:10:20.665328  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.704609  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.670105  4948 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:20.705173  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2130) took 1415 ms. Trace:
I20260709 12:10:20.362898  7394 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.647722  7347 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:20.662843  7037 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.620405  7342 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.702404  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.705716  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.705183  4988 leader_election.cc:400] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:10:20.721763  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.655905  7073 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.705564  4943 rpcz_store.cc:276] 0709 12:10:19.290017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.642480 (+1352463us) service_pool.cc:224] Handling call
0709 12:10:20.705118 (+ 62638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.660732  7262 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:20.708319  5603 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:20.701582  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:20.708524  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.726699  7262 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:20.639292  7012 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.710204  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.727650  7262 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.658504  7023 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.728611  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.728915  7023 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.729590  7342 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.729693  4917 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:20.730523  7342 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.727046  5019 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:20.731254  7360 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:20.731619  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.731746  7360 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.714192  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.732630  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:20.732981  7342 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:20.728660  7012 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:20.733695  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.734426  5600 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:20.715173  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.699314  7345 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:20.741256  7407 log.cc:927] Time spent T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:10:20.677809  7233 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:20.704705  4942 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:20.741916  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.742305  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.675047  7283 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.749133  4947 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
W20260709 12:10:20.741369  7409 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:10:20.722339  4950 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:20.730628  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:20.738377  7395 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.733074  4949 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:20.710949  7348 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:20.742105  7412 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:20.706053  7391 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:20.743300  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.787930  4942 raft_consensus.cc:2410] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:20.725035  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.749646  4947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2139) took 1402 ms. Trace:
I20260709 12:10:20.749568  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.736102  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.788750  4947 rpcz_store.cc:276] 0709 12:10:19.347327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.364197 (+1016870us) service_pool.cc:224] Handling call
0709 12:10:20.749586 (+385389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.656642  7357 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.794000  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.741341  7386 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.767815  4917 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:20.723512  7037 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.786338  7383 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:20.788301  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:20.791586  4950 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:20.663950  7368 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.750095  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.790974  4947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2138) took 1443 ms. Trace:
I20260709 12:10:20.819582  4947 rpcz_store.cc:276] 0709 12:10:19.347066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.790241 (+1443175us) service_pool.cc:224] Handling call
0709 12:10:20.790510 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.790685 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.790710 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.790749 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:20.790778 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.790830 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.790922 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.792788  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:20.794608  5019 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:20.765422  7233 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:20.800396  7394 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.800626  7013 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.802997  4917 leader_election.cc:400] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6.
I20260709 12:10:20.823503  4917 leader_election.cc:403] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:20.677430  7039 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.791838  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2150) took 1343 ms. Trace:
I20260709 12:10:20.825421  4942 rpcz_store.cc:276] 0709 12:10:19.448799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.743087 (+1294288us) service_pool.cc:224] Handling call
0709 12:10:20.791785 (+ 48698us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.817560  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 225) took 1434 ms. Trace:
W20260709 12:10:20.742331  7153 consensus_meta.cc:287] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.004s
I20260709 12:10:20.752108  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:20.826292  4945 rpcz_store.cc:276] 0709 12:10:19.383406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.791639 (+1408233us) service_pool.cc:224] Handling call
0709 12:10:20.817141 (+ 25502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.817293 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.817316 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.817352 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:20.817379 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.817427 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.817511 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.821843  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.792680  7393 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:20.827322  4875 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:20.787506  7372 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.788985  7398 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:20.815234  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2134) took 1469 ms. Trace:
I20260709 12:10:20.733902  7342 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.826660  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.826031  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:20.825093  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 226) took 1441 ms. Trace:
I20260709 12:10:20.833714  4943 rpcz_store.cc:276] 0709 12:10:19.383618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.814865 (+1431247us) service_pool.cc:224] Handling call
0709 12:10:20.824646 (+  9781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.824798 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.824838 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.824875 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:20.824904 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.824954 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.825041 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.820993  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.835068  5019 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:20.827831  5021 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:20.829329  4950 rpcz_store.cc:276] 0709 12:10:19.346014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.764118 (+1418104us) service_pool.cc:224] Handling call
0709 12:10:20.775689 (+ 11571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.815026 (+ 39337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.815187 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.818806  7295 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:20.842649  4948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52376 (request call id 1206) took 1590 ms (client timeout 1668 ms). Trace:
W20260709 12:10:20.843072  4948 rpcz_store.cc:269] 0709 12:10:19.252200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.900442 (+648242us) service_pool.cc:224] Handling call
0709 12:10:20.842458 (+942016us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54002765d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:20.842588 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411577600}
I20260709 12:10:20.837220  7372 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.838902  7398 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.847604  4872 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:20.848102  7023 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.831704  7393 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.824975  7233 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.831660  7153 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:20.876868  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.997009  5017 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:20.969478  4991 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:20.912935  4988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.66:43473 timed out after 1.863s (SENT) [suppressed 10 similar messages]
I20260709 12:10:20.901839  5018 raft_consensus.cc:2410] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:10:20.875612  7417 log.cc:927] Time spent T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:20.968663  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.018802  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:20.964650  5604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:37906
I20260709 12:10:20.959282  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.019671  5604 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:20.939111  4946 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
W20260709 12:10:21.010138  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 97220.3us
I20260709 12:10:21.020056  5604 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.832275  7285 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.947525  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.023587  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.024206  7294 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6.
W20260709 12:10:21.025000  4946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2135) took 1678 ms (client timeout 2182 ms). Trace:
W20260709 12:10:20.931067  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 105099us
I20260709 12:10:20.922863  7384 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:21.025504  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 63722.7us
I20260709 12:10:20.939460  7073 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:20.969604  7346 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:21.015995  5602 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:21.012665  7383 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.019399  5017 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:20.853497  4841 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:21.021749  5022 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
W20260709 12:10:21.036935  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 183504us
I20260709 12:10:20.932178  4945 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:20.969238  7386 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.025313  4942 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:21.025480  4946 rpcz_store.cc:269] 0709 12:10:19.346262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.363830 (+1017568us) service_pool.cc:224] Handling call
0709 12:10:21.024938 (+661108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.028015  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.026322  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:21.038481  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2145) took 1591 ms. Trace:
I20260709 12:10:21.000308  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:21.032401  7304 consensus_meta.cc:287] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.771s	user 0.002s	sys 0.007s
I20260709 12:10:20.880795  7120 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.865667  7338 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:20.893615  7348 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.034536  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:20.920619  7391 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:20.968981  7286 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:21.039677  4945 rpcz_store.cc:276] 0709 12:10:19.447553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.827404 (+1379851us) service_pool.cc:224] Handling call
0709 12:10:20.931853 (+104449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.038263 (+106410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.038434 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.041188  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.040019  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.045773  4943 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:21.022521  7037 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.035887  7228 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.015550  7393 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.040866  7358 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:21.040681  7073 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:21.053928  5604 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.040694  7386 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.054720  7170 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.056030  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.057207  7360 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.039109  7346 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.057233  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.058604  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.059890  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:21.061097  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:21.061321  4840 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:21.061914  7374 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:21.061959  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.064097  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.065687  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:21.064756  7345 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.067029  7155 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:21.068645  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.042098  7334 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.071828  7228 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:21.102015  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.102145  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.077069  5598 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:21.077549  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.077819  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.078011  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2144) took 1630 ms. Trace:
I20260709 12:10:21.057366  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.077483  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.043120  7304 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.088979  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.074919  7073 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.091729  4917 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:21.114534  7386 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:21.103317  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.069909  7286 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.122303  4867 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:21.105567  4873 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:21.105751  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.105757  4942 rpcz_store.cc:276] 0709 12:10:19.447310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.826024 (+1378714us) service_pool.cc:224] Handling call
0709 12:10:21.025023 (+198999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.038446 (+ 13423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.077825 (+ 39379us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54000a78d0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:21.077955 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442705152}
I20260709 12:10:21.078991  7013 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:21.108646  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:21.079639  7170 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:21.115352  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.089542  7338 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:21.090008  5600 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:21.117070  7357 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.118672  7181 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:21.119127  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:21.102604  7368 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.125084  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.096029  7360 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:21.101677  7334 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:21.117465  7073 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.129494  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.117986  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.135108  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.136425  4875 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.128044  7170 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.122046  7120 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.096064  7374 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.161361  7120 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.162688  7374 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.144042  4942 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:21.163805  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.164011  7120 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:21.144371  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.144687  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.145016  7427 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:21.145397  7398 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:21.145771  7233 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.143203  7334 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.143309  7171 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:21.149367  7360 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.143561  7181 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:21.129567  7338 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.152444  4988 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:21.231587  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 79212.9us
I20260709 12:10:21.232146  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.133741  7013 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.153100  4839 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.153754  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:21.148727  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:21.157142  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:21.144758  7429 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:10:21.157750  4875 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:21.158452  7391 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.160847  7304 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.139891  5597 raft_consensus.cc:2368] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6.
I20260709 12:10:21.174101  4947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1212) took 1781 ms. Trace:
I20260709 12:10:21.177052  4951 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:21.136171  7357 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:21.137281  7368 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:21.233086  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.166148  7411 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.298044  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.299636  5017 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.300698  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:21.288129  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.269363  6293 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.285539  4947 rpcz_store.cc:276] 0709 12:10:19.394166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.820450 (+1426284us) service_pool.cc:224] Handling call
0709 12:10:20.826822 (+  6372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.851752 (+ 24930us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:21.008854 (+157102us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.058360 (+ 49506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.058406 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:21.058449 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.173911 (+115462us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b54001199d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:21.173952 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.174052 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5225,"prepare.queue_time_us":174924,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":35,"raft.queue_time_us":5323,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":56844672,"thread_start_us":187001,"threads_started":2,"wal-append.queue_time_us":62639}
W20260709 12:10:21.269169  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 116153us
W20260709 12:10:21.297058  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 64298.8us
I20260709 12:10:21.312282  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.299377  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.296039  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.230397  7171 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.317934  4988 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.318939  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.246960  7233 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.235919  7338 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:21.294090  7436 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:10:21.323130  4988 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.326736  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.327422  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.285684  7293 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.293345  7357 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.355654  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.298149  7368 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.354562  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.362991  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.370921  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.371577  4947 raft_consensus.cc:2368] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
W20260709 12:10:21.353543  7430 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 12:10:21.322424  7199 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:21.322278  7374 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:21.352883  7383 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:21.354457  7231 consensus_meta.cc:287] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.001s
I20260709 12:10:21.320698  7171 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.376065  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.325145  7157 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.378293  7118 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.360401  7386 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.364167  7039 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:21.368083  7345 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.379426  7013 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.352620  7304 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:10:21.360319  7390 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.360858  7394 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.387527  4876 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:21.373404  7398 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:21.389513  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:21.389932  7181 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.393956  7228 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.394937  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:21.396479  7385 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.325970  7233 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:21.398017  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 43545.8us
I20260709 12:10:21.396601  5017 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:21.328090  7295 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:21.399464  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.399878  4870 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:21.325770  7285 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.327966  7065 consensus_queue.cc:1059] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:10:21.376121  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:21.364562  7348 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:10:21.376276  7346 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:21.359977  7293 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.399029  7383 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:21.434720  7383 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.403224  7386 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:21.440984  7386 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.442982  7170 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.419646  4839 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.464202  7065 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:21.465153  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 45606.2us
I20260709 12:10:21.465976  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.467032  4839 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.411254  7374 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:21.410851  7390 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:21.401252  7231 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.412788  7013 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.427953  7381 raft_consensus.cc:993] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:10:21.428184  7295 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.436985  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.438241  4946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1220) took 1095 ms. Trace:
I20260709 12:10:21.472476  4946 rpcz_store.cc:276] 0709 12:10:20.343220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.086789 (+743569us) service_pool.cc:224] Handling call
0709 12:10:21.090862 (+  4073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.091067 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.091092 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.109459 (+ 18367us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.296981 (+187522us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:21.297018 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.297087 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.438061 (+140974us) raft_consensus.cc:1685] finished
0709 12:10:21.438079 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.438189 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":177409,"threads_started":1,"wal-append.queue_time_us":288462}
I20260709 12:10:21.439359  5606 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.439945  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1222) took 1092 ms. Trace:
I20260709 12:10:21.398736  7199 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.451423  7360 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.451718  7338 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.425455  7233 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.469805  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.448271  7357 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.428994  5600 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.473937  4942 rpcz_store.cc:276] 0709 12:10:20.347590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.164604 (+817014us) service_pool.cc:224] Handling call
0709 12:10:21.164929 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.165300 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.165330 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.165753 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.328448 (+162695us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:21.328473 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.328525 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.439760 (+111235us) raft_consensus.cc:1685] finished
0709 12:10:21.439777 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.439896 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"thread_start_us":162393,"threads_started":1,"wal-append.queue_time_us":249178}
I20260709 12:10:21.475589  4943 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:21.478686  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.481170  4871 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:21.469498  7075 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:21.491129  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 124541us
I20260709 12:10:21.471503  7390 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.495426  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.495484  4947 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:10:21.492692  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 129783us
I20260709 12:10:21.493870  4839 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.479408  7065 raft_consensus.cc:1081] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Signalling peer ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:10:21.498508  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.508424  4839 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.507038  4916 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:21.514799  4873 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.516892  7199 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.517858  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.518198  7065 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.478046  7013 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.520274  7231 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.521070  5597 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
W20260709 12:10:21.521423  7444 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:10:21.521090  7397 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:21.523034  7397 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:21.524049  7397 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.529819  7013 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.531246  7295 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.531427  7348 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:21.532084  7170 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.531956  7348 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.521857  7338 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.533872  7348 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:21.534004  7357 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.535993  4950 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:21.538864  7383 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.497552  7075 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:21.540053  7075 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.542488  4874 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:21.544529  7118 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.545967  7368 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.547947  7368 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.471751  7374 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.549746  7374 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:21.497444  7360 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.513706  7394 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:10:21.555828  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.519274  4942 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:21.560038  7384 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.563057  4988 leader_election.cc:400] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:21.563341  4988 leader_election.cc:403] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.564148  7399 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:21.563982  7171 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.514479  7393 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:21.566063  7424 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.487s	user 0.001s	sys 0.001s
I20260709 12:10:21.569947  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.571864  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:21.564635  7434 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:10:21.568670  5567 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.577162  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.578298  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:21.579022  5605 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:21.583876  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.585808  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.586506  5017 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:21.584498  5024 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:21.573508  7374 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.589138  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.589195  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:21.588025  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 79666.3us
I20260709 12:10:21.591042  4839 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.592494  4915 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.581650  7013 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.560647  7073 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.620187  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.622066  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.622706  5017 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:21.594009  7397 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.594866  7199 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.596287  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.624629  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.625162  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.597615  7383 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.600525  7262 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:21.593581  7334 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.603761  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1114) took 1341 ms. Trace:
I20260709 12:10:21.593732  7386 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.632113  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.605746  7171 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.606187  5604 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:21.576126  7399 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:10:21.609642  5022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 1143) took 1543 ms (client timeout 1932 ms). Trace:
I20260709 12:10:21.610241  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.636265  5019 raft_consensus.cc:2393] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 6: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:21.611210  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.612164  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.613094  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.614569  4839 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:21.638388  4839 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.615757  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.617492  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:21.623829  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.625170  4942 raft_consensus.cc:2376] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7. Re-sending same reply.
I20260709 12:10:21.617616  7452 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:21.647053  7415 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:21.647565  7415 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:21.648205  7073 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.631726  7181 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.648468  7415 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.651523  7075 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.652992  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.653770  4942 raft_consensus.cc:2368] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:10:21.654490  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.655910  7452 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:21.656306  7452 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:21.656525  7393 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.658346  7234 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:21.659109  4948 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.655469  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.659893  4942 raft_consensus.cc:2376] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6. Re-sending same reply.
I20260709 12:10:21.660003  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.660580  5017 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.626999  7447 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.629129  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.661854  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.632932  4869 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:21.631634  4868 rpcz_store.cc:276] 0709 12:10:20.262154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.660114 (+397960us) service_pool.cc:224] Handling call
0709 12:10:20.660388 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.712724 (+ 52336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.712752 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.712788 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:20.712833 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.603568 (+890735us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b540004ea54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:21.603608 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.603710 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119970688}
I20260709 12:10:21.663215  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:21.663697  4868 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.665854  7199 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.630380  7262 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:21.669484  7358 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.669903  7358 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:21.670383  5600 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:21.671097  5606 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:21.641398  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:21.642526  4950 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:21.643275  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.672887  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:21.635391  5022 rpcz_store.cc:269] 0709 12:10:20.065914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.066087 (+   173us) service_pool.cc:224] Handling call
0709 12:10:21.609435 (+1543348us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54004187d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:21.609546 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2100199680}
I20260709 12:10:21.673375  4875 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.671645  7262 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.674576  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 453) took 1079 ms. Trace:
I20260709 12:10:21.675201  7262 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.674952  5603 rpcz_store.cc:276] 0709 12:10:20.594763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.602982 (+  8219us) service_pool.cc:224] Handling call
0709 12:10:21.674400 (+1071418us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b540051f754. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:21.674506 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142635776}
I20260709 12:10:21.656610  7452 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:21.676833  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:21.677431  4872 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.677202  7358 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.678361  7075 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.679117  7358 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:21.680047  7348 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:21.681883  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:21.684966  5604 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:21.685986  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:21.674155  7153 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:21.688784  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:21.689807  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:21.690317  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:21.691416  5597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:37906
I20260709 12:10:21.691929  5597 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:21.692281  5597 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.693090  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.693866  7358 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:21.694181  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.686918  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:21.694806  7399 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:21.695154  7399 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:21.695215  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:21.695982  7399 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.690263  5603 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.697170  7419 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.675745  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 509) took 1006 ms. Trace:
I20260709 12:10:21.698604  7399 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:21.696350  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:21.699386  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.701098  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.698499  5599 rpcz_store.cc:276] 0709 12:10:20.669364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.823588 (+154224us) service_pool.cc:224] Handling call
0709 12:10:21.674509 (+850921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.674689 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.674713 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.674751 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.674778 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.674825 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.675605 (+   780us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b540051f750. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:21.675697 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1934132096}
I20260709 12:10:21.695917  4873 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:21.677758  4872 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:21.660750  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.673290  7390 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.698997  5024 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:21.719376  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 78040.8us
I20260709 12:10:21.704269  4942 raft_consensus.cc:2376] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6. Re-sending same reply.
I20260709 12:10:21.707600  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.720594  5019 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:21.707978  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.720268  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.708216  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.720849  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.728256  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.718261  4875 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:21.719197  5017 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:21.732149  4915 leader_election.cc:400] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
I20260709 12:10:21.732924  4868 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:21.704334  4872 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.739804  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:21.740419  5021 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:21.741981  4868 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:21.743109  4868 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.743729  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:21.694319  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:21.745513  5016 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:21.745852  4872 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:21.745103  5018 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 1124) took 1626 ms (client timeout 1933 ms). Trace:
I20260709 12:10:21.748543  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.755465  5019 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:21.749342  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.751331  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.756526  4870 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
W20260709 12:10:21.754453  5018 rpcz_store.cc:269] 0709 12:10:20.118345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.239663 (+121318us) service_pool.cc:224] Handling call
0709 12:10:21.744936 (+1505273us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400162bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:21.745053 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244496128}
I20260709 12:10:21.743657  7447 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:21.744035  7181 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.775357  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.686964  7233 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.783445  5603 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:21.778060  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:21.785571  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:21.786279  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:21.787331  5017 raft_consensus.cc:2368] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:21.790139  7394 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.770612  7419 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:21.794490  5017 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:21.796020  5018 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:21.777114  7447 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.798269  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.752233  7345 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:10:21.774557  7181 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:21.803689  5020 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.804337  4873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39302
I20260709 12:10:21.790561  7394 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:21.813953  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.820505  4947 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:21.816777  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:21.790162  7356 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.824904  4840 leader_election.cc:400] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:21.825237  4840 leader_election.cc:403] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.820874  4872 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:21.831629  4873 raft_consensus.cc:606] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 12:10:21.831986  4873 raft_consensus.cc:614] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:21.822177  7419 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:21.833079  5018 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:21.803921  7447 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:21.834669  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:21.836472  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.812913  7181 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.827378  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.821342  7394 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.893885  4872 raft_consensus.cc:2393] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
W20260709 12:10:21.894680  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 57770.2us
I20260709 12:10:21.821502  7234 raft_consensus.cc:2764] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:10:21.896447  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 69147.3us
I20260709 12:10:21.897716  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.898691  4991 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.900087  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:21.901201  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:21.832381  7073 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:21.835208  7453 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:21.823755  7075 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:10:21.910162  4872 raft_consensus.cc:2368] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:21.837386  7411 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:21.902063  7420 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:10:21.894955  7039 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:21.894804  7153 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.901885  7348 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:21.926416  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.936157  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.929608  4988 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.929812  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.933440  4991 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.893054  7385 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:21.905053  7286 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:21.934598  7358 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:21.940486  7456 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:10:21.942575  7452 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.901507  7368 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:10:21.945111  7039 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:21.945849  7419 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:21.946316  7447 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:21.953521  4988 leader_election.cc:400] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:10:21.972674  4988 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.954279  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:21.956650  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.912357  7073 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:21.958343  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1215) took 1645 ms. Trace:
I20260709 12:10:22.003095  4944 rpcz_store.cc:276] 0709 12:10:20.312780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.922380 (+609600us) service_pool.cc:224] Handling call
0709 12:10:21.957666 (+1035286us) spinlock_profiling.cc:243] Waited 923 us on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:10:21.957851 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.958016 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.958044 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.958081 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:21.958111 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.958181 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.958294 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121984}
I20260709 12:10:21.974964  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:21.955536  7383 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.005812  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.957561  7170 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.007579  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 1115) took 1709 ms. Trace:
I20260709 12:10:22.008008  4988 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:21.959123  7286 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.009765  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1112) took 1787 ms. Trace:
I20260709 12:10:22.011395  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:22.014897  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:22.012921  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:22.015683  4950 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:22.016458  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:22.017406  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:22.018002  4950 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.010901  4874 rpcz_store.cc:276] 0709 12:10:20.262429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.566865 (+304436us) service_pool.cc:224] Handling call
0709 12:10:21.971435 (+1404570us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54002b52d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:21.971536 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227339520}
I20260709 12:10:22.014086  4867 rpcz_store.cc:276] 0709 12:10:20.222188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.649673 (+427485us) service_pool.cc:224] Handling call
0709 12:10:20.670700 (+ 21027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.122682 (+451982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.009558 (+886876us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54002b66d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:22.009709 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038159104}
I20260709 12:10:22.019205  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.020162  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.033377  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:21.976181  7358 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:22.036027  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:22.038934  4946 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.002529  7398 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:22.037954  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 104113us
I20260709 12:10:22.037873  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:22.040295  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.037707  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.008469  7390 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:22.009989  7153 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:22.015106  7348 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:22.047864  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 79127.9us
I20260709 12:10:22.051867  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:22.057933  4950 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:22.059643  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.059999  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:22.061669  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:22.062842  4946 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:22.064450  4946 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:10:22.064590  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.039397  7383 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.065155  4944 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:22.065608  4944 pending_rounds.cc:85] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 2
I20260709 12:10:22.065831  4944 pending_rounds.cc:107] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:22.066052  4944 raft_consensus.cc:2889] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.041383  7233 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:22.066995  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:22.016928  7170 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:22.042006  7399 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:10:22.080077  5597 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:22.083935  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 71410.2us
I20260709 12:10:22.075139  7398 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:22.075891  7153 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:22.094439  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.099148  5019 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.105062  4874 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:22.111160  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 48661us
I20260709 12:10:22.112322  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:22.087504  7233 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:22.113716  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1145) took 2039 ms. Trace:
I20260709 12:10:22.074067  7476 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:10:22.117089  7233 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:22.105104  7418 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:22.073083  7073 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:22.120415  5023 rpcz_store.cc:276] 0709 12:10:20.074475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.269711 (+195236us) service_pool.cc:224] Handling call
0709 12:10:20.952162 (+682451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.952326 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.952349 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.952388 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:20.952418 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.952465 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.113550 (+1161085us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400343350. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:22.113656 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568873728}
I20260709 12:10:22.108558  7345 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:22.129204  4874 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:22.129359  7294 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:22.129802  7294 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:22.130311  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.131194  7228 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:22.131301  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:22.130537  7294 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:22.132792  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:22.133483  7462 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:22.133605  5021 raft_consensus.cc:2410] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:22.133200  7233 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:22.134423  7233 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.142748  7453 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:22.149371  4867 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:22.152107  7039 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:22.156507  4947 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:22.119863  7471 consensus_queue.cc:1059] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:22.157989  7228 raft_consensus.cc:3055] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.118944  7358 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:22.158352  7228 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:22.159185  7228 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:22.160495  7228 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.161088  7447 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:22.126857  7418 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:22.166996  7418 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:22.167562  7345 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:22.167943  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.169745  7345 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:22.170644  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.170857  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:22.174414  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:22.174975  4874 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.117136  7399 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:22.176040  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1231) took 1158 ms. Trace:
I20260709 12:10:22.176230  7452 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:22.177173  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 230) took 1958 ms. Trace:
W20260709 12:10:22.177774  7262 consensus_meta.cc:287] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
W20260709 12:10:22.178205  4951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 2129) took 2890 ms (client timeout 1873 ms). Trace:
W20260709 12:10:22.178566  4951 rpcz_store.cc:269] 0709 12:10:19.287859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.330306 (+ 42447us) service_pool.cc:224] Handling call
0709 12:10:22.178032 (+2847726us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54001194d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:22.178123 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3933785856}
I20260709 12:10:22.181156  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:22.118609  7153 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:22.175028  4869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 206) took 1437 ms (client timeout 1770 ms). Trace:
I20260709 12:10:22.183511  4945 rpcz_store.cc:276] 0709 12:10:21.017851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.301956 (+284105us) service_pool.cc:224] Handling call
0709 12:10:21.320076 (+ 18120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.490429 (+170353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.490461 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.490502 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:21.490536 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.175834 (+685298us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400374e54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:22.175877 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.175978 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391337216}
I20260709 12:10:22.177501  4948 rpcz_store.cc:276] 0709 12:10:20.218697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.843833 (+625136us) service_pool.cc:224] Handling call
0709 12:10:21.061512 (+217679us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:10:21.062820 (+  1308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.659454 (+596634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.176956 (+517502us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400375354. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:22.177121 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578016896}
I20260709 12:10:22.182296  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:22.185837  5019 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:22.183005  4869 rpcz_store.cc:269] 0709 12:10:20.737670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.058372 (+320702us) service_pool.cc:224] Handling call
0709 12:10:22.174853 (+1116481us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54002c24d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:22.174966 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268334976}
I20260709 12:10:22.189273  4874 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:22.174233  5597 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:22.182385  7153 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:22.208369  5019 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:22.222714  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:22.207588  7153 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:22.223551  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 158699us
I20260709 12:10:22.225340  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.226750  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:22.226938  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:10:22.228711  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 122044us
I20260709 12:10:22.227802  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:22.231803  4869 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:22.233448  4839 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:22.236712  5024 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:22.237515  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:22.238433  4839 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:22.240340  7075 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.241003  7075 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:22.241931  7357 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:22.242293  7357 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:22.243067  7357 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:22.245221  7390 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.246753  7228 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:22.247776  7228 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.248109  7228 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:22.248952  7228 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:22.250100  7228 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.254470  7357 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:22.256584  7181 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:22.289070  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2128) took 3011 ms. Trace:
I20260709 12:10:22.289597  4949 rpcz_store.cc:276] 0709 12:10:19.278146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.768836 (+1490690us) service_pool.cc:224] Handling call
0709 12:10:20.769111 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.588458 (+819347us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:21.588709 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.703922 (+115213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.703984 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:21.704025 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.262924 (+558899us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54002779d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:22.288925 (+ 26001us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.289027 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17453,"prepare.queue_time_us":1936,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":15108,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":16416,"spinlock_wait_cycles":1883880320,"thread_start_us":114820,"threads_started":1,"wal-append.queue_time_us":224391}
I20260709 12:10:22.231041  7394 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:22.253931  7368 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.237663  7477 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.265725  7360 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:22.309820  7360 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:22.310698  7360 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:22.313097  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:22.297403  7479 log.cc:927] Time spent T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:10:22.298367  7480 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:10:22.298579  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 455) took 1695 ms. Trace:
I20260709 12:10:22.321622  5598 rpcz_store.cc:276] 0709 12:10:20.603497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.712986 (+109489us) service_pool.cc:224] Handling call
0709 12:10:22.298358 (+1585372us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400483854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:22.298512 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757480704}
I20260709 12:10:22.322762  7023 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:22.317058  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.337492  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:22.353463  7394 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:22.318001  7181 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:22.382481  7013 raft_consensus.cc:3055] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.382881  7013 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:22.383749  7013 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:22.405570  7153 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:22.407691  7153 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:24.028553  7374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.029s
W20260709 12:10:24.036502  7374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.000s	sys 0.030s
I20260709 12:10:24.076108  7293 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.148747  7334 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:24.156738  6293 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.157265  6293 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.159057  6293 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.159457  6293 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:24.159819  6293 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.161429  6293 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.170647  7362 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:24.174283  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 1162) took 2082 ms. Trace:
I20260709 12:10:24.174592  5024 rpcz_store.cc:276] 0709 12:10:22.091924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.092057 (+   133us) service_pool.cc:224] Handling call
0709 12:10:22.092310 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.237116 (+144806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.174064 (+1936948us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400140ad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:24.174235 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331634432}
W20260709 12:10:24.174705  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.176086  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.180123  7499 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.180753  7502 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.179961  7498 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.180596  7499 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.181386  6293 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.184638  6293 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.185623  7342 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:24.186678  7447 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:24.187047  7495 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:24.187170  7447 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.187527  7495 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.187867  6293 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:24.181325  7502 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.188951  7295 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:24.185303  4871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 2221) took 4049 ms (client timeout 4499 ms). Trace:
I20260709 12:10:24.186465  7342 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:24.189828  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.189435  7295 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.190593  7502 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.191298  7037 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:24.191774  7037 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.192183  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.192306  7493 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.192720  7334 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:24.192931  7347 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:24.193312  7334 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.194233  7037 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.194671  7037 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:24.190835  7342 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:24.189502  4871 rpcz_store.cc:269] 0709 12:10:20.134473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.578181 (+443708us) service_pool.cc:224] Handling call
0709 12:10:24.183822 (+3605641us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54002b6bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:24.183996 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980129664}
I20260709 12:10:24.192795  7493 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.194967  7037 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.195890  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.196449  4944 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:24.196923  7037 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.191434  7295 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.197479  7347 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.195227  7334 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:24.198287  7502 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.191697  7492 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:24.198694  7502 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.199424  7347 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.199203  7492 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.200202  7502 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.200664  7502 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.201077  7502 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.196977  7493 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.189352  7495 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.192752  4948 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:24.198654  7447 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.201364  7492 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:24.205391  4839 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:24.205866  4947 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.206064  7503 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:24.202728  7502 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:24.206713  7503 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.207161  7503 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.207172  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.208266  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.183387  7499 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.181592  7498 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.209285  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.210237  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.210407  7498 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.210815  4947 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:24.206175  4839 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:24.211527  7498 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.211926  7498 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:24.212572  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.212760  7499 consensus_queue.cc:1059] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:24.213047  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:24.214387  7502 raft_consensus.cc:3055] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.214794  7502 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:24.215023  7499 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.215509  7499 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.216089  7499 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.215555  7502 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.216912  7502 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.216934  7503 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.218045  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39302 (request call id 74) took 3480 ms. Trace:
I20260709 12:10:24.218405  4873 rpcz_store.cc:276] 0709 12:10:20.737412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.792180 (+1054768us) service_pool.cc:224] Handling call
0709 12:10:24.217864 (+2425684us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b540004db54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e4853 00007f2a5f8b260a 00007f2a58e387d4 00007f2a58e38762 00007f2a58e38691 00007f2a58e3860c 00007f2a58e378c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:24.217964 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61488384}
I20260709 12:10:24.219056  7503 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.214473  7498 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.225124  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.225229  7499 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.225735  4944 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:24.227421  7499 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.228632  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:24.229172  4944 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.229683  7498 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.230959  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:24.231462  4949 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.234127  7498 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.237409  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.238212  4944 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:24.239096  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.240868  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:24.241365  4944 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.246182  4839 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:24.247262  4949 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:24.247869  5567 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:24.248641  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:24.249146  4944 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:24.249571  7504 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:24.248709  7075 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:24.249998  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.250667  7075 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:24.251273  4944 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:24.251523  7075 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.252063  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:24.252614  4944 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.257762  5567 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:24.258476  4944 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:24.260365  7395 raft_consensus.cc:2764] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:24.260495  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:24.261162  4944 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.261351  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:24.264068  7395 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:24.265421  4868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.083s	user 0.014s	sys 0.022s
W20260709 12:10:24.265836  4868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.083s	user 0.014s	sys 0.022s
I20260709 12:10:24.266454  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2262) took 2085 ms. Trace:
I20260709 12:10:24.266745  4868 rpcz_store.cc:276] 0709 12:10:22.181122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.181262 (+   140us) service_pool.cc:224] Handling call
0709 12:10:22.181540 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:22.181856 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.181883 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:22.182282 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.266159 (+2083877us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:24.266199 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.266261 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.266296 (+    35us) raft_consensus.cc:1685] finished
0709 12:10:24.266306 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.266408 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116,"raft.queue_time_us":3737,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":10025,"thread_start_us":2083550,"threads_started":1,"wal-append.queue_time_us":175173,"wal-append.run_cpu_time_us":1569,"wal-append.run_wall_time_us":1075745}
I20260709 12:10:24.268033  4944 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:24.269347  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:24.270143  4839 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:24.270797  7502 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:24.271448  7502 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:24.272289  7502 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.273669  7170 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:24.272245  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.276973  7065 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.270843  7499 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.277568  7499 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:24.277469  7065 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.278450  7499 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.279527  7065 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.270929  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1163) took 3210 ms. Trace:
I20260709 12:10:24.265264  5567 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:24.281554  5016 rpcz_store.cc:276] 0709 12:10:21.060478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.144948 (+ 84470us) service_pool.cc:224] Handling call
0709 12:10:21.745351 (+600403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.753198 (+  7847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.270737 (+2517539us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400162bd0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:24.270853 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380169088}
I20260709 12:10:24.291114  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1175) took 2585 ms. Trace:
I20260709 12:10:24.291467  5020 rpcz_store.cc:276] 0709 12:10:21.706002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.706129 (+   127us) service_pool.cc:224] Handling call
0709 12:10:21.706351 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.804093 (+ 97742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.290883 (+2486790us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b5400064354. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:24.291055 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220100352}
I20260709 12:10:24.301381  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 519) took 2618 ms. Trace:
I20260709 12:10:24.301724  5602 rpcz_store.cc:276] 0709 12:10:21.682658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.682983 (+   325us) service_pool.cc:224] Handling call
0709 12:10:21.696720 (+ 13737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.697099 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.697129 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.700158 (+  3029us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.832629 (+132471us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.837340 (+  4711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.895206 (+ 57866us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.136668 (+241462us) raft_consensus.cc:1685] finished
0709 12:10:22.136693 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.292759 (+2156066us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b540044b450. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:24.301306 (+  8547us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1220,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"spinlock_wait_cycles":30856448,"thread_start_us":121853,"threads_started":1,"wal-append.queue_time_us":262954,"wal-append.run_cpu_time_us":2209,"wal-append.run_wall_time_us":1172680}
I20260709 12:10:24.306483  7497 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:24.307687  7497 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.313309  7497 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:24.313933  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.315459  7504 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.317195  7504 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.319108  7504 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:24.320297  7504 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:24.321739  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 56544.2us
I20260709 12:10:24.325368  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.326953  5601 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:24.331879  4949 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:24.331987  4945 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:24.333117  7511 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.334045  7503 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:24.334451  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:24.335395  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:24.336447  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:24.328958  7497 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.353681  7509 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:24.353782  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.320744  7504 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.367091  5016 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:24.367246  5601 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:24.337131  7505 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:24.355422  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.368417  5022 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:24.352453  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:24.368536  4916 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:24.369352  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.370412  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.371346  5602 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:24.369657  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.365677  7502 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.372288  5020 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:24.371389  7504 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:24.372831  4916 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:24.373546  7504 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.373556  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.374262  5020 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:24.374212  7504 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:24.368046  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.374127  7492 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:24.375640  5020 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:24.375479  7504 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.377223  7492 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.377766  7492 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:24.378655  7492 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.380366  7495 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.369396  7497 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.385507  7497 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:24.385957  5022 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:24.371584  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:24.389041  7493 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:24.389230  7497 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.361302  7511 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.389786  7497 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.391376  7511 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:24.391681  7497 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:24.393232  7503 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:24.395027  7386 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:24.372570  7505 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.396992  7505 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.380887  7495 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:24.399899  7495 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.401250  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 260) took 3568 ms. Trace:
I20260709 12:10:24.401607  5025 rpcz_store.cc:276] 0709 12:10:20.832890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.129816 (+296926us) service_pool.cc:224] Handling call
0709 12:10:21.141517 (+ 11701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.167320 (+ 25803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.167347 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.167383 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:21.167410 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.401057 (+3233647us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54001617d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:24.401097 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.401200 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58948864}
I20260709 12:10:22.358141  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:24.403112  4942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52376 (request call id 1259) took 2096 ms (client timeout 2136 ms). Trace:
I20260709 12:10:24.402921  7493 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:24.403497  4942 rpcz_store.cc:269] 0709 12:10:22.314053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.355177 (+ 41124us) service_pool.cc:224] Handling call
0709 12:10:24.403058 (+2047881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:24.407863  7493 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.409010  7493 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.371336  7509 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.364945  7499 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.412742  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:24.413333  5024 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.413185  7509 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:24.416967  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 61531.3us
I20260709 12:10:24.419862  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.420397  5020 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:24.421422  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:24.422652  5024 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:24.424302  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:24.426442  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 103640us
I20260709 12:10:24.427575  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:24.455492  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.456133  5024 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:24.499905  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:24.416604  7509 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:24.501688  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 44962us
I20260709 12:10:24.403070  7502 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:24.505498  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 90159.5us
I20260709 12:10:24.415676  7499 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.539793  7499 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.542321  7509 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:24.542842  7509 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.544905  7498 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.545282  7498 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:24.546051  7498 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.547168  7498 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.544713  7509 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:24.766386  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.800782  7502 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.804988  7509 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.825213  7509 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:24.827252  7509 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.833169  7520 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:24.833730  7520 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:24.808715  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.845839  7520 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:24.863322  4867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 2258) took 2964 ms (client timeout 3211 ms). Trace:
W20260709 12:10:24.863714  4867 rpcz_store.cc:269] 0709 12:10:21.898852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.047732 (+148880us) service_pool.cc:224] Handling call
0709 12:10:24.863156 (+2815424us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b54003e3fd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:24.863265 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160470784}
W20260709 12:10:24.866895  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.867106  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 446618us
I20260709 12:10:24.868269  4946 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:10:24.869971  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 442444us
I20260709 12:10:24.870612  5567 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:24.870944  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:24.872766  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:24.872555  7502 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.903249  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:24.872397  5570 connection.cc:256] RPC call timeout handler was delayed by -1.0787581540000701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 12:10:24.904475  5570 connection.cc:256] RPC call timeout handler was delayed by -1.0657229880000614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 12:10:24.904414  4840 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:24.903705  4842 connection.cc:256] RPC call timeout handler was delayed by -1.1935192009998445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:10:24.903415  7528 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:24.911866  7520 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:24.905310  7498 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.912505  7498 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.912906  7498 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.912631  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.913287  7520 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:24.916999  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:24.917706  7499 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.918061  7499 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.918402  7499 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.919586  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 1160) took 3008 ms. Trace:
I20260709 12:10:24.919533  7498 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:24.911610  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 43680.4us
I20260709 12:10:24.923524  7509 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:24.925051  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.926966  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.927911  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:24.917131  7075 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.010s	sys 0.011s
I20260709 12:10:24.920135  5018 rpcz_store.cc:276] 0709 12:10:21.911170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.911274 (+   104us) service_pool.cc:224] Handling call
0709 12:10:21.936360 (+ 25086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.008280 (+ 71920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.008309 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.008349 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:22.008380 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.919364 (+2910984us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b54002d3f54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:24.919410 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.919534 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164945280}
I20260709 12:10:24.930410  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:24.933245  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.932873  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:24.937573  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:24.940449  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:24.944075  7533 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.903486  7502 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:24.930962  7075 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.011s	sys 0.011s
I20260709 12:10:24.904072  7515 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.949836  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:24.949999  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:24.950198  7498 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:24.954586  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.956558  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.957310  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.958361  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:24.958875  5024 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.929561  7386 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:24.961664  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.970285  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.970742  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:24.970893  5018 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:24.971331  5025 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:24.947012  7533 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.946393  7502 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.949180  7523 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:24.976387  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 49989.5us
I20260709 12:10:24.949797  7515 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.982581  5024 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:24.983489  7537 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.983595  7538 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:24.984130  7537 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.984161  7538 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:24.974874  7523 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:24.986068  7523 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.986300  7538 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:24.973711  7533 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.969201  7386 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.001370  5021 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:25.001912  7386 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.006242  7499 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:25.011164  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.012120  4991 connection.cc:256] RPC call timeout handler was delayed by -1.7548723209999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:10:24.978576  7515 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.008738  7499 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:25.035485  4991 connection.cc:256] RPC call timeout handler was delayed by -1.6630700450000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 12:10:25.034781  7075 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.040323  7075 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.041640  7294 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.042214  7075 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.012135  7523 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.044271  7523 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.046818  7537 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:25.051476  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 74414.3us
W20260709 12:10:25.105090  4991 connection.cc:256] RPC call timeout handler was delayed by -1.4749700449999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 12:10:25.105494  4991 connection.cc:256] RPC call timeout handler was delayed by -1.467770044999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 12:10:25.105788  4991 connection.cc:256] RPC call timeout handler was delayed by -1.4668700449999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 12:10:25.106065  4991 connection.cc:256] RPC call timeout handler was delayed by -1.4569700449999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 12:10:25.106335  4991 connection.cc:256] RPC call timeout handler was delayed by -1.4227700450001066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 12:10:25.106603  4991 connection.cc:256] RPC call timeout handler was delayed by -1.3894700450000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:10:25.106863  4991 connection.cc:256] RPC call timeout handler was delayed by -1.1196905730000708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:10:25.107128  4991 connection.cc:256] RPC call timeout handler was delayed by -1.0899905730000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:10:25.135927  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 82353.7us
I20260709 12:10:25.136632  4990 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:25.137845  7542 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.138509  7547 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.138389  7542 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.139859  4867 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.139922  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.140686  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
W20260709 12:10:25.141374  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.143347  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.145890  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.146456  5601 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:25.146725  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:25.147748  4991 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.149425  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.149760  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.149964  4868 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:25.150285  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.151223  4870 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:25.151607  4873 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:25.151744  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.150578  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:25.152493  4875 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:10:25.155036  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.155972  4947 raft_consensus.cc:2410] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:25.161011  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:25.161537  5024 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.162173  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.163048  4873 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:25.164582  5570 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.165753  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:25.166750  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.167280  4869 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.167971  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.166759  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.177654  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.182634  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.182814  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:25.183905  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.184353  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.183261  4874 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 3.
I20260709 12:10:25.177085  5024 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:25.191551  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.192092  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:25.192111  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:25.192919  5024 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.151191  7549 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.182009  7548 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.195072  4869 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:25.194355  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:25.172964  7505 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.180410  7530 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.182725  7523 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:25.221287  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:25.212869  5024 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:25.193653  7075 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.231767  7075 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:25.200132  7498 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:25.232143  7533 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.232605  7498 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:25.229610  5020 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:25.233469  7498 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.237454  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:25.238425  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:25.239583  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.173096  7541 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:10:25.196090  7516 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:25.139091  7547 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.196313  7548 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:25.219400  7549 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.217864  7552 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.163566  7515 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.232120  7075 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.235711  5597 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.245774  7514 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.245501  7527 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:25.271147  7556 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:25.323257  7529 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:10:25.328895  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 395058us
I20260709 12:10:25.267983  7505 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:10:25.312985  7516 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:25.382015  4951 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:25.360769  4871 raft_consensus.cc:2368] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 7.
I20260709 12:10:25.371732  4945 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:25.323155  7530 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:25.277604  7548 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:25.335178  7550 log.cc:927] Time spent T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:25.389757  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:25.298655  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff040 after lost signal to thread 3725
I20260709 12:10:25.329751  7527 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:25.367259  7506 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:25.324887  7514 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.392715  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:25.380741  7541 raft_consensus.cc:3055] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.387243  7505 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:10:25.412158  3730 debug-util.cc:398] Leaking SignalData structure 0x7b080033b680 after lost signal to thread 4917
I20260709 12:10:25.387140  7533 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.443447  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1280) took 1174 ms. Trace:
I20260709 12:10:25.443814  4944 rpcz_store.cc:276] 0709 12:10:24.269384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.269512 (+   128us) service_pool.cc:224] Handling call
0709 12:10:24.269756 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.269932 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:25.249259 (+979327us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.443153 (+193894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.443201 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.443241 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.443297 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.443396 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1168480,"prepare.queue_time_us":999859,"prepare.run_cpu_time_us":899,"prepare.run_wall_time_us":2551,"raft.queue_time_us":193830,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48}
I20260709 12:10:25.430853  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:25.393916  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff060 after lost signal to thread 3728
W20260709 12:10:25.418120  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 251402us
I20260709 12:10:25.366576  7556 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.422216  7542 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.423354  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:25.426532  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.176s	user 0.019s	sys 0.034s
I20260709 12:10:25.429227  7526 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:25.430930  7552 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:25.437847  7546 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:10:25.413733  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 1266) took 1210 ms. Trace:
W20260709 12:10:25.449476  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.199s	user 0.019s	sys 0.034s
I20260709 12:10:25.449273  4868 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:25.450012  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:25.455655  4839 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.396572  7530 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.412907  7527 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:25.436551  7514 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.454672  4948 rpcz_store.cc:276] 0709 12:10:24.203698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.204855 (+  1157us) service_pool.cc:224] Handling call
0709 12:10:24.205117 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.205296 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:25.244867 (+1039571us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.413419 (+168552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.413473 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:25.413514 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.413578 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.413678 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1033728,"prepare.queue_time_us":1062432,"prepare.run_wall_time_us":36,"raft.queue_time_us":17316,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":12533,"spinlock_wait_cycles":78329088,"thread_start_us":26035,"threads_started":1}
I20260709 12:10:25.436784  7541 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:10:25.457706  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 310000us
I20260709 12:10:25.459218  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:25.450624  7556 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:25.465588  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.452399  7523 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.466661  7554 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:25.467609  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.467795  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.471216  7075 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.471751  7557 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.473577  7362 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.474086  7362 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.476064  7362 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.477427  7294 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:25.476578  7362 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:25.478122  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.480772  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.481925  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.482693  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.460120  7530 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:25.447244  7502 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.457742  7565 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.449494  7505 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.485337  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.453115  7526 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.508455  4991 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.518198  7551 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.519760  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.522854  7551 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.486428  7542 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.528599  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.512275  7557 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.485194  7523 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.507164  7565 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:25.543051  7541 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.507445  7338 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:25.536056  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 50827.5us
I20260709 12:10:25.562717  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:25.485903  7516 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.564077  7075 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.565361  7415 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:25.565722  7415 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:25.572592  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.545218  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.456910  7552 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:25.552560  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 90649.5us
I20260709 12:10:25.574752  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:25.552904  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 92578us
I20260709 12:10:25.552146  7562 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:25.575894  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.576923  7576 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:25.581158  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:25.589452  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 44312.6us
I20260709 12:10:25.590466  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.571226  7486 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.593482  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2193) took 3256 ms. Trace:
I20260709 12:10:25.569069  7547 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.595209  4950 rpcz_store.cc:276] 0709 12:10:22.326114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.326223 (+   109us) service_pool.cc:224] Handling call
0709 12:10:22.326487 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.326692 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:25.445265 (+3118573us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b1800040c60. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a5a4924bc 00007f2a577e048b 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fa455 00007f2a5e2e23c7 00007f2a5a8f49a7 00007f2a5a9040bf
0709 12:10:25.445390 (+   125us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.582508 (+137118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.582576 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:25.582638 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.582738 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.582871 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50386,"prepare.queue_time_us":2870970,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":6546,"spinlock_wait_cycles":2551168,"thread_start_us":179319,"threads_started":2}
I20260709 12:10:25.596436  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:25.592253  7557 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.598950  5018 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.574254  7338 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.609151  7505 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.595192  7551 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.572173  7415 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.611219  7415 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:25.614498  7334 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:25.615036  7334 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:25.615347  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2181) took 3692 ms. Trace:
I20260709 12:10:25.615692  4943 rpcz_store.cc:276] 0709 12:10:21.922997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.923136 (+   139us) service_pool.cc:224] Handling call
0709 12:10:21.941474 (+ 18338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:21.955652 (+ 14178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:21.964474 (+  8822us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.259578 (+295104us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b18000975a0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577cb2a6 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5f813aa1 00007f2a5f80ab37 00007f2a5f80a9ca 00007f2a5f90226f
0709 12:10:22.260345 (+   767us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b48000b1e58. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5f813aa1 00007f2a5f80ab37 00007f2a5f80a9ca 00007f2a5f90226f 00007f2a5f901f37 00007f2a5f91655c 00007f2a5f916508 00007f2a5f916488 00007f2a5f916443 00007f2a5f9156ec 00007f2a5e83fa96
0709 12:10:25.425535 (+3165190us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18000975a0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a23a 00007f2a5a8f4a2a
0709 12:10:25.503013 (+ 77478us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.503106 (+    93us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:25.507564 (+  4458us) log.cc:844] Serialized 52 byte log entry
0709 12:10:25.507704 (+   140us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.508023 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.508377 (+   354us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.571120 (+ 62743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.571290 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.615151 (+ 43861us) raft_consensus.cc:1685] finished
0709 12:10:25.615170 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.615298 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84270,"prepare.queue_time_us":112569,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":107,"raft.queue_time_us":18016,"raft.run_cpu_time_us":1898,"raft.run_wall_time_us":297518,"spinlock_wait_cycles":79088512,"thread_start_us":139538,"threads_started":2,"wal-append.queue_time_us":3554199}
I20260709 12:10:25.617913  7556 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.619851  7547 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:25.622098  7552 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.623685  7523 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.593125  7356 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.624042  7294 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.582811  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.626086  5598 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:25.626969  7356 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.627401  4990 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:25.627857  7356 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.601764  7486 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.599731  7362 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 12:10:25.619978  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.641274  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:25.641999  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.642406  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:25.642607  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:25.643900  4951 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.644300  5018 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:25.644876  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.595772  7554 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.645532  7554 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.646584  7551 consensus_queue.cc:1059] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:25.647351  7551 consensus_queue.cc:1243] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:25.647759  7551 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.648041  7551 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:25.598738  7572 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.643898  4942 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:25.663931  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:25.664356  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 101716us
I20260709 12:10:25.694424  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:25.667047  4839 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:25.698359  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:25.698405  4951 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:25.646129  7554 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.634609  7356 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:25.701699  4943 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.653995  7547 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:25.655359  7557 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.707808  7476 raft_consensus.cc:2764] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:25.701062  7199 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:25.713944  7557 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.714394  7557 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.648772  7551 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.717537  7565 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.710816  7526 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.696955  7562 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.718436  7551 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.719157  7530 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.713903  7547 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.725217  7356 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.726343  7356 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.729856  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.730149  7548 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.651340  7334 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.710414  7572 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.732957  7572 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.733330  7572 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.739511  7557 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.653725  7502 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.744057  7578 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.744424  7571 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.718694  7562 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:25.744861  7199 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.745761  5022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 1206) took 1391 ms. Trace:
I20260709 12:10:25.746484  7181 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.747323  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 266) took 3650 ms. Trace:
I20260709 12:10:25.748083  4875 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.748359  7476 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.749356  4872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 2249) took 3946 ms (client timeout 1985 ms). Trace:
I20260709 12:10:25.749039  7527 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.749998  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1126) took 4606 ms. Trace:
I20260709 12:10:25.755578  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:25.757690  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 61721.7us
I20260709 12:10:25.757875  5022 rpcz_store.cc:276] 0709 12:10:24.354058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.370214 (+ 16156us) service_pool.cc:224] Handling call
0709 12:10:25.745622 (+1375408us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b54001608d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:25.745713 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34574592}
I20260709 12:10:25.784428  5601 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:25.785195  4872 rpcz_store.cc:269] 0709 12:10:21.802579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.901007 (+ 98428us) service_pool.cc:224] Handling call
0709 12:10:25.749177 (+3848170us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b540004d654. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:25.749294 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18881792}
I20260709 12:10:25.708247  7075 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.782631  4876 rpcz_store.cc:276] 0709 12:10:21.143455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.411307 (+267852us) service_pool.cc:224] Handling call
0709 12:10:21.421545 (+ 10238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.421730 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.421752 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.427205 (+  5453us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.507729 (+ 80524us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:21.558477 (+ 50748us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.558731 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.558808 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.258532 (+699724us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b1800426c40. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:24.150852 (+1892320us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800426c40. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:24.152584 (+  1732us) raft_consensus.cc:1685] finished
0709 12:10:24.152606 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.749825 (+1597219us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b54002b75d0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:25.749919 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50620,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":67,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":12353,"spinlock_wait_cycles":35466752,"thread_start_us":32394,"threads_started":1,"wal-append.queue_time_us":92072}
I20260709 12:10:25.786190  5017 rpcz_store.cc:276] 0709 12:10:22.097522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.097913 (+   391us) service_pool.cc:224] Handling call
0709 12:10:22.098162 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:22.117932 (+ 19770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:22.117958 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:22.117994 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:22.118023 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.747132 (+3629109us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b54003cc654. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:25.747172 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.747274 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45080320}
I20260709 12:10:25.797948  5601 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:25.799079  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:25.801986  7572 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.804227  7572 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.805202  7548 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.807650  7514 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.811074  7295 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.811529  7295 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.787106  7181 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.756044  7556 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.760330  7199 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:25.760670  7562 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.787827  7075 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.817281  7295 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.818322  7013 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:25.818619  4901 heartbeater.cc:646] Failed to heartbeat to 127.3.163.126:34023 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.163.126:34023 timed out after 15.000s (SENT)
I20260709 12:10:25.819026  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.824483  5601 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:10:25.832378  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.816013  7386 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:25.836273  7386 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:25.836884  4947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 234) took 1599 ms. Trace:
I20260709 12:10:25.837246  4947 rpcz_store.cc:276] 0709 12:10:24.237087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.237193 (+   106us) service_pool.cc:224] Handling call
0709 12:10:25.836704 (+1599511us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54001a86d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:25.836832 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2110660992}
I20260709 12:10:25.839160  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.842546  7348 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:25.842772  7519 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:25.844058  7415 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:25.843708  7519 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.844599  7415 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.846112  7519 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.846650  7415 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.846647  7519 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:25.847869  7519 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:25.848160  7527 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.760540  7571 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.850308  7571 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.843665  7348 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.852149  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.843784  7538 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:25.837108  7386 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.756019  7578 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.856833  7538 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:25.859416  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff740 after lost signal to thread 4808
I20260709 12:10:25.859421  7538 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.853081  7530 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:25.859891  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff8c0 after lost signal to thread 4828
I20260709 12:10:25.861033  7348 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:25.861884  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08003b30c0 after lost signal to thread 4900
W20260709 12:10:25.862155  5627 debug-util.cc:398] Leaking SignalData structure 0x7b0800307c20 after lost signal to thread 4901
I20260709 12:10:25.862498  7199 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.863454  7199 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.864902  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.859810  4772 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 3 to 5, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 5 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:25.865474  7578 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.867465  7514 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.856350  7411 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.870082  7514 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.870486  7514 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:25.871408  7514 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.822700  7075 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.847172  7415 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:25.790705  7476 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.863677  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1198) took 1512 ms. Trace:
I20260709 12:10:25.877713  5023 rpcz_store.cc:276] 0709 12:10:24.351447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.862966 (+1511519us) service_pool.cc:224] Handling call
0709 12:10:25.863231 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.863391 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.863418 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.863457 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:25.863488 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.863536 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.863628 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.506232  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:25.880402  7476 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.863642  7181 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.871565  7554 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.883720  7554 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.884047  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.884712  5601 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:25.885787  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:25.864396  7562 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.850096  7519 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.888176  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:25.888666  7538 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:25.892506  7538 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:25.894590  7574 log.cc:927] Time spent T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:10:25.896564  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.897975  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.898320  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:25.887640  7181 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:25.900189  7181 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.900514  7181 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:25.898459  4947 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
W20260709 12:10:25.904418  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.894497  7538 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.887887  7348 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:25.905385  7348 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:25.907348  7515 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:25.909571  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.910127  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.911487  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.913098  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:25.913650  5602 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:25.914369  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:25.917240  5605 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:25.907333  7348 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:25.922331  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0980 after lost signal to thread 4975
I20260709 12:10:25.923064  7293 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.923727  7562 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:25.923544  7293 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:25.923485  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080033f600 after lost signal to thread 5049
W20260709 12:10:25.926466  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5720 after lost signal to thread 5050
I20260709 12:10:25.930576  5602 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:25.939064  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:25.939756  5601 raft_consensus.cc:2368] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:25.940659  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:25.941527  5604 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:25.937095  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:25.938443  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.912568  7514 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.949002  7447 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:25.950999  4773 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 213) took 16185 ms (client timeout 15000 ms). Trace:
I20260709 12:10:25.941470  7532 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.951622  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080035a9c0 after lost signal to thread 5630
W20260709 12:10:25.952591  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080037bdc0 after lost signal to thread 5631
I20260709 12:10:25.936661  7293 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:25.953578  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:25.955685  5023 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.955721  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:25.957002  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.957199  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:25.957666  4951 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:25.957690  5018 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:25.959735  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.961787  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.964901  5018 raft_consensus.cc:2410] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:25.969012  5023 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.969895  5021 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:25.970400  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:25.971041  5017 raft_consensus.cc:2368] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6.
I20260709 12:10:25.971479  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:25.971575  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.951249  7486 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:25.988579  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.922290  7075 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:25.956878  7562 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:25.976083  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:25.972954  5022 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 9. Ops: []
I20260709 12:10:25.974947  5017 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:26.036576  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.037012  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.037987  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.038709  4947 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.039143  5019 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:26.007431  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.008646  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.039599  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:26.012686  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.006067  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.038935  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.043467  5570 leader_election.cc:400] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 7.
I20260709 12:10:26.043682  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:26.044270  4868 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.968855  7199 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.016816  7541 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.020711  7557 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:26.021878  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.019582  4772 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 5 to 6, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 6 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:26.049001  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:25.951370  4773 rpcz_store.cc:269] 0709 12:10:09.765460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.765865 (+   405us) service_pool.cc:224] Handling call
0709 12:10:10.891363 (+1125498us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:25.950903 (+15059540us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:17.541993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:17.652188 (+110195us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:17.652235 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:10:17.652266 (+    31us) tablet.cc:662] Decoding operations
0709 12:10:17.653030 (+   764us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:17.653101 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:17.653128 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:10:17.653752 (+   624us) tablet.cc:701] Row locks acquired
0709 12:10:17.653797 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:10:17.653971 (+   174us) write_op.cc:270] Start()
0709 12:10:17.654106 (+   135us) write_op.cc:276] Timestamp: P: 1783599017653894 usec, L: 0
0709 12:10:17.654131 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:17.654744 (+   613us) log.cc:844] Serialized 2122 byte log entry
0709 12:10:17.921813 (+267069us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18002213e0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:10:18.073751 (+151938us) op_driver.cc:464] REPLICATION: finished
0709 12:10:18.255099 (+181348us) write_op.cc:301] APPLY: starting
0709 12:10:18.255208 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:18.255389 (+   181us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:18.255424 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:18.256233 (+   809us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:18.256532 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:10:18.256582 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:18.256895 (+   313us) log.cc:844] Serialized 47 byte log entry
0709 12:10:18.259020 (+  2125us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:18.259130 (+   110us) write_op.cc:454] Released schema lock
0709 12:10:18.259192 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:18.260799 (+  1607us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:18.260840 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":539412,"reported_tablets":43,"spinlock_wait_cycles":993006848,"child_traces":[["op",{"apply.queue_time_us":181083,"apply.run_cpu_time_us":2558,"apply.run_wall_time_us":5670,"num_ops":5,"prepare.queue_time_us":351035,"prepare.run_cpu_time_us":46877,"prepare.run_wall_time_us":219564,"raft.queue_time_us":43578,"raft.run_cpu_time_us":42158,"raft.run_wall_time_us":64146,"replication_time_us":419459,"spinlock_wait_cycles":24855168,"thread_start_us":358199,"threads_started":4,"wal-append.queue_time_us":52533,"wal-append.run_cpu_time_us":12719,"wal-append.run_wall_time_us":1319023}]]}
I20260709 12:10:25.960678  7545 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.032322  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.035447  5023 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:25.969012  7520 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:25.973807  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:26.045524  4841 connection.cc:256] RPC call timeout handler was delayed by -3.6687073069999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 12:10:26.052452  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:26.059156  4841 connection.cc:256] RPC call timeout handler was delayed by -3.6219073069999013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 12:10:26.047348  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.047868  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.059337  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:26.060070  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:26.060325  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:25.958214  7386 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.049242  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:26.061791  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:26.062346  4871 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:26.050143  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.046103  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:26.053756  4945 raft_consensus.cc:2410] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:26.048266  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.064000  5019 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
W20260709 12:10:25.992486  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.046751  7199 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:26.066375  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:26.067077  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.067718  4950 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:26.057876  4868 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:26.064106  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:25.947274  7516 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:26.054280  4867 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.068527  5604 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.053927  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.052785  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.064743  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.065348  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.064775  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.062306  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.062431  4870 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.070657  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.072387  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.073251  6293 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:26.073570  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:26.074147  4841 connection.cc:256] RPC call timeout handler was delayed by -3.3634395159999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 12:10:26.074515  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.075439  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:26.074488  4841 connection.cc:256] RPC call timeout handler was delayed by -3.3442586670000765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 12:10:26.076244  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:26.076679  4841 connection.cc:256] RPC call timeout handler was delayed by -3.2704586669999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 12:10:26.073158  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.077123  5020 raft_consensus.cc:2410] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:26.073690  6293 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.077893  4946 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:26.078078  5021 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.078521  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.078539  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.078740  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.052268  7065 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:25.958636  7532 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.140818  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.144888  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:26.151077  4841 connection.cc:256] RPC call timeout handler was delayed by -2.7082184799999141s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:10:26.212739  5604 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:26.205343  5025 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:10:26.213189  4841 connection.cc:256] RPC call timeout handler was delayed by -2.5806073070000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30920000000000003s for a response
I20260709 12:10:26.174783  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:26.181901  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.145098  4772 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 4, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 4 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:26.161007  4944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:47298
W20260709 12:10:26.140563  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.076306  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.204710  4947 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
W20260709 12:10:26.215013  4841 connection.cc:256] RPC call timeout handler was delayed by -2.5165184799998315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 12:10:26.141954  4876 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:26.215337  4841 connection.cc:256] RPC call timeout handler was delayed by -2.4175184799998988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:10:26.080760  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:26.157464  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.161059  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.081532  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.109512  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.221922  5019 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:26.205667  4871 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:26.170538  5602 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.210136  4988 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.222935  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.223407  4871 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:26.216223  5568 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.217350  5601 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.060600  7551 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:26.169121  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1213) took 1740 ms. Trace:
I20260709 12:10:26.214754  4874 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:26.224751  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.225665  5021 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:26.079434  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.169965  4915 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.225427  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.227317  4874 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:26.224586  5016 rpcz_store.cc:276] 0709 12:10:24.429021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.429228 (+   207us) service_pool.cc:224] Handling call
0709 12:10:24.431497 (+  2269us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:24.837242 (+405745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.837272 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:25.751271 (+913999us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b2c0003d8a8. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a591e3a11 00007f2a591f3372 00007f2a5a925a01 00007f2a5a8ea43a 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2
0709 12:10:25.751641 (+   370us) log.cc:844] Serialized 52 byte log entry
0709 12:10:25.884949 (+133308us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:25.884986 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.885052 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.168861 (+283809us) raft_consensus.cc:1685] finished
0709 12:10:26.168880 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.169068 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":405300,"raft.queue_time_us":406003,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2497,"spinlock_wait_cycles":45573888,"thread_start_us":132936,"threads_started":1,"wal-append.queue_time_us":195444}
I20260709 12:10:26.058334  7537 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.204453  4946 pending_rounds.cc:85] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 4
I20260709 12:10:26.232834  4946 pending_rounds.cc:107] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:26.218959  4867 raft_consensus.cc:2368] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6.
I20260709 12:10:26.219846  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:26.219542  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.233079  4946 raft_consensus.cc:2889] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.232909  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.079313  7509 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:26.222031  4873 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:26.223300  4988 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:26.215660  4841 connection.cc:256] RPC call timeout handler was delayed by -1.972918479999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2505s for a response
I20260709 12:10:26.052059  7562 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.228794  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.242128  4988 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:26.251996  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.052446  7474 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:26.070360  7538 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.229897  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.077251  7527 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.074679  7516 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:26.231034  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 61138.4us
I20260709 12:10:26.175110  7565 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.231926  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:26.232214  5016 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.232287  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.221268  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.264703  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.236300  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.234444  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.235540  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:26.238893  5017 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.164987  4870 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:26.265151  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.239286  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.266093  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.266371  5025 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.266077  4873 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:26.267807  4915 leader_election.cc:400] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6.
I20260709 12:10:26.267824  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.266785  5601 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:26.239851  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.220124  4772 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 2 to 3, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65), VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66), VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67), VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:26.253867  4876 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:26.255015  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:26.255487  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.255901  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:26.256124  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:26.227975  7545 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.257891  6293 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.259346  4990 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.067824  7520 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.228607  7564 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.237365  7493 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.271231  5016 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:26.284969  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.272138  4841 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.285614  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.265501  5021 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:26.164747  7181 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.285187  5020 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:26.274211  5604 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:26.274390  4869 raft_consensus.cc:2368] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 6.
I20260709 12:10:26.169625  7447 consensus_queue.cc:1059] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:10:26.263777  7075 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.276175  5024 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.277495  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.261229  7538 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:26.217945  7065 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.239657  7386 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.278471  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.280695  5598 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:26.253322  7547 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.300726  5024 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:26.301010  7545 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.301506  7545 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:26.301841  7545 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.303642  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.303910  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:26.286293  4870 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:26.304713  4867 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.287725  4876 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.288379  7519 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.288754  7502 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.224980  7199 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.306874  5025 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:26.307538  5022 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.309324  7519 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:26.310202  7519 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.255002  7509 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.314694  7386 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.295024  7542 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:10:26.315271  5017 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:26.289537  7588 consensus_queue.cc:1059] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:26.266302  7516 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:26.316697  7374 raft_consensus.cc:3055] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:26.293220  4841 leader_election.cc:400] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6.
I20260709 12:10:26.291285  4990 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:26.318097  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.318221  4990 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:26.318830  4841 leader_election.cc:403] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:26.319343  6293 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6.
I20260709 12:10:26.235594  7551 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.324905  4869 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.326272  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.295234  4871 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:26.295492  4868 raft_consensus.cc:2393] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:26.275486  7334 consensus_queue.cc:1059] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:26.270426  7527 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.237972  7537 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.276019  7576 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:26.315704  7542 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:26.289691  7181 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:26.321492  5602 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.340688  7295 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:26.341080  7295 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:26.341863  7295 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.342895  7295 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.337379  7293 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:10:26.344959  7572 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.345274  7572 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:26.346079  7572 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.347112  7509 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.343405  7545 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.347132  7572 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.327340  7588 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.324358  7486 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:26.349864  7495 raft_consensus.cc:3055] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.350266  7495 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:26.351061  7495 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.351866  7527 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.352411  4872 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:26.327870  7075 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.354044  7551 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:26.354224  5023 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 4.
I20260709 12:10:26.356199  7495 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.356734  5018 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:26.357805  7520 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.362119  4872 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:26.362893  4867 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:26.363488  4876 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.320082  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:26.322096  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.323782  5601 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:26.317127  7374 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:26.329567  4868 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:26.370023  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 50014.3us
I20260709 12:10:26.370749  4841 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:26.328685  4915 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.370304  4868 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:26.295825  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:26.307204  7199 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.331135  7348 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:26.331876  7523 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.261466  7474 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.333086  4869 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.333932  4870 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.295668  7538 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.378214  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:26.378782  4947 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.275718  7565 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.338533  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:26.339214  7542 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:26.339560  7532 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.328217  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.373179  6293 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.382655  5604 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:26.327005  7386 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:26.382974  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54834.5us
I20260709 12:10:26.383716  4876 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:26.384076  7542 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.385324  7542 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:26.374478  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45867.3us
I20260709 12:10:26.371279  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:26.377233  4871 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:26.392134  4947 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
W20260709 12:10:26.375428  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 79649.7us
I20260709 12:10:26.386947  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.387605  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:26.393837  6293 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.393962  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.373574  4841 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.393083  4839 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:26.369515  7075 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:26.374568  7499 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:26.395907  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.397008  6293 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.397789  4841 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.399052  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.399765  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.399971  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.405489  5568 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.400595  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.380759  7342 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.401190  4874 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.376654  7551 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:26.388823  7523 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:26.416692  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.388301  7527 raft_consensus.cc:2764] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:26.421041  7065 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.421772  7588 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:26.422472  7569 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:26.431700  6293 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:26.424165  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:26.440964  4841 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.407025  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.441493  6293 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.425292  5019 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.376139  7486 consensus_queue.cc:1059] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:26.381536  7519 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:10:26.402191  7502 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.392553  7386 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:26.413537  7293 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.432597  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:26.431703  5604 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:26.413270  7590 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:26.441958  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.424759  4874 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:26.435384  7348 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.394599  7334 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:10:26.446878  4841 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:26.450598  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.454622  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.455009  7486 raft_consensus.cc:3055] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:26.455924  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.456506  5018 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.456444  4915 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:26.457569  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.432703  7533 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.432102  7571 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:26.460422  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.434942  7499 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:26.462587  4841 leader_election.cc:400] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:26.439415  7503 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.436841  7588 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:26.482215  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.497197  4841 leader_election.cc:403] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:26.466627  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:26.490752  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.495159  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.494907  5019 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.501014  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.455224  7348 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.449074  7065 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:26.452602  7509 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.447681  7562 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:26.495131  7519 consensus_queue.cc:1243] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer ab9da67236874634be59ebfd05b18255 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:26.437320  7493 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:26.504964  5020 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:26.506633  5023 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:26.508183  5018 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:26.458655  7386 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.436602  7541 consensus_queue.cc:1059] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:26.401654  7374 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.452142  7293 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:26.462045  7476 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:26.465533  4991 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.451836  7075 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.464664  7502 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:26.459818  7527 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.497407  7013 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:26.517509  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:26.532585  7493 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.494310  7551 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:26.494848  7547 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.504240  7474 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:26.495414  7447 consensus_queue.cc:1059] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:10:26.512336  7181 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.464929  7590 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:10:26.519712  7503 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5.
I20260709 12:10:26.521600  7545 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:26.458094  7486 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:26.520346  7065 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:26.553084  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 87629.4us
I20260709 12:10:26.445499  7535 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:10:26.549964  7293 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.562978  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 121084us
I20260709 12:10:26.551829  7520 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:26.550181  7476 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:26.556865  7562 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:26.573772  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 135414us
I20260709 12:10:26.576560  4991 leader_election.cc:400] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 6.
I20260709 12:10:26.563476  7493 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:26.562310  7551 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:26.578490  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 122099us
W20260709 12:10:26.589782  4822 auto_rebalancer.cc:893] Removing replace marker failed: Replica 4f3bf546572147c3abe4522189e86ce6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:26.566797  7374 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.517040  7523 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.580210  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:26.564924  7565 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:26.589200  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 126714us
I20260709 12:10:26.779685  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.780462  4945 raft_consensus.cc:2368] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
I20260709 12:10:26.780604  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.780865  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:26.781296  4943 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:26.781383  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:26.782104  5601 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 6: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:26.582527  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.567804  7181 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:26.597671  7537 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:26.598022  7545 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:26.600613  4991 leader_election.cc:403] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:26.543913  7588 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:26.601917  7595 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:10:26.603579  7476 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.735442  7551 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:26.788787  7181 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.794266  7535 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.743431  7486 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.602859  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:26.752883  4822 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:10:26.564222  7499 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.812645  7293 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.813148  7493 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.814291  7493 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.814601  7572 raft_consensus.cc:2764] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:26.814733  7293 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.753252  5604 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:26.773741  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.774621  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:26.782975  4988 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:26.785290  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:26.785966  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.786840  4876 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:26.818849  4872 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:26.795651  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:26.811889  4822 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:10:26.810205  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 207379us
I20260709 12:10:26.826122  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:26.769801  7527 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:10:26.828889  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 252447us
I20260709 12:10:26.830356  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:26.831255  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 48370.1us
W20260709 12:10:26.832526  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 47319.8us
W20260709 12:10:26.833935  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.834626  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.834759  4949 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:10:26.835090  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.837322  4988 leader_election.cc:400] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
I20260709 12:10:26.837607  4988 leader_election.cc:403] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:26.838482  5018 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:26.779292  7597 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:10:26.817890  7516 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:26.791733  7348 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:26.858305  7598 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:10:26.869880  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:26.731078  7065 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.877796  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:26.886365  4946 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:26.887409  4873 raft_consensus.cc:2368] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:10:26.856086  7519 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.862411  7603 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:26.861706  7334 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.862306  7602 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:26.892041  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 309558us
I20260709 12:10:26.890276  4870 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.868148  7486 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:26.889393  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.892474  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 118367us
I20260709 12:10:26.894228  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.865182  7293 consensus_queue.cc:1059] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:26.865635  7547 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:10:26.860785  7527 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.891812  7334 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:26.906152  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.902396  7610 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:26.908566  7610 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:10:26.903839  7538 consensus_meta.cc:287] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.000s
I20260709 12:10:26.898985  7519 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
W20260709 12:10:26.907812  7199 consensus_meta.cc:287] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 12:10:26.901228  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.898505  7602 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:26.916977  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.918371  4944 raft_consensus.cc:606] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:10:26.918757  4944 raft_consensus.cc:614] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:26.901747  7603 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:26.906450  7334 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.926275  7295 consensus_meta.cc:287] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.002s
I20260709 12:10:26.917876  7541 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:26.915515  7538 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:26.925339  7600 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.934000  7541 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:26.939087  7538 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:26.936605  7600 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:26.939545  7541 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.940296  7600 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.929773  7610 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.935137  7571 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:26.943418  7527 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:26.942619  7602 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:26.943460  7603 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:26.979794  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 73526us
I20260709 12:10:26.980441  4841 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.983821  4840 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:26.986348  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:26.986919  4942 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:26.993695  7075 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.061401  4871 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.064481  7516 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:27.066375  7527 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.084205  7611 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.084265  7613 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.084987  7611 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.085486  7611 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:27.102569  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 240371us
I20260709 12:10:27.124977  7606 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:10:27.130046  7520 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:27.130569  7520 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.940654  7551 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.132933  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811353fb6b174f3e96608844f05794de"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:27.136741  7533 raft_consensus.cc:3055] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.138737  7533 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:27.139981  7533 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.143273  4991 leader_election.cc:400] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:10:27.143664  4991 leader_election.cc:403] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:27.144460  7533 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.135211  7523 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.151559  7618 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.153173  7374 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:27.155591  7374 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:27.157192  7624 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:27.157714  7624 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:27.158944  7624 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.160424  7624 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.148416  4948 raft_consensus.cc:606] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.161276  7476 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.164887  7551 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:27.172662  7386 consensus_meta.cc:287] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
I20260709 12:10:27.173194  7386 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.176667  7386 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:27.177407  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.185256  7476 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.186637  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:27.160948  7557 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:27.194130  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.184886  7523 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.202930  7523 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.204066  7519 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.206914  5605 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:27.209683  7610 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.210100  7610 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.210440  7610 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.210708  7334 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.215308  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:27.216171  5017 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:27.216770  5018 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:27.217751  7386 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:27.218027  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:27.219208  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:27.198364  4948 raft_consensus.cc:606] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:27.220000  4948 raft_consensus.cc:614] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:27.222472  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:27.223322  4874 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:27.224342  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:27.194777  7557 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:27.225705  7557 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.226219  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:27.227144  4875 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:27.222494  5019 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:27.225656  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:27.221374  7181 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.242709  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:27.243227  5605 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:27.243901  7170 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.244304  7170 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:27.244710  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:27.245519  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:27.246348  4873 raft_consensus.cc:2393] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:27.251184  7342 raft_consensus.cc:3055] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.251581  7342 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:27.255508  7374 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:10:27.256000  7532 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.256475  7537 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.258723  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:27.204671  7519 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.197535  7606 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.269733  7520 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.270826  7334 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:27.270609  7562 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:27.274540  5605 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:27.243429  4876 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.280735  7532 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.283208  7532 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:27.288509  4876 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:27.290820  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:27.293993  4871 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:27.295933  5023 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:27.245425  7170 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.300967  7170 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.300905  5570 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:27.305292  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 46679.7us
I20260709 12:10:27.306946  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:27.279791  7606 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.315157  7564 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.315709  7564 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.316567  7606 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.318344  4871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c480da15ff054400bdd09744d494717c"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:27.318994  4871 raft_consensus.cc:606] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
W20260709 12:10:27.319198  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 481845us
I20260709 12:10:27.273437  7611 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.307703  7532 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:27.302246  7519 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:27.303717  7374 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.336623  7556 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:27.339093  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:27.345449  5021 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:27.331666  7532 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.346674  7532 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.352074  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:27.352617  4872 raft_consensus.cc:606] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.352941  4872 raft_consensus.cc:614] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:27.353344  4840 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:27.348658  7348 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.357430  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:27.361231  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:27.365357  7181 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.357769  7565 raft_consensus.cc:2764] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:10:27.366187  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 922488us
I20260709 12:10:27.369630  4917 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.369469  7599 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.368574  7565 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:10:27.374409  4944 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.371605  7556 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:27.379503  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:27.381628  7499 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:27.387217  4872 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:27.387373  7564 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.388331  4947 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:27.371807  7519 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.377959  7527 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.384537  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:27.392670  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.392964  4949 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.393574  5020 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:27.392798  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:27.396127  4870 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:27.357501  7348 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.399462  7588 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.400279  7493 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.401684  7557 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:27.401996  4917 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.376331  7556 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.414405  4872 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:27.415277  7486 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:27.402581  7181 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.411127  7519 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.408659  7342 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.427326  7342 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.438169  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:27.437594  4839 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.448993  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:27.454319  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:27.441056  7611 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.499832  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:27.500962  7564 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:27.501467  4917 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.502851  4917 leader_election.cc:400] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6.
I20260709 12:10:27.504338  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.463824  7520 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:27.507432  5023 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.508292  7549 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:27.509313  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:27.511806  5016 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:27.465840  7639 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:10:27.472995  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.473459  4946 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:27.474694  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.475399  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 98366.5us
I20260709 12:10:27.479835  7390 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.480973  4949 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:27.482280  7519 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:27.482719  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:27.483932  4951 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:27.484597  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:27.485457  7170 consensus_queue.cc:1059] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:27.488924  4942 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:27.436461  7181 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.454398  7348 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:27.497938  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49271.6us
I20260709 12:10:27.514065  5024 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:27.526711  4839 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.463761  7537 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 6.
I20260709 12:10:27.532760  4945 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:27.517292  7342 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.538264  4944 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:27.539024  7486 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:27.546927  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.547325  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.549417  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2220) took 1131 ms. Trace:
I20260709 12:10:27.549821  4950 rpcz_store.cc:276] 0709 12:10:26.405453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.405599 (+   146us) service_pool.cc:224] Handling call
0709 12:10:26.414933 (+  9334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.559664 (+144731us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:26.892851 (+333187us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.988883 (+ 96032us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.989001 (+   118us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:26.991989 (+  2988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.529428 (+537439us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540032da54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:27.529470 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.536899 (+  7429us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":344179,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":31,"raft.queue_time_us":5015,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":244,"spinlock_wait_cycles":332384512,"thread_start_us":426778,"threads_started":2,"wal-append.queue_time_us":51524}
I20260709 12:10:27.554409  4948 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:27.555236  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:27.555794  5601 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:27.538110  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:27.538847  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:27.514918  7549 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.574036  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:27.574385  5022 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:27.576046  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 71778.7us
I20260709 12:10:27.574656  4869 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:10:27.580482  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:27.582450  7644 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:27.575006  7611 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.584370  4869 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:27.589072  4945 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:27.589419  4945 pending_rounds.cc:85] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 6
I20260709 12:10:27.589658  4945 pending_rounds.cc:107] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:27.589915  4945 raft_consensus.cc:2889] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:27.594410  7640 log.cc:927] Time spent T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:10:27.594889  5022 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:27.601069  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 74457.6us
I20260709 12:10:27.601271  4949 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:27.603181  4870 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.609560  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.598197  7610 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.613060  7541 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:10:27.614599  7610 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.615303  4990 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:27.616348  7348 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.616618  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:27.616905  4943 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:27.617882  5598 raft_consensus.cc:2368] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
I20260709 12:10:27.608433  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:27.619131  4948 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:27.620509  4990 leader_election.cc:400] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
I20260709 12:10:27.620882  4990 leader_election.cc:403] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:10:27.621260  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.622355  7519 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.620777  7532 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.626538  5025 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:10:27.628681  7532 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:27.629565  7390 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:27.629802  7075 consensus_queue.cc:1059] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:27.630897  7390 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.600905  7181 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:27.631263  7390 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:27.632072  7390 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.632582  7549 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:27.633795  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.616709  7348 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.634325  7493 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:27.634606  7348 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.637972  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:27.640041  7390 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.643033  7533 raft_consensus.cc:3055] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.643556  7533 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:27.644647  7533 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.645833  7533 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.648875  7493 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:27.649320  7532 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.649909  7362 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:27.650068  7493 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.650882  7606 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.651270  7606 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:27.651448  7493 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.651981  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.653182  4839 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.653421  7606 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.654819  7606 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.653844  7503 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:27.651535  7362 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:27.656777  7362 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:27.657115  7362 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:27.657868  7362 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.658980  7362 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:27.660315  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.661778  5025 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:27.650349  7532 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.663980  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:27.664837  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:27.665457  5018 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.665979  7532 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.666890  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:27.663599  4988 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:27.669256  7342 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:27.670205  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 66412.3us
I20260709 12:10:27.670753  5019 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:27.670935  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.672176  7519 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
I20260709 12:10:27.671185  7503 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.673902  7503 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.674238  7503 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.675369  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:27.676399  7013 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:27.676795  7013 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.677243  7013 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:27.680258  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.688544  5019 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:27.711431  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:27.717149  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 53630.9us
I20260709 12:10:27.719437  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:27.713955  7557 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.734534  4988 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:27.711870  7348 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.729322  7486 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.741083  4840 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.730384  7499 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 12:10:27.750703  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 79880.8us
I20260709 12:10:27.740077  7549 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:27.754995  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:27.756366  4947 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.752566  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:27.751824  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:27.757477  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:27.741876  7486 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:27.760185  4948 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:27.741628  7181 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.761916  7607 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:27.762442  7502 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:27.762734  5602 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:10:27.762048  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.759196  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:27.767717  4951 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:27.752231  7527 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.753952  7611 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.770398  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:27.763717  4949 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:10:27.773658  4949 pending_rounds.cc:85] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 6
I20260709 12:10:27.773907  4949 pending_rounds.cc:107] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:10:27.774129  4949 raft_consensus.cc:2889] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:27.763088  7486 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.777693  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:27.779224  4950 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:27.780989  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:27.781656  7548 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:10:27.762471  7607 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:27.777057  7532 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:10:27.771219  7549 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:27.785856  7549 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:27.786705  7549 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.790256  7607 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:27.799731  7503 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:27.800875  7181 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.803066  7348 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:27.797025  7532 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:27.777386  7523 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:10:27.809798  4945 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.808976  7342 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.816185  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:27.816198  4872 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:27.819288  4869 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:27.819849  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:27.857055  4873 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.821327  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:27.857686  4875 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:27.777020  7065 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:10:27.859249  6293 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:27.827472  5018 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:27.829238  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:27.831514  7503 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:27.837261  4947 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:27.843484  7610 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:27.846453  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 68287.3us
I20260709 12:10:27.846911  7519 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:27.847961  4946 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:27.851512  4942 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:27.869837  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:27.867640  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:27.872766  5602 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.851269  7181 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:27.873533  7551 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:27.879896  5016 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:27.868371  7557 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.898351  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:27.912550  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 153577us
I20260709 12:10:27.898440  5567 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:27.915992  5605 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:27.871999  7519 consensus_queue.cc:1243] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:27.927740  5605 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:27.929378  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:27.930799  4946 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.928579  4840 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:27.876920  7348 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:10:27.922863  7181 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.876349  7610 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:27.938860  5605 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:27.942170  5605 pending_rounds.cc:85] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 4
I20260709 12:10:27.942401  5605 pending_rounds.cc:107] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:27.942617  5605 raft_consensus.cc:2889] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:27.940994  4840 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:27.946233  4988 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:27.918103  7541 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:27.954458  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:27.943686  7606 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:27.929291  7520 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:27.932438  7170 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:10:27.962558  7493 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:27.963138  7600 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:27.964248  7348 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:27.935946  7611 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 12:10:27.987659  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.958623  7618 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.015515  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 69342us
W20260709 12:10:28.016534  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.948401  7565 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:10:28.012645  7588 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.961516  7181 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:28.033046  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.038187  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.964635  7605 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:10:27.978288  7606 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:28.044251  7519 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:28.044786  7181 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.045501  7618 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.045704  4988 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:28.047230  7611 consensus_queue.cc:1243] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:27.964545  7362 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:10:28.014386  7600 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:10:28.052464  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.080827  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.060652  4873 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:28.062476  4946 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:28.062932  4945 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:28.063531  5602 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
W20260709 12:10:28.079875  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 123510us
I20260709 12:10:28.082906  4990 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:28.065347  4875 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:28.010851  7348 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:28.073629  6293 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:27.964699  7013 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.086592  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:28.087687  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 130814us
I20260709 12:10:28.070574  7493 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:28.104136  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:28.104740  4942 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:28.118994  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 184171us
I20260709 12:10:28.102210  7624 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:28.078246  7486 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:28.146878  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.146790  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:28.149736  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:28.150858  7515 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:28.153347  7515 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.153723  7515 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:28.154232  7342 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:28.157130  7600 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:28.158197  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.159147  7618 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.134358  7633 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:28.103910  7502 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:28.164227  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:28.167514  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.121170  7610 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.143642  7624 raft_consensus.cc:697] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:28.127156  7493 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.188565  4839 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:28.173450  7633 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:28.150633  7606 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.262650  7603 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.172976  7618 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.264117  7618 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.266099  7618 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.266516  7515 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.275961  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:28.278466  5605 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:28.279903  4990 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:28.253096  7181 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:28.281509  7503 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:28.294140  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 123922us
I20260709 12:10:28.284433  7588 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:28.317199  7503 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:28.318267  7503 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.321780  7515 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.219924  7348 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.331872  7633 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.333135  7493 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.333302  7181 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:28.334185  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 65446.1us
I20260709 12:10:28.301095  7588 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.338613  7486 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.339452  7348 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:28.340246  7674 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:28.341038  7631 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:28.342338  7603 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:28.334311  7624 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.304054  7671 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:28.347107  7680 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.348455  7556 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.351590  7557 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.374780  7677 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:28.340583  7013 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.374455  7557 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.353297  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:28.355512  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:28.363080  7603 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.370503  7631 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.373334  7671 consensus_queue.cc:1243] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer baa50eb5ed704004b7f391934a59d010 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:28.374363  7556 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.355232  7588 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:28.400833  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47111.1us
I20260709 12:10:28.399786  7181 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.402176  7181 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:28.402549  7181 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.405926  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:28.399055  7671 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.378880  7680 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.402935  7631 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:28.404343  7557 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.468621  4917 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:10:28.470897  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.475214  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.475850  7557 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.476442  7557 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.478040  7486 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:28.478369  7557 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:28.478420  7486 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:28.479132  7557 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:28.479758  7557 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.483078  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:28.484561  7557 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.484982  7170 raft_consensus.cc:2764] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:28.487151  7680 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.475811  7631 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:28.498440  7527 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:28.498874  7527 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:28.499636  7527 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:28.501176  7691 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:10:28.503367  7556 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.504788  4944 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:28.505143  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:28.505373  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:28.505733  4947 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.505899  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:28.507663  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:28.508889  7690 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:28.509368  7690 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.511653  7690 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.507699  7181 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.512948  7631 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:28.514894  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 105531us
I20260709 12:10:28.531522  7631 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:28.515978  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.513862  4950 pending_rounds.cc:85] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 6
I20260709 12:10:28.533622  4950 pending_rounds.cc:107] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:10:28.533874  4950 raft_consensus.cc:2889] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:28.535471  7689 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 12:10:28.518976  7662 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.379s	user 0.002s	sys 0.000s
I20260709 12:10:28.515544  7527 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:28.529727  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:28.479532  7486 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.545332  7692 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.545787  7692 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.547715  7692 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.551918  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:28.554111  7181 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.554700  7181 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:28.560076  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:28.549180  7680 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:28.566919  4947 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:28.571547  7603 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.578971  7486 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:28.594594  7667 log.cc:927] Time spent T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.461s	user 0.001s	sys 0.000s
I20260709 12:10:28.595029  4948 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:28.568378  7588 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.606333  7541 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 12:10:28.615612  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 82545.4us
I20260709 12:10:28.645658  7493 raft_consensus.cc:993] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:28.653762  7588 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.626920  7181 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:28.677477  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:28.679162  5598 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.696943  7065 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:28.697832  7065 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.700929  5598 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:28.703060  4990 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:28.709045  7588 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:28.710100  7588 raft_consensus.cc:697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:28.710887  7588 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.713464  7342 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:28.713855  7342 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:28.714637  7342 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.715538  7342 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.702797  7603 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:28.717707  7181 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.720944  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:28.722244  7065 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:28.726085  5024 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:28.727023  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:28.730839  5018 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:28.731791  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:28.732401  5025 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:28.733376  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:28.738122  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:28.738598  7493 raft_consensus.cc:1081] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:28.738626  5023 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:28.741755  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 88486.9us
I20260709 12:10:28.744525  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:28.750263  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:28.751596  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:28.766695  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:28.767272  5022 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:28.769860  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:28.770462  5018 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:28.777340  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:28.786700  4943 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:28.788311  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.791579  4945 raft_consensus.cc:1217] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Deduplicated request from leader. Original: 5.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 12:10:28.792060  4945 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:28.762153  7565 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.765447  7527 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:28.800902  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:28.814517  5024 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:28.815793  5019 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:28.820039  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:28.821993  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:28.819945  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:28.795658  7503 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.825559  4876 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.828310  5023 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:10:28.830760  4873 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:28.837857  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:28.844625  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:28.845934  4873 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:28.844574  7170 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.816681  7565 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.870388  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:28.872402  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:28.873952  5023 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.876235  7565 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:28.876698  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.846419  7503 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.878459  7503 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.881143  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:28.882730  4867 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.884994  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:28.885676  4876 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:28.885874  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:28.886603  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:28.887163  4870 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:28.887979  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:28.889267  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:28.902578  7520 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:28.908617  5022 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:28.909175  4874 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:28.910871  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:28.915978  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:28.922750  4943 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:28.872128  7170 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.927330  4839 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:28.933007  6293 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.940526  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:28.926296  7631 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:28.955747  4944 raft_consensus.cc:2410] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:28.928716  7532 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:28.964775  7633 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:28.965688  7631 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:28.967780  7631 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:28.965005  7532 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:28.974843  7532 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.978812  4915 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:28.979628  7690 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:28.982362  4772 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 122) took 18047 ms (client timeout 15000 ms). Trace:
I20260709 12:10:28.985999  4774 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 5, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:28.959753  7170 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:28.988318  4774 catalog_manager.cc:5697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 4, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:28.961061  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:28.962402  7013 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:28.964272  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:28.961141  5022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "811353fb6b174f3e96608844f05794de"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55722
I20260709 12:10:28.991581  4872 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
W20260709 12:10:28.993597  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 52264.7us
I20260709 12:10:29.004172  4988 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.007520  5022 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:29.007880  5022 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:29.007933  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 43741.5us
I20260709 12:10:28.991868  4915 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:28.982776  4772 rpcz_store.cc:269] 0709 12:10:10.935228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.629046 (+693818us) service_pool.cc:224] Handling call
0709 12:10:28.982126 (+17353080us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:26.572851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:27.373562 (+800711us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5c0026020c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a60adc331 00007f2a60adc221 00007f2a60ad6f6c 00007f2a5e334d69 00007f2a5e3200a6 00007f2a5e31fd58 00007f2a5e3249f1 00007f2a5e3249a9 00007f2a5e324939 00007f2a5e324901 00007f2a5e323b2d
0709 12:10:27.373728 (+   166us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:27.373772 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:10:27.373808 (+    36us) tablet.cc:662] Decoding operations
0709 12:10:27.374662 (+   854us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:27.374754 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:27.374793 (+    39us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:27.375271 (+   478us) tablet.cc:701] Row locks acquired
0709 12:10:27.375315 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:10:27.375533 (+   218us) write_op.cc:270] Start()
0709 12:10:27.375774 (+   241us) write_op.cc:276] Timestamp: P: 1783599027375454 usec, L: 0
0709 12:10:27.375838 (+    64us) op_driver.cc:348] REPLICATION: starting
0709 12:10:27.412379 (+ 36541us) log.cc:844] Serialized 1736 byte log entry
0709 12:10:27.805724 (+393345us) op_driver.cc:464] REPLICATION: finished
0709 12:10:27.960082 (+154358us) write_op.cc:301] APPLY: starting
0709 12:10:27.965799 (+  5717us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:27.965960 (+   161us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:27.965995 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:28.039149 (+ 73154us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:28.083660 (+ 44511us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:28.083718 (+    58us) write_op.cc:312] APPLY: finished
0709 12:10:28.148685 (+ 64967us) log.cc:844] Serialized 41 byte log entry
0709 12:10:28.153037 (+  4352us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:28.153138 (+   101us) write_op.cc:454] Released schema lock
0709 12:10:28.153195 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:28.153635 (+   440us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:28.153661 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5337994,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":131905,"apply.run_cpu_time_us":3341,"apply.run_wall_time_us":207509,"num_ops":4,"prepare.queue_time_us":235396,"prepare.run_cpu_time_us":30569,"prepare.run_wall_time_us":970408,"raft.queue_time_us":193322,"raft.run_cpu_time_us":34304,"raft.run_wall_time_us":122658,"replication_time_us":429746,"spinlock_wait_cycles":4999168,"thread_start_us":467902,"threads_started":4,"wal-append.queue_time_us":148487}]]}
I20260709 12:10:29.008796  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.011364  4774 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 5, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.013809  4988 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.016284  5016 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:29.018005  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.018620  5019 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:29.002288  7348 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.030364  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.023716  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.028460  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:29.034940  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 101340us
I20260709 12:10:29.037345  4839 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:29.033432  4840 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.019598  7532 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.041450  4947 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:29.023494  7556 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.020074  7618 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.043845  4947 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.044122  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.019515  7682 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:29.046813  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.038501  5022 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.047363  4948 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.046749  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.052470  4950 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:29.023355  7537 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:29.060043  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.063326  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.064038  4947 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:29.045189  7548 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.072099  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.045146  7499 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:29.044992  7181 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:29.079773  7705 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.075783  4945 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:29.051244  7690 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:29.077872  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.078301  4946 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:29.045282  7532 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:29.082329  4774 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 4, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.083119  4915 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:29.074393  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:29.079524  7181 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.077361  5022 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.060184  7588 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:29.034729  7348 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.062470  7600 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.080179  7705 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.078954  7548 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.091432  7499 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:29.096444  7499 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.093925  7548 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.104616  7523 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.105118  7523 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.106041  7548 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.107995  7548 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:29.084550  7532 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.122152  7181 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.086694  7170 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.130076  7556 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:29.149345  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:29.149976  4948 raft_consensus.cc:3055] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:29.150295  4948 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:29.154404  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.094630  7705 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.086220  7690 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.104542  7013 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:29.091741  7551 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:29.172528  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:29.174604  4946 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.130980  7556 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.173501  4988 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:29.127365  7170 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.091981  7588 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.183775  7588 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.094498  7600 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.177410  4948 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.170562  7725 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:29.197157  4948 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:29.151618  7631 consensus_queue.cc:1059] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:29.209379  7631 raft_consensus.cc:3055] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:29.209635  7631 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:29.180004  7170 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.176185  7556 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:29.204639  4946 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:29.186205  4774 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.172943  7541 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:10:29.187055  7713 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.261s	user 0.002s	sys 0.001s
I20260709 12:10:29.212416  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.215317  4874 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:29.212524  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.186685  7703 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.203999  7588 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:29.218822  4946 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:29.220079  4774 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 3, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:29.179409  7723 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:29.224886  4946 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:29.177942  7013 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.244132  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:29.244796  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.246980  4948 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
I20260709 12:10:29.249147  5602 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:29.226567  7723 consensus_queue.cc:1243] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:29.251235  4774 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 3, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:29.252960  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 79519.1us
I20260709 12:10:29.254496  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:29.254632  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.261332  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.261852  4948 raft_consensus.cc:2393] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:29.264045  7013 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:29.269193  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.269767  4872 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:29.273512  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.273137  7551 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:29.275647  7551 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.281133  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.223393  7631 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.284221  7631 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.286243  7551 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:29.286978  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.259174  7588 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.290485  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:29.291064  4868 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.287545  4948 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:29.298015  4868 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:29.301966  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:29.259660  7537 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:10:29.306205  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.307968  5020 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:29.249511  7556 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.299527  7588 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:29.319216  6293 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.321059  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.321740  4874 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 5: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:29.323586  5024 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:29.324884  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.322055  6293 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:29.328068  7728 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:29.328501  7611 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:29.329556  4946 raft_consensus.cc:1217] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-8.5]   Dedup: 5.3->[6.4-8.5]
I20260709 12:10:29.329892  7611 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.330562  4872 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.330793  7705 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.331890  4951 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:29.328948  7493 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:29.333799  6293 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.334714  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:29.336766  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:29.337301  5604 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:29.328256  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.338830  4948 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:29.313093  7588 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.338773  4946 pending_rounds.cc:85] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 3
I20260709 12:10:29.341499  4946 pending_rounds.cc:107] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:10:29.312716  7690 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:29.341775  4946 raft_consensus.cc:2889] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:29.341804  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.343051  4949 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:29.344439  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.345014  5023 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:29.337222  7600 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:29.337963  7556 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.331890  7611 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.349944  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:29.351135  5016 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.370128  7532 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.372402  5605 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:29.362082  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:29.373206  4872 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:29.373809  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:29.375741  5016 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
W20260709 12:10:29.380877  7730 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:10:29.382073  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:29.351094  7705 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:29.384769  4871 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:29.384871  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:29.390720  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.393477  4872 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:10:29.380736  7611 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:29.382824  7618 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:29.395069  7541 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.409123  7532 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:29.411121  7523 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.418743  7724 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:29.422084  4915 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:29.429421  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:29.430429  7631 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:29.430873  7348 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.387404  7725 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.433862  4872 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:29.435289  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:29.437510  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.443532  4947 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:29.448349  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:29.440626  7703 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:29.432879  7541 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.449290  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:29.449810  5604 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:29.450537  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:29.451061  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.400440  7733 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:29.439491  7724 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:29.449800  4839 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:29.442288  7725 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:29.465405  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:29.467919  5016 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:29.471956  5602 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:29.471956  5601 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:29.432003  7611 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.454432  7348 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:29.434811  7618 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.480436  5016 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:29.483414  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.471673  7737 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:10:29.486316  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.494711  5023 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:29.486918  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.454600  7541 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.490005  5597 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:29.492605  5017 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:29.485757  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:29.442633  7631 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.459090  7633 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:29.471235  7523 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:29.498914  7618 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:29.501224  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.501819  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.502811  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:29.465569  7703 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:29.506759  4917 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.476894  7725 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.483965  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.495555  5019 raft_consensus.cc:2410] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:29.510530  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.508517  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:29.511205  5023 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.465943  7733 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:29.498502  7744 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:10:29.514696  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:29.528743  4868 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:29.479532  7606 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:29.487970  7503 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:10:29.542580  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.544308  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.551604  4873 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:29.532920  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:29.553714  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.528143  7493 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.513486  7523 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:29.554920  5016 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:29.528373  7564 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:29.523969  7348 raft_consensus.cc:697] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 2 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:29.557096  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:29.558427  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:29.561359  4876 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:29.562858  4872 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:29.562443  4871 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.543905  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.563710  4869 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:29.564602  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.565711  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.533845  7181 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:29.570770  7523 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:29.572003  7716 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.392s	user 0.000s	sys 0.003s
I20260709 12:10:29.512449  7548 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:29.573012  7703 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.575088  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:29.577397  5023 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
W20260709 12:10:29.577749  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.579619  4868 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:29.524268  7682 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:10:29.580696  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 55697.8us
I20260709 12:10:29.581559  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.582279  7631 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:29.552446  7696 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:29.527990  7342 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:10:29.586436  4867 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:29.587033  7745 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:29.591899  7348 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.592322  4871 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:29.531487  7724 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.653934  7724 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.585673  7625 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:10:29.655012  7541 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.584225  7170 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.656173  5598 raft_consensus.cc:2368] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
W20260709 12:10:29.657174  7748 consensus_queue.cc:1175] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f3bf546572147c3abe4522189e86ce6" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:10:29.589541  7564 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:29.658397  7564 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.660035  7541 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:29.594686  7723 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.595166  7548 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:29.574366  7493 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:29.661108  7548 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:29.661953  7493 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.598161  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:29.598526  7611 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.602162  5019 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:29.604934  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:29.607594  7733 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:29.623486  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.623672  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.642496  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.566129  7603 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:29.665854  5019 pending_rounds.cc:85] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 3
W20260709 12:10:29.624594  7742 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:10:29.657593  7170 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:29.671839  5019 pending_rounds.cc:107] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:29.687901  5019 raft_consensus.cc:2889] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:29.673094  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 75012.8us
W20260709 12:10:29.673393  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49808.3us
I20260709 12:10:29.689043  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:29.666574  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 85959.2us
I20260709 12:10:29.641678  7745 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.641676  7520 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:10:29.643265  7342 consensus_queue.cc:1243] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:10:29.669414  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 46358.8us
I20260709 12:10:29.662094  7548 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:29.718832  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 207272us
I20260709 12:10:29.718672  4990 leader_election.cc:400] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
I20260709 12:10:29.720577  4990 leader_election.cc:403] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:29.722345  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 192571us
I20260709 12:10:29.653062  7606 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:29.732614  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:29.733186  4943 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.661070  7723 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:29.687091  7625 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:29.736526  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.715206  7390 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.674456  7611 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.745059  7170 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:29.736984  7625 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.746140  7625 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.715324  7745 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:29.743701  7548 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.754305  7723 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:29.674168  7746 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:10:29.761860  5604 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 2.
W20260709 12:10:29.767685  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 169744us
I20260709 12:10:29.785485  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:29.760159  7696 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.736872  7532 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:10:29.794482  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:29.797194  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:29.797770  5016 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.827549  5016 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:29.831451  4915 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:29.836073  7486 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.836536  7486 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:29.838953  7486 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:29.850629  4943 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:29.851825  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:29.849928  7745 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:29.858326  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 140482us
I20260709 12:10:29.863991  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:29.910732  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 50642.5us
W20260709 12:10:29.914043  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 293892us
W20260709 12:10:29.914599  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.914870  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:29.859112  7618 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.858368  7759 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:29.922338  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 205834us
I20260709 12:10:29.910001  7527 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.935643  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 196908us
I20260709 12:10:29.946635  4917 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:29.950026  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.953449  4991 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.954531  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.956036  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.959611  4991 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.965420  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.966897  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:29.966090  7761 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:29.973884  7756 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.966392  7723 raft_consensus.cc:2764] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:29.974622  7756 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.974793  7748 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:29.976856  7757 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:29.966286  7751 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.978211  7761 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.981026  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.981731  7751 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.989630  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:29.990686  7748 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.993688  7745 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:29.999576  7748 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:29.944898  7759 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:30.002558  7759 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:30.005870  7348 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:30.008144  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:30.008945  7348 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.009651  7703 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.011385  7751 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:30.016594  7588 consensus_meta.cc:287] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.666s	user 0.003s	sys 0.004s
W20260709 12:10:30.028824  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 61966.1us
I20260709 12:10:29.925163  7618 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.031502  7493 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:30.036708  7725 consensus_meta.cc:287] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.001s
I20260709 12:10:30.037181  7725 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:29.946502  7527 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:30.051200  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:10:30.060084  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 227747us
W20260709 12:10:30.051744  7772 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.051s	user 0.004s	sys 0.000s
W20260709 12:10:30.060688  7764 log.cc:927] Time spent T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.057s	user 0.004s	sys 0.000s
I20260709 12:10:30.079294  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:30.020267  7625 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:30.108908  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 75488.3us
I20260709 12:10:30.109750  4917 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:30.112241  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:30.113744  4917 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:30.115715  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:30.077056  7170 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.042836  7588 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:30.129197  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 205423us
I20260709 12:10:30.094597  7548 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.130403  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:30.181371  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51041.3us
I20260709 12:10:30.113474  7520 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:30.186362  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 90894us
I20260709 12:10:30.199041  5018 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:30.182401  7527 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:30.242830  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 127172us
I20260709 12:10:30.239084  7725 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:30.264784  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 73354.2us
I20260709 12:10:30.270561  7748 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:30.274264  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.235060  7756 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:30.250029  7785 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:30.196177  7548 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:30.295570  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 98233.8us
I20260709 12:10:30.263471  7752 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:30.288349  7170 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:30.292501  7696 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 5. Current term is 6.
I20260709 12:10:30.332010  7779 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:30.326427  7752 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.332615  7783 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:30.333077  7588 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:30.333295  7795 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:30.334156  7548 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:30.458357  7783 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:30.334811  7763 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:10:30.459298  7783 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:30.335639  7786 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:10:30.336436  7773 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:10:30.337458  7775 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:10:30.344861  7743 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.757s	user 0.005s	sys 0.001s
I20260709 12:10:30.345574  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:30.463500  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 309) took 1154 ms. Trace:
I20260709 12:10:30.463856  5020 rpcz_store.cc:276] 0709 12:10:29.308955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.309075 (+   120us) service_pool.cc:224] Handling call
0709 12:10:29.319715 (+ 10640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.320019 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.320046 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.320445 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 12:10:29.425819 (+105374us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b180033f460. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a0d1 00007f2a5a8a5a0f
0709 12:10:29.478658 (+ 52839us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:29.479531 (+   873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.479593 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.295888 (+816295us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:30.463265 (+167377us) raft_consensus.cc:1685] finished
0709 12:10:30.463286 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.463416 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":3030,"spinlock_wait_cycles":67077632,"thread_start_us":52681,"threads_started":1,"wal-append.queue_time_us":206906}
I20260709 12:10:30.370316  7703 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:30.371094  7758 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.515s	user 0.000s	sys 0.002s
I20260709 12:10:30.371744  7767 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:30.466763  7767 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.374361  7801 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:30.374727  7794 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.469359  7794 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:30.470597  7767 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:30.471355  7794 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:30.374296  7780 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.472028  7780 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.378576  7618 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:30.473515  7625 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:30.473950  7780 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:30.383316  7170 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.329646  7486 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.477444  7486 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.479473  7486 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:30.497630  7503 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.498018  7503 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:30.498775  7503 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.499699  7503 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:30.502614  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 228685us
I20260709 12:10:30.509174  7705 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:30.509655  7705 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.510946  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:30.513754  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:30.514036  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:30.514771  5605 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:30.516585  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:30.517093  5604 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.442338  5019 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:30.496615  7752 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:30.534761  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 227873us
W20260709 12:10:30.542546  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.530345  7705 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:30.590617  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 1318) took 1116 ms. Trace:
W20260709 12:10:30.593619  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 56866.9us
I20260709 12:10:30.594463  4946 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:30.599915  4874 pending_rounds.cc:85] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 7
I20260709 12:10:30.600219  4874 pending_rounds.cc:107] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:30.600419  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:30.600440  4874 raft_consensus.cc:2889] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:30.601751  4873 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.601120  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:30.591014  5018 rpcz_store.cc:276] 0709 12:10:29.474235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.474337 (+   102us) service_pool.cc:224] Handling call
0709 12:10:29.474601 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.204438 (+729837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.590388 (+385950us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400343354. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:30.590556 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665660672}
I20260709 12:10:30.605404  4943 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:30.677977  4867 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:30.742417  5023 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:30.739921  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:30.748347  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:30.738740  5021 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.688650  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:30.715142  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 171440us
I20260709 12:10:30.727483  4873 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:30.713340  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:30.682843  5604 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:30.752440  5018 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.689333  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:30.749266  4876 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:30.754204  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:30.755048  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:30.756557  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.689070  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:30.758104  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:30.759066  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:30.762079  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:30.763613  4873 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:30.766927  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:30.767107  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:30.767485  4950 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.767659  4868 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:30.769388  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:30.771870  4991 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:30.772725  5018 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:30.773824  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:30.774431  5018 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8.
I20260709 12:10:30.597303  7705 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:30.775923  5022 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:30.777262  5024 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.678328  7779 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:30.780995  5022 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:30.781639  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:30.628778  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:30.783012  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:30.785511  7761 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.790683  7780 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:30.790908  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:30.806263  5018 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:30.807284  4840 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:30.807740  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:30.791438  7688 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:30.792752  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.803861  4950 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:30.802642  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:30.813092  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:30.817863  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:30.789906  7705 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:30.778388  7696 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:30.778273  7556 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:30.825047  4868 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:10:30.829639  4947 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:30.733281  7808 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:10:30.817067  7794 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.799655  7486 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:10:30.845093  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:30.841799  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:30.817245  7631 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.821466  7720 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:30.852625  4915 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:30.857340  5568 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8.
I20260709 12:10:30.857656  5568 leader_election.cc:403] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:30.807160  7779 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.811937  7761 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.820230  7780 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.844146  7805 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:30.837823  7556 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.863704  7520 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.872611  4947 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:30.885533  5023 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:30.869233  7720 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:30.863924  7776 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8.
I20260709 12:10:30.869838  7013 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:30.864462  7170 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:10:30.914726  7791 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.915093  7792 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 12:10:30.858958  7631 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.925441  5024 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:10:30.930030  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 110302us
I20260709 12:10:30.881105  7805 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:30.940860  7013 consensus_queue.cc:1243] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer baa50eb5ed704004b7f391934a59d010 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:30.989976  7556 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:30.990289  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:30.992655  4950 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:30.971858  7756 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:30.994036  7756 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:30.996011  7682 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:30.998385  7779 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:30.899935  7520 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.000492  7780 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.038055  7761 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:31.056416  7808 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.065769  7808 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.067871  7808 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:30.941658  7720 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:31.070621  4867 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:31.073325  4867 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:31.058746  7631 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:31.063436  7520 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.044272  7805 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:31.081056  7793 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:31.081593  7793 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.083647  7793 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.084089  7793 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:31.084519  7793 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.093021  7793 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:30.934942  7760 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:31.111364  7541 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.996065  7756 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:30.964758  7752 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.160s
I20260709 12:10:31.113404  7541 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:31.258841  7541 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.263348  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:31.381026  4944 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.051s	sys 0.064s
W20260709 12:10:31.381438  4944 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.051s	sys 0.064s
W20260709 12:10:31.396512  5568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.011s	sys 0.015s
W20260709 12:10:31.397161  5568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.011s	sys 0.015s
I20260709 12:10:31.244172  7776 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:31.397468  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 535119us
I20260709 12:10:31.246019  7749 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:10:31.509250  5019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 316) took 1636 ms (client timeout 1549 ms). Trace:
W20260709 12:10:31.510015  5019 rpcz_store.cc:269] 0709 12:10:29.794013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.794262 (+   249us) service_pool.cc:224] Handling call
0709 12:10:31.430701 (+1636439us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54001617d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:31.430799 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356459776}
I20260709 12:10:31.382028  7767 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:10:31.431366  7759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.008s	sys 0.018s
W20260709 12:10:31.402186  4875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.002s	sys 0.024s
W20260709 12:10:31.549651  4875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.002s	sys 0.025s
I20260709 12:10:31.404098  7761 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.511337  7776 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:31.514098  7820 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.549s	user 0.003s	sys 0.000s
I20260709 12:10:31.430437  7808 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:31.549227  7759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.009s	sys 0.018s
W20260709 12:10:31.552431  7782 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:10:31.568233  7810 log.cc:927] Time spent T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:10:31.567368  7767 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:31.585186  4950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.024s	sys 0.013s
W20260709 12:10:31.585500  4950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.024s	sys 0.013s
W20260709 12:10:31.585155  7720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.031s
W20260709 12:10:31.570430  7790 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.019s	sys 0.018s
I20260709 12:10:31.573607  7793 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:31.571416  7181 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.584962  7812 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.023s	sys 0.017s
I20260709 12:10:31.512955  7749 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:31.571044  7761 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:31.601056  7790 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.019s	sys 0.018s
W20260709 12:10:31.599270  7720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.009s	sys 0.031s
I20260709 12:10:31.620594  7181 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:31.574754  7808 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:31.625860  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2275) took 1021 ms. Trace:
W20260709 12:10:31.617937  7812 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.024s	sys 0.017s
I20260709 12:10:31.617898  7793 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.676462  7793 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.674253  4948 rpcz_store.cc:276] 0709 12:10:30.604162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.604882 (+   720us) service_pool.cc:224] Handling call
0709 12:10:31.625118 (+1020236us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:10:31.625328 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.625528 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.625566 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:31.625609 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:31.625642 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.625694 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.625801 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3784064}
I20260709 12:10:31.680284  7013 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.681169  7013 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:31.667484  7822 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.423s	user 0.000s	sys 0.000s
W20260709 12:10:31.701232  7830 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:31.701645  7181 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:31.702550  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 268) took 1078 ms. Trace:
I20260709 12:10:31.702948  4868 rpcz_store.cc:276] 0709 12:10:30.624548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.851508 (+226960us) service_pool.cc:224] Handling call
0709 12:10:30.864726 (+ 13218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.873199 (+  8473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.873256 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.873981 (+   725us) log.cc:844] Serialized 26 byte log entry
0709 12:10:31.139652 (+265671us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:31.139688 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.139753 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.702336 (+562583us) raft_consensus.cc:1685] finished
0709 12:10:31.702356 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.702492 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7981,"thread_start_us":265214,"threads_started":1,"wal-append.queue_time_us":708556}
I20260709 12:10:31.719216  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 266) took 1095 ms. Trace:
I20260709 12:10:31.719776  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:31.720402  5604 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 2.
I20260709 12:10:31.719616  4873 rpcz_store.cc:276] 0709 12:10:30.624102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.765168 (+141066us) service_pool.cc:224] Handling call
0709 12:10:30.765441 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.787056 (+ 21615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.787081 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.787449 (+   368us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.936501 (+149052us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.936540 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.936611 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.718994 (+782383us) raft_consensus.cc:1685] finished
0709 12:10:31.719015 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.719157 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21293,"raft.queue_time_us":23224,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":64,"thread_start_us":148729,"threads_started":1,"wal-append.queue_time_us":326162}
W20260709 12:10:31.718595  5568 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.549s (SENT) [suppressed 14 similar messages]
I20260709 12:10:31.725832  4916 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:31.742692  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:31.743414  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 271) took 1118 ms. Trace:
I20260709 12:10:31.743692  4869 rpcz_store.cc:276] 0709 12:10:30.625212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.709954 (+ 84742us) service_pool.cc:224] Handling call
0709 12:10:31.742557 (+1032603us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b5800002a98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:10:31.743360 (+   803us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21464832}
I20260709 12:10:31.753296  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:31.755146  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:31.757063  7625 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:31.757180  7794 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:31.757601  7625 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.758323  7794 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:31.759610  7625 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.729817  7841 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:31.729827  7799 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:31.769269  7767 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:31.769733  7761 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:31.782083  7348 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:31.782282  7836 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:31.782605  7348 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.783380  7808 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:31.783568  7837 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:10:31.787660  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:31.788076  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 69512.6us
I20260709 12:10:31.770764  7799 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.788357  5604 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:31.772291  7749 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.771454  7839 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.785969  7833 log.cc:927] Time spent T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:10:31.772171  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:31.772229  7776 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:31.784705  7348 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:31.796051  7743 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 1.010s	user 0.002s	sys 0.014s
I20260709 12:10:31.793305  7799 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:31.803081  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 864951us
I20260709 12:10:31.772372  7841 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.802048  7839 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.826864  4988 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:31.827950  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:31.820034  7803 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:10:31.822021  7813 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.857s	user 0.005s	sys 0.032s
I20260709 12:10:31.803901  5597 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:31.841153  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:31.842350  7625 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:31.843114  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 53176.8us
I20260709 12:10:31.843782  7779 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.844316  7779 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.845208  4916 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:31.829878  7783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.344s	user 0.022s	sys 0.014s
W20260709 12:10:31.848063  7783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.363s	user 0.023s	sys 0.014s
I20260709 12:10:31.849042  7839 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.849284  7779 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.847295  7793 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:31.852435  7793 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:31.852842  7793 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:31.829754  7803 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:31.849957  7842 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:31.850813  7824 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.831725  7746 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:31.857470  7818 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.866s	user 0.002s	sys 0.010s
I20260709 12:10:31.832376  7745 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:31.864346  7824 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.854954  7803 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:31.865319  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 58141.8us
I20260709 12:10:31.828471  7348 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:10:31.862565  7832 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:10:31.862053  7841 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.875380  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:31.925552  5024 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:31.878554  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:31.928709  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:31.928999  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:31.931528  5020 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
W20260709 12:10:31.895057  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 65880.1us
I20260709 12:10:31.878227  7803 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:31.865393  7746 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.953569  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2276) took 1349 ms. Trace:
I20260709 12:10:31.953934  4942 rpcz_store.cc:276] 0709 12:10:30.604442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.614259 (+  9817us) service_pool.cc:224] Handling call
0709 12:10:31.952908 (+1338649us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:10:31.953109 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.953298 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:31.953321 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:31.953356 (+    35us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:31.953383 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.953429 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.953522 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3719424}
I20260709 12:10:31.954978  7746 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:31.955325  7824 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:31.878046  7799 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:31.956905  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:31.957319  7799 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:31.936414  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:31.957947  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:31.958464  5023 raft_consensus.cc:2376] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6. Re-sending same reply.
I20260709 12:10:31.938298  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:31.939450  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:31.940219  7745 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:31.940838  7739 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.941397  7631 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:31.945125  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:31.969863  4946 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:31.947003  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1199) took 1347 ms. Trace:
I20260709 12:10:31.949113  7793 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:31.937295  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:31.959252  4948 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:31.959028  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:31.959420  4947 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
W20260709 12:10:31.931027  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 84756.9us
I20260709 12:10:31.980021  4944 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:31.970623  4874 rpcz_store.cc:276] 0709 12:10:30.599362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.599459 (+    97us) service_pool.cc:224] Handling call
0709 12:10:30.599736 (+   277us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:30.713172 (+113436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.713206 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:30.713766 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 12:10:30.822036 (+108270us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:30.836184 (+ 14148us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.859417 (+ 23233us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.860182 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.860248 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:31.749396 (+889148us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b1800340d80. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a57777c0a 00007f2a60eb7219 00007f2a5e7be58f 00007f2a577fd571 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd
0709 12:10:31.856986 (+107590us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:31.946777 (+ 89791us) raft_consensus.cc:1685] finished
0709 12:10:31.946800 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:31.946923 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136630,"prepare.queue_time_us":43637,"raft.queue_time_us":146109,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":11194,"spinlock_wait_cycles":41187968,"thread_start_us":100472,"threads_started":1,"wal-append.queue_time_us":252463}
I20260709 12:10:31.988493  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:31.989197  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 120365us
I20260709 12:10:31.989661  5024 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:31.997222  7065 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:31.998181  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:31.999151  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:31.999717  7842 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:32.000245  7842 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:32.004151  7821 log.cc:927] Time spent T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 1.029s	user 0.006s	sys 0.009s
I20260709 12:10:32.005578  7852 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:31.987612  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:32.006780  5597 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.980542  7631 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.009644  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.010222  5022 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:31.979487  7745 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:31.979434  7739 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.013782  5017 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:31.979071  7847 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.014824  7847 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.015882  5017 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:32.125727  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.220193  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.021397  4945 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10. Ops: []
W20260709 12:10:32.221809  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 186943us
I20260709 12:10:32.222123  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.172523  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.222910  4948 raft_consensus.cc:2393] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 3: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:32.166811  5597 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:32.223850  5604 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.223881  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.028956  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2339) took 1405 ms. Trace:
I20260709 12:10:32.034180  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.217927  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.006232  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.227041  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.230811  4916 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:32.183933  7013 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.234196  7792 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:32.234659  7792 raft_consensus.cc:697] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:32.235291  7362 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:32.235493  7792 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.235790  7362 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.237511  7793 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.237715  7362 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.241729  6293 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.241904  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.242547  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.242504  4874 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
W20260709 12:10:32.243067  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 216554us
I20260709 12:10:32.243994  6293 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.245666  5019 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: [5.6-10.8]
I20260709 12:10:32.252441  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:32.245802  6293 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.125461  7847 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.252043  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.225287  4875 rpcz_store.cc:276] 0709 12:10:30.623116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.757236 (+134120us) service_pool.cc:224] Handling call
0709 12:10:30.757633 (+   397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:30.798014 (+ 40381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.798041 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:30.798812 (+   771us) log.cc:844] Serialized 52 byte log entry
0709 12:10:31.569394 (+770582us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:31.723889 (+154495us) log.cc:844] Serialized 14 byte log entry
0709 12:10:31.829780 (+105891us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.028487 (+198707us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b540016c720. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a865733 00007f2a5a8eadbf 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c
0709 12:10:32.028533 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.028627 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.028744 (+   117us) raft_consensus.cc:1685] finished
0709 12:10:32.028757 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.028899 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186901,"prepare.queue_time_us":200585,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":160766,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":29800,"spinlock_wait_cycles":10012928,"thread_start_us":919677,"threads_started":2,"wal-append.queue_time_us":805281}
I20260709 12:10:32.252338  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:32.178048  7821 log.cc:927] Time spent T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:10:32.178182  7705 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.275911  7797 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.277704  7797 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.278431  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 1201) took 1678 ms. Trace:
I20260709 12:10:32.278884  7748 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:32.279435  7748 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.279851  7797 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.255195  7793 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.281270  7748 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.281168  7705 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.282114  7705 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.284245  7705 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.284956  7783 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.286078  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.265822  5019 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:32.286624  5020 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:32.266024  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.266978  7857 consensus_queue.cc:1059] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:32.268520  7724 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.028664  7789 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.107748  7799 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.269838  7841 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.271004  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.275976  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:32.275825  7761 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.276863  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.287483  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:32.287607  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:32.027227  7348 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.318565  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.288657  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.289762  4945 raft_consensus.cc:2393] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:32.278787  4871 rpcz_store.cc:276] 0709 12:10:30.599866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.599985 (+   119us) service_pool.cc:224] Handling call
0709 12:10:30.748409 (+148424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.756569 (+  8160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.756595 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.758103 (+  1508us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.842690 (+ 84587us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:30.859413 (+ 16723us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.860456 (+  1043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.860519 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:32.003632 (+1143113us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:10:32.278186 (+274554us) raft_consensus.cc:1685] finished
0709 12:10:32.278269 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.278376 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":880236,"prepare.queue_time_us":28137,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":2424,"raft.queue_time_us":43902,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":9298,"spinlock_wait_cycles":59505536,"thread_start_us":57283,"threads_started":1,"wal-append.queue_time_us":189984}
I20260709 12:10:32.107506  7756 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:32.291704  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.292171  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.289707  7556 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.289934  7797 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.347565  4872 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:32.281618  7793 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.294734  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.295305  5604 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:32.297096  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.306545  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.308672  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.347177  5025 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:32.349115  7556 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.290529  7705 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.295044  7748 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.357321  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.356556  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.360622  4876 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:32.358917  5018 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:32.303493  7631 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.353173  5021 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:32.366026  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.367426  4874 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:32.368279  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.285401  7783 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.369048  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.316744  7803 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:32.347759  7779 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.305387  7724 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.347234  7839 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.317130  7841 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.308883  7789 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.310607  7799 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.350864  7564 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:32.380304  4948 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 4.
I20260709 12:10:32.419188  4876 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:32.359092  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:32.414474  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 118579us
I20260709 12:10:32.421936  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.418916  4945 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:32.351090  7751 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:32.428478  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.429991  4945 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:32.351521  7348 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.347321  7761 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.394708  7842 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.359275  7797 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.360924  7756 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.361279  7705 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.364434  7748 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.439638  5023 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:32.445116  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.445308  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:32.447849  4875 raft_consensus.cc:2376] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11. Re-sending same reply.
I20260709 12:10:32.448745  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:32.377741  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 136366us
I20260709 12:10:32.452603  4875 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:32.459784  7745 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.460075  7705 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.460523  7739 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.460645  7705 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.461073  7739 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:32.461196  7705 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.461535  7739 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.463477  7739 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.463195  7705 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.465260  7705 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.465417  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.465761  7705 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.468349  7705 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.382742  7523 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:10:32.473215  7789 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.473387  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.474936  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.475497  4867 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:32.476284  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.477242  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.477828  4867 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:32.473973  4875 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:32.475508  5017 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:32.423702  7779 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.423296  7839 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.427271  7751 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.485285  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.493992  7556 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.495930  7797 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.438519  7793 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.513904  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.514541  5024 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:32.477281  7783 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.517900  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.519023  5019 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:32.522516  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.523037  5019 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:32.531562  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:32.531898  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 241586us
I20260709 12:10:32.533974  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.535470  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.535270  4988 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:32.540210  4991 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:32.544061  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.544152  5570 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:32.545362  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:32.555517  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.555809  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.543927  4988 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:32.563692  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.542613  7839 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.566330  7864 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:32.566797  7861 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:10:32.567011  7633 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.567590  7348 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.566918  7556 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.568490  7799 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.569470  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.569686  7779 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.570479  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.571004  4947 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:32.566802  7864 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.573307  7864 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.573923  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.567646  7746 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:32.577137  7746 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.577502  7746 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:32.578873  7841 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.579528  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.580206  4948 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 6: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:32.581408  7756 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.582319  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.582720  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.562451  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:32.602711  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.601363  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:32.604110  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.607048  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.609186  4948 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:32.609565  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.610119  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.566946  7564 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:32.610782  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.614566  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.616701  7839 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.617205  7839 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.617599  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:32.617964  7841 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:32.620184  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:32.624101  7721 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:32.625818  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.625949  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:32.627015  4840 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:32.605154  7556 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.630532  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:32.618359  7792 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.651479  4839 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:32.605161  7565 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:32.606032  7852 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.648124  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:32.653163  6293 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.646504  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:32.654662  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:32.653532  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:32.667644  4915 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:32.670068  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:32.671587  6293 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.671952  6293 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.672261  6293 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.605161  7348 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:10:32.613480  7564 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.676314  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.627264  7778 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.677904  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.649479  7556 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.681152  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:32.627554  7724 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.650800  7870 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.695367  7776 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.687997  7556 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.700474  7760 raft_consensus.cc:3055] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:32.700863  7760 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:32.701057  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.683120  7564 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.707278  7756 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.707931  7756 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.709705  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:32.670684  7705 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.689123  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:32.650789  7799 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:32.654788  7527 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.692433  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.663832  7852 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.686959  4915 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
W20260709 12:10:32.721362  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 176670us
I20260709 12:10:32.708467  7756 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:32.718612  7839 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.724846  7724 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.725670  7751 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.732967  7631 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.679658  7761 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.691212  7565 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.734308  7556 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.685743  7778 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:32.675467  7797 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.738739  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.740535  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:32.751868  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 64964.3us
I20260709 12:10:32.694391  7870 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.719521  7705 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.718662  7748 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.718611  7799 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.751415  7852 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.712971  7760 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:32.788446  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47993.5us
I20260709 12:10:32.792676  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:32.782184  7778 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.800001  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:32.774950  7867 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:32.801451  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 120364us
I20260709 12:10:32.803479  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:32.781903  7797 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.786303  7705 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.790903  7761 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.785251  7870 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.788866  7799 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.767922  7864 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.819399  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:32.815029  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:32.761502  7564 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.837960  7564 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.841380  7556 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.841691  7565 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:32.817862  7797 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.846061  4774 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 220) took 23228 ms (client timeout 15000 ms). Trace:
I20260709 12:10:32.845676  4773 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 4 to 9, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 9 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:32.020226  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:32.846419  4774 rpcz_store.cc:269] 0709 12:10:09.617720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:09.624969 (+  7249us) service_pool.cc:224] Handling call
0709 12:10:32.845984 (+23221015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:29.340005 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:29.455988 (+115983us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:29.457917 (+  1929us) write_op.cc:435] Acquired schema lock
0709 12:10:29.459307 (+  1390us) tablet.cc:662] Decoding operations
0709 12:10:29.624267 (+164960us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:29.663186 (+ 38919us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:29.665808 (+  2622us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:10:29.763331 (+ 97523us) tablet.cc:701] Row locks acquired
0709 12:10:29.765436 (+  2105us) write_op.cc:260] PREPARE: finished
0709 12:10:29.789429 (+ 23993us) write_op.cc:270] Start()
0709 12:10:29.794961 (+  5532us) write_op.cc:276] Timestamp: P: 1783599029789370 usec, L: 0
0709 12:10:29.797118 (+  2157us) op_driver.cc:348] REPLICATION: starting
0709 12:10:29.893082 (+ 95964us) log.cc:844] Serialized 2844 byte log entry
0709 12:10:30.506945 (+613863us) op_driver.cc:464] REPLICATION: finished
0709 12:10:30.979460 (+472515us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a577e00ac 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5e320ef0
0709 12:10:31.709005 (+729545us) write_op.cc:301] APPLY: starting
0709 12:10:31.710135 (+  1130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:31.725414 (+ 15279us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:31.728280 (+  2866us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:31.834376 (+106096us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:31.834582 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:10:31.834628 (+    46us) write_op.cc:312] APPLY: finished
0709 12:10:31.834840 (+   212us) log.cc:844] Serialized 59 byte log entry
0709 12:10:31.959281 (+124441us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:31.981916 (+ 22635us) write_op.cc:454] Released schema lock
0709 12:10:31.981970 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:32.172416 (+190446us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:32.172445 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":320459,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":1191308,"apply.run_cpu_time_us":34094,"apply.run_wall_time_us":425161,"num_ops":7,"prepare.queue_time_us":51067,"prepare.run_cpu_time_us":28068,"prepare.run_wall_time_us":742130,"raft.queue_time_us":45345,"raft.run_cpu_time_us":41054,"raft.run_wall_time_us":1177473,"replication_time_us":709679,"spinlock_wait_cycles":65780608,"thread_start_us":1502813,"threads_started":5,"wal-append.queue_time_us":368306,"wal-append.run_cpu_time_us":3651,"wal-append.run_wall_time_us":1395854}]]}
I20260709 12:10:32.793972  7793 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:32.797684  7866 consensus_queue.cc:1059] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:10:32.852058  7866 consensus_queue.cc:1243] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:32.853636  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:32.820451  7868 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:32.777987  7631 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.814051  7739 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.812366  7844 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.815577  7867 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.833864  7745 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:32.834208  7864 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:32.847018  4773 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 5 to 9, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:32.824858  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 170243us
I20260709 12:10:32.870638  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:32.872197  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.820941  7756 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:32.873322  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.873428  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:32.883467  5605 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:32.874281  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:32.873935  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 202875us
I20260709 12:10:32.876160  7739 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.878242  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:32.867100  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:32.885967  5023 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.884194  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:32.887495  4945 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 5.
I20260709 12:10:32.888142  4773 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:32.865314  7871 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.889397  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:32.891964  4773 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 3 to 6, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 6 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.874576  7793 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:32.898850  7793 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.899241  7793 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:32.881839  7867 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.878080  7868 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:32.887583  7739 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.894472  4773 catalog_manager.cc:5697] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 6, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 6 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.909396  7565 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:32.893718  7871 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.911988  7871 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.912963  7779 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.913369  7779 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:32.913715  7779 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.918226  7756 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:32.921185  7868 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:32.926144  7631 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:32.929909  7362 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.930330  7362 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:32.930712  7362 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.933481  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:32.938488  5023 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:10:32.907984  4773 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 5, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 5 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:32.949882  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 51415.2us
I20260709 12:10:32.950311  6293 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:32.950764  4773 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 5 to 6, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 6 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:32.953136  4773 catalog_manager.cc:5697] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:32.956050  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51511.5us
I20260709 12:10:32.958021  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:32.954535  4773 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 5, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:32.960242  4839 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:10:33.019891  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 59826.3us
I20260709 12:10:33.027935  6293 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:33.036763  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 76586.3us
W20260709 12:10:33.038563  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.881954  7844 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:33.019461  7792 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.035792  7789 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:33.066639  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 177750us
I20260709 12:10:33.041839  7780 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:33.043349  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 176316us
I20260709 12:10:33.068159  4988 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:33.039237  7870 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.069728  4944 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.078302  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.079449  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.080442  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.081252  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.081406  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.082340  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.082180  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.085568  5019 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:33.089411  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.089979  4945 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:33.090727  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.066685  7789 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.089037  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.093971  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.094604  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.061319  7746 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.111119  7799 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.112962  4948 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:33.113704  4943 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:33.114619  7870 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.118701  7797 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.119654  7362 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.120867  7789 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.077695  7780 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.125682  4915 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.135751  7779 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.137535  7889 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.141043  7760 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.174549  4949 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:33.174957  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.144109  7852 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.144886  7780 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.143983  7523 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:33.148051  7778 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.152176  7799 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.154497  7793 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:33.155078  7739 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.190425  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.092895  7348 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.192173  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.184576  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.198098  4949 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:33.159333  4944 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:10:33.161269  7844 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.163309  7746 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.164304  7865 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:33.204833  7865 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:33.205672  7865 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:33.206892  7865 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:33.165774  7783 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.169095  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.209859  7779 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.169739  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.173116  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.192154  7523 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:33.210889  5017 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:33.192031  7881 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:33.210855  4947 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:33.212854  7852 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.214515  7871 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.217626  7362 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.221041  4950 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.222920  7793 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.226987  7778 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.230804  7871 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.235234  7705 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.236300  4946 raft_consensus.cc:2393] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:33.239192  7523 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:33.241261  7705 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.120669  7797 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.189714  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.242689  5016 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:33.202173  5024 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:33.252040  7780 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.192261  7348 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.256489  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.257498  5568 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:33.262161  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.263622  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.276856  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.278107  5024 raft_consensus.cc:2393] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:33.284237  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.285012  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.287312  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.286782  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:33.176564  7867 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.282358  7523 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:10:33.281216  7724 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:10:33.296663  7724 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:33.297006  7724 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:33.297725  7724 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.274174  7348 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.301508  5567 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:33.320149  4951 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:33.273801  7887 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:33.274497  7797 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:10:33.328577  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 293830us
I20260709 12:10:33.306224  7802 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:33.325532  7724 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.341034  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.340618  7793 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.356657  7780 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.373078  7778 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.374665  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.396955  7778 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:33.397396  7778 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.397604  4840 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.397941  7780 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.375276  7631 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:33.398641  7780 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.377871  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4699787549416cb829da40d250e0cf"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:33.399667  4875 raft_consensus.cc:606] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.401857  7761 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:33.402370  7761 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.402949  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.403473  4876 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.404021  4991 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.404349  7761 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.405838  7894 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:33.406208  7894 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:33.406857  7804 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:33.396554  7793 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:33.407630  7804 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:33.408273  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 55184.7us
I20260709 12:10:33.410513  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.411023  4942 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.378389  7527 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:33.342661  7802 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:33.385881  7797 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:33.425076  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.397743  7362 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.415601  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.412602  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.416139  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.417008  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.417124  5018 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:33.433137  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.417706  5020 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:33.408049  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.417694  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.425774  5023 raft_consensus.cc:2368] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:33.427640  4876 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:10:33.407996  7804 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:33.342365  7789 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:33.460031  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47509.8us
I20260709 12:10:33.461397  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.464660  7756 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.464999  7348 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.408281  7631 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.414371  7865 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:33.466867  4876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:33.470250  4876 raft_consensus.cc:606] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.470571  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.470836  4876 raft_consensus.cc:614] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:33.429940  7842 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.428439  7879 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:33.429765  7362 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:33.485700  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.486704  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.491230  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.487006  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.487530  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.492619  4873 raft_consensus.cc:2368] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
I20260709 12:10:33.493410  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.487622  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.479982  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.495102  4874 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:33.452467  7852 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:33.454800  7866 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.495867  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.497565  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.424379  7527 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:33.500820  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.499769  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.507871  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.407196  7894 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.508008  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.466126  7756 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.508658  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.514436  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.408269  7793 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.517400  7631 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.518756  7527 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.508738  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.520471  7789 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.498504  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.511432  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.480127  7869 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:33.513260  4875 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:33.556360  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.543823  5020 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.529399  5025 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:33.485112  7865 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.529402  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.557346  5025 pending_rounds.cc:85] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 4
I20260709 12:10:33.557650  5025 pending_rounds.cc:107] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:33.557861  5025 raft_consensus.cc:2889] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.558116  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.532212  7879 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:33.511413  7852 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.533787  7749 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.525004  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.524104  7804 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.521049  7802 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:33.534498  7348 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.431710  7797 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:33.538957  7867 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.541080  7793 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.541601  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.543030  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.543625  7866 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:33.539021  4951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:33.543932  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.528348  4874 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:33.545243  4761 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 36177f71106c42f98afc1b375e5f6838 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:33.546736  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.582139  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.583609  7847 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.583747  4840 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.584343  7847 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.528671  7739 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.584976  7847 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:33.528416  7894 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.575781  7885 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:33.586083  4840 leader_election.cc:400] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:33.586364  4840 leader_election.cc:403] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.547640  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.549469  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.583689  7814 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:33.524606  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.589413  5017 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:33.521631  7362 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.590436  7362 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.553970  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.595108  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.588883  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.595994  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.557363  4942 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:33.562068  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.562980  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.599084  5023 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 6: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:33.565397  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.566226  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.600302  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.573858  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.601068  4876 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.563452  7879 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:33.603211  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 55656.1us
I20260709 12:10:33.603979  4917 leader_election.cc:400] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
I20260709 12:10:33.604267  4917 leader_election.cc:403] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.585199  7789 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.582158  7797 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:33.605064  7867 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.606714  7867 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
I20260709 12:10:33.605729  4917 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.607935  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.608798  7885 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.582163  7778 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.609411  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.610385  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.610325  4872 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.611382  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:33.574766  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 65067.5us
I20260709 12:10:33.577226  4951 raft_consensus.cc:606] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:33.615314  4951 raft_consensus.cc:614] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:33.569829  7902 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:33.570279  7749 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:33.618366  7749 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.578658  7804 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.615949  4839 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:33.579975  7865 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.619395  5598 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:10:33.621484  5598 pending_rounds.cc:85] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 6
I20260709 12:10:33.621726  5598 pending_rounds.cc:107] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:10:33.621933  5598 raft_consensus.cc:2889] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.622256  5598 pending_rounds.cc:107] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:10:33.622459  5598 raft_consensus.cc:2889] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.623426  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.623773  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.563594  7869 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.626082  7869 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.608568  7867 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.580479  7852 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.579855  7866 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.628562  4873 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:33.621366  7847 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.629590  7847 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:33.630158  7866 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.630385  7847 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.630681  7866 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:33.631289  7866 consensus_queue.cc:1243] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer ab9da67236874634be59ebfd05b18255 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:33.632403  4869 raft_consensus.cc:2410] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:33.626288  7778 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.621877  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.631402  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.626595  4943 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:33.634245  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.634907  4873 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:33.634245  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.635454  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.634821  5598 pending_rounds.cc:85] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 5
I20260709 12:10:33.636036  5598 pending_rounds.cc:107] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:10:33.636359  5598 raft_consensus.cc:2889] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.636538  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:33.637068  4917 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.635977  4875 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:33.638025  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:33.638546  4875 raft_consensus.cc:606] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:10:33.638859  4875 raft_consensus.cc:614] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:33.639102  4872 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:33.643780  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:33.645761  4876 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:33.648097  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.649367  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:33.649631  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51318.2us
I20260709 12:10:33.651710  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:33.651872  4872 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:33.652694  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.653987  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.655486  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:33.657109  4949 raft_consensus.cc:2368] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7.
I20260709 12:10:33.651407  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.659123  7839 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:33.659504  4876 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.597507  4874 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:33.661355  4875 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:33.663262  4917 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.664003  7839 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.665230  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.667766  7778 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.672686  4871 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:33.674769  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.647953  7893 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:33.656654  7841 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.676964  7814 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:33.679111  4950 raft_consensus.cc:2410] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:33.685005  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.679354  4839 leader_election.cc:400] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7.
I20260709 12:10:33.686029  4839 leader_election.cc:403] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.649262  7871 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:33.687150  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 109089us
I20260709 12:10:33.688619  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:33.693712  4870 raft_consensus.cc:2393] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:33.695138  4917 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.686941  7778 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:10:33.683717  7839 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.707796  7885 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.708580  4942 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.709544  7797 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.683991  7879 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:33.716351  7824 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7.
I20260709 12:10:33.717139  7871 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.684985  7814 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:33.718405  7814 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.719203  7879 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:33.719624  7814 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:33.719941  7778 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:33.719875  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.720402  7778 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:33.722549  7852 consensus_queue.cc:1059] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:33.723412  7866 raft_consensus.cc:3055] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.723755  7866 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:33.724540  7866 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.725008  7778 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:33.725630  7866 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.723330  4870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:33.726399  4870 raft_consensus.cc:606] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.728376  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.729014  5018 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.730368  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.735620  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.737131  4840 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.694768  7887 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.742044  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.740324  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:33.742527  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.743928  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.745512  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.746688  4991 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.747706  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.749820  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.743094  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.759166  4868 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:33.762355  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:33.764204  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.763218  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.765282  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:33.765691  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:33.765792  4873 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:10:33.768113  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:33.752321  7739 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.738137  7523 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.777621  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:33.759907  7565 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.780916  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.767220  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.773924  5017 raft_consensus.cc:2368] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7.
I20260709 12:10:33.775254  7631 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.784142  7749 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:33.784513  7749 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:33.774842  4991 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.784873  7749 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:33.785729  7887 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:33.786851  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:33.773976  7842 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.787289  4917 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.787891  7842 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.788607  7842 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.774211  7724 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.790068  4871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:33.790570  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.733935  7841 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.752410  7869 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:10:33.738644  7893 consensus_queue.cc:1175] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "baa50eb5ed704004b7f391934a59d010" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 9 index: 6 } }
I20260709 12:10:33.787954  7887 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.790589  4871 raft_consensus.cc:606] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.792557  7887 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.793099  7887 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:33.761090  7778 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:33.794281  5597 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:33.795320  7520 raft_consensus.cc:993] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:33.795754  7520 raft_consensus.cc:1081] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:33.757371  7907 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.796968  4840 leader_election.cc:400] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7.
I20260709 12:10:33.787914  4991 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.799557  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.801187  7760 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.801664  5017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:33.801774  7760 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.802192  5017 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:33.802541  5017 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.797529  7887 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.808362  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.809082  7793 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:33.809129  5017 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.809788  7793 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:33.810595  7793 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.811296  5017 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:33.812126  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:33.812680  4942 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.814064  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.814760  7841 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:33.817687  4917 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:33.818331  7841 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.818811  7841 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:33.810869  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.768395  7885 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.760079  7865 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.796945  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:10:33.826252  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:33.827034  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:33.831692  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.822121  5018 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:10:33.820348  4991 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:33.834017  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.834882  5019 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:10:33.835050  7841 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.840996  7527 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:33.842729  4942 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:33.845005  4988 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:33.846201  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.851871  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.865183  7724 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.865836  7724 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:33.866261  7724 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:33.867189  4942 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:33.866993  7724 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:33.835429  7631 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:33.843412  7761 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:33.927407  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 48229.4us
I20260709 12:10:33.851588  7869 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:33.853832  7633 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:33.874787  7631 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:10:33.979799  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 107289us
I20260709 12:10:33.891501  7842 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:10:33.891940  7829 consensus_queue.cc:1059] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
W20260709 12:10:33.988382  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 57588.6us
W20260709 12:10:33.993216  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 138494us
I20260709 12:10:33.938820  7869 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:33.995221  4991 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:33.953380  7631 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.002789  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:34.020326  4991 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:34.021766  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:34.027603  4991 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:34.006101  7556 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.020725  7852 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:34.004860  7739 consensus_queue.cc:1059] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:10:34.017190  7789 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:10:34.073693  7917 log.cc:927] Time spent T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:10:34.074404  7916 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:10:34.075013  7915 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:10:34.080405  7920 log.cc:927] Time spent T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:34.035516  7922 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:34.096684  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 69138.8us
I20260709 12:10:34.102734  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:34.097726  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 203818us
I20260709 12:10:34.097544  4870 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:34.100256  7842 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:34.127381  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 128227us
I20260709 12:10:34.128232  7924 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:34.100311  7869 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.120502  7749 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:34.145218  7749 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:34.145684  7523 raft_consensus.cc:993] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:34.146921  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:34.148030  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:34.150712  7523 raft_consensus.cc:1081] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:34.155778  7556 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:34.157725  7556 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:34.158492  7631 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.158468  7556 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.165537  7556 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.166208  7631 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:34.160209  4874 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:34.161285  7721 raft_consensus.cc:993] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:34.172232  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:34.177801  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 46901.2us
I20260709 12:10:34.189016  4869 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:34.207865  4942 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:34.206266  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:34.212011  4951 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:34.216058  5021 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:34.224545  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:34.225878  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:34.227228  7631 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:34.227728  7631 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:34.228566  7631 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.187368  7906 raft_consensus.cc:1081] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:34.232555  7924 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:34.252208  5021 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:34.233237  7523 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:34.247303  7348 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:34.314167  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 78105.8us
I20260709 12:10:34.342247  5019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55706
I20260709 12:10:34.342809  5019 raft_consensus.cc:606] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 12:10:34.343118  5019 raft_consensus.cc:614] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:34.355089  5019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:34.355628  5019 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:34.355969  5019 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.369697  4945 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:34.378036  7541 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:34.384472  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 62105us
I20260709 12:10:34.384904  7877 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:34.389840  5597 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:34.377224  5019 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.400355  5598 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:34.402020  4874 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:34.403496  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:34.405872  7789 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:34.403996  4868 raft_consensus.cc:3055] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.411150  7881 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:34.414538  5016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c4699787549416cb829da40d250e0cf"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:34.418651  5016 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:34.418991  5016 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.415400  4868 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:34.420001  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:34.420517  4950 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.419592  4870 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.416122  5017 raft_consensus.cc:1240] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.422374  4874 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:34.397480  5019 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:34.428891  4873 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:34.429334  7882 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:34.427369  4822 auto_rebalancer.cc:893] Removing replace marker failed: Replica baa50eb5ed704004b7f391934a59d010 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:34.430274  4822 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:10:34.430531  4822 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:10:34.430686  7556 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:34.431313  4871 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:34.434942  4945 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:34.435788  5019 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:34.439143  4867 raft_consensus.cc:3055] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:34.439498  4867 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:34.436561  4868 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.443217  4868 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.444105  5025 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.444293  5021 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:34.444139  4950 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:34.447702  4944 raft_consensus.cc:1240] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.428483  7724 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:34.449301  4988 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:34.450381  7841 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:34.451224  4867 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.452103  7746 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.452615  7746 raft_consensus.cc:697] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:34.453439  7746 consensus_queue.cc:237] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.453971  7724 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:10:34.454355  7724 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:34.455114  7724 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:34.456166  7724 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:34.453380  7793 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:10:34.452266  4867 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.461160  5019 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:34.475387  7780 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:34.476429  7885 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:34.483844  4868 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:34.493821  5016 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:34.459774  7348 consensus_queue.cc:1175] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f3bf546572147c3abe4522189e86ce6" responder_term: 11 status { last_received { term: 11 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 11 index: 7 } }
I20260709 12:10:34.513330  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:34.514021  4873 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.514325  4873 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:34.513372  5016 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:34.518909  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:34.519500  4945 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.521621  7885 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:34.529986  4867 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:34.531769  4945 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:34.526774  4873 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.533219  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:34.533106  7893 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:10:34.538461  4873 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.531215  7882 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:34.536741  7631 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.550009  7631 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:34.550887  7631 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.563002  7797 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:34.563410  7797 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:34.530997  7793 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:34.569461  7867 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:34.570123  7867 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:34.571120  7867 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.572968  7867 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.573948  4944 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 3 to 8, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:34.579221  4773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 123) took 6984 ms. Trace:
I20260709 12:10:34.583056  4873 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:34.590889  4944 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:34.564237  7797 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:34.583503  4773 rpcz_store.cc:276] 0709 12:10:27.595228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.604106 (+  8878us) service_pool.cc:224] Handling call
0709 12:10:27.818171 (+214065us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b5400240090. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c6640 00007f2a6069d846 00007f2a607a790e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:34.579136 (+6760965us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:33.355390 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:33.358772 (+  3382us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:33.358809 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:33.358828 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:33.359768 (+   940us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:33.359823 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:33.359851 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:10:33.360548 (+   697us) tablet.cc:701] Row locks acquired
0709 12:10:33.360566 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:33.360700 (+   134us) write_op.cc:270] Start()
0709 12:10:33.360834 (+   134us) write_op.cc:276] Timestamp: P: 1783599033360656 usec, L: 0
0709 12:10:33.360859 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:33.361491 (+   632us) log.cc:844] Serialized 3636 byte log entry
0709 12:10:33.868853 (+507362us) op_driver.cc:464] REPLICATION: finished
0709 12:10:34.022217 (+153364us) write_op.cc:301] APPLY: starting
0709 12:10:34.029324 (+  7107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:34.061564 (+ 32240us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:34.061678 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:34.107755 (+ 46077us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:34.107985 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:10:34.108031 (+    46us) write_op.cc:312] APPLY: finished
0709 12:10:34.137223 (+ 29192us) log.cc:844] Serialized 71 byte log entry
0709 12:10:34.137382 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:34.137507 (+   125us) write_op.cc:454] Released schema lock
0709 12:10:34.137551 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:34.137875 (+   324us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:34.137901 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":613291,"reported_tablets":22,"spinlock_wait_cycles":65365376,"child_traces":[["op",{"apply.queue_time_us":136099,"apply.run_cpu_time_us":3099,"apply.run_wall_time_us":119712,"num_ops":9,"prepare.queue_time_us":239938,"prepare.run_cpu_time_us":9536,"prepare.run_wall_time_us":82690,"raft.queue_time_us":314505,"raft.run_cpu_time_us":53980,"raft.run_wall_time_us":79751,"replication_time_us":507851,"thread_start_us":565024,"threads_started":4,"wal-append.queue_time_us":185647}]]}
I20260709 12:10:34.613143  7926 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:34.618484  7797 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:34.615407  7881 consensus_queue.cc:1175] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8de40fe2bb814adcbe13958669063dc9" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 12:10:34.614221  7348 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:34.655448  4949 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:34.643893  7926 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:34.682116  4771 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
W20260709 12:10:34.693207  7942 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:34.684162  4771 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.665242  7842 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:34.787241  7871 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:34.794304  7871 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.796253  7871 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:34.797981  7926 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:34.801100  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:34.801846  4944 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:34.788550  4771 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 5, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.849880  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:34.850639  5022 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:34.851548  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:34.852195  5023 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:10:34.864769  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:34.865475  4876 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
W20260709 12:10:34.865762  7948 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:10:34.877089  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:34.879514  4874 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:34.848421  4771 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.880686  4944 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:34.885481  4876 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.886399  4771 catalog_manager.cc:5697] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.888128  4771 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.886808  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:34.889462  4771 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:34.878885  7749 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:34.896761  4771 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 4, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:34.890616  7348 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:10:34.899154  4771 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 5, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 5 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:34.904273  4771 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.906437  4771 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.908039  4771 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 6, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.909833  4771 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 7, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.911386  4771 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 4, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.913722  4771 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:34.893620  7749 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:34.893360  7936 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:34.915066  4771 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 4, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.920077  4771 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 7, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.890753  7842 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:10:34.930588  4771 catalog_manager.cc:5697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.918774  7749 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:34.932446  4771 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.918493  7936 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:34.934620  7936 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:34.934029  4771 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:34.942736  4771 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 7, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.946388  4771 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.948072  4771 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 6, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.925590  7724 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:34.934094  7348 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:34.952730  4771 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 5, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.959195  4771 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 6, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:34.960781  4771 catalog_manager.cc:5697] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 2 to 7, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.963120  4771 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:34.975324  7949 log.cc:927] Time spent T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:10:34.990847  7936 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:34.997439  4871 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:35.020756  7631 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.974802  7348 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.022570  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:35.022825  7348 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:35.023288  5022 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:35.016788  4868 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:10:35.000517  7945 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.242s	user 0.003s	sys 0.001s
I20260709 12:10:35.026365  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:35.033150  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:35.033747  4873 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:35.034802  7348 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:35.035151  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:35.036062  7348 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.036414  7348 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:35.036751  7348 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.041914  7882 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.042372  7882 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.044279  7882 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:35.051623  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:35.051862  7936 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.053582  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:35.054334  5021 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:35.055279  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:35.056481  7882 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:35.054051  4944 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:35.056831  7882 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.057274  7882 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:35.061415  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:35.062106  4944 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:35.073415  7960 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:35.073901  7960 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:35.074862  7961 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:35.075807  7960 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:35.078024  7882 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.057154  7749 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.083613  7882 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:35.084947  5597 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:35.078372  7348 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.092394  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:35.092612  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:35.093086  4949 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:35.093372  4951 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:35.094501  4944 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:35.095083  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:35.095645  5597 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:35.097353  7348 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:35.112253  7348 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:35.113176  7720 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.113678  7720 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.115644  7720 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.127337  7749 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:35.124650  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 86260.1us
I20260709 12:10:35.128572  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:35.134773  5023 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:10:35.135627  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:35.139552  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:35.140216  4951 raft_consensus.cc:2368] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:10:35.141189  5567 leader_election.cc:400] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:10:35.147787  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:35.148408  5023 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:35.160521  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:35.161123  5024 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:35.163815  7867 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.164364  7867 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.167939  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:35.168462  5023 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:35.169768  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:35.170478  7882 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.170866  7882 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.171317  7882 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.170859  7867 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.178031  7882 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.180984  7882 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.181936  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:35.182502  5022 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.182699  5597 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:10:35.183200  7749 raft_consensus.cc:2764] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:10:35.185714  4916 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:35.186410  7882 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:35.186877  7882 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:35.187682  4868 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:35.188409  5022 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:35.187692  7882 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.189643  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:35.190182  4873 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:35.191182  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:35.171375  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:35.197358  4944 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:35.198467  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:35.199215  7881 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.199558  7881 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.199882  7881 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.208608  7881 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.211192  7881 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.213116  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:35.217669  4944 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.225692  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:35.226737  7867 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:35.227536  7867 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:35.228338  7867 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.228832  4873 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:35.232450  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:35.238255  7631 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:35.238623  7631 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:35.238947  7631 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:35.248317  7631 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:35.249773  5024 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:10:35.250739  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:35.251358  4868 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.255599  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:35.256389  7882 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.257208  7882 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:35.257974  7882 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.260823  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:35.262898  4944 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:35.264034  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:35.264935  7881 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:35.265656  7881 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:35.266469  7881 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.272176  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:35.272866  4868 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:35.272699  5022 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.279767  5022 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:35.282325  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:35.283128  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:35.296296  4874 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:35.297292  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:35.299686  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:35.300364  4949 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:35.293133  7348 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.303390  7866 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:35.315591  7348 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:35.316365  7348 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.321528  7866 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:35.322409  7866 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:35.299274  7631 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:35.347399  4773 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 4 to 6, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 6 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:35.359483  4773 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:35.361673  4773 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.362749  4773 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.363653  4773 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:35.375007  4773 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 4 to 6, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 6 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:35.376586  4773 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 8 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.378207  4773 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 4 to 7, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 7 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.379551  4773 catalog_manager.cc:5697] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:35.380678  4773 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 9, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 9 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.396207  4771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 221) took 7727 ms. Trace:
I20260709 12:10:35.398406  4773 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 3 to 6, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 6 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.399919  4773 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 1 to 5, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 5 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.405921  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:35.396582  4771 rpcz_store.cc:276] 0709 12:10:27.668597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.668855 (+   258us) service_pool.cc:224] Handling call
0709 12:10:27.923006 (+254151us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5400240090. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c60b2 00007f2a6073f759 00007f2a606d7a76 00007f2a606a8d58 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc
0709 12:10:28.060649 (+137643us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:35.396147 (+7335498us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:35.079962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:35.080469 (+   507us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:35.080503 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:10:35.080519 (+    16us) tablet.cc:662] Decoding operations
0709 12:10:35.082338 (+  1819us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:35.082410 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:35.082434 (+    24us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:10:35.088359 (+  5925us) tablet.cc:701] Row locks acquired
0709 12:10:35.088376 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:35.088509 (+   133us) write_op.cc:270] Start()
0709 12:10:35.088615 (+   106us) write_op.cc:276] Timestamp: P: 1783599035088469 usec, L: 0
0709 12:10:35.088635 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:35.089640 (+  1005us) log.cc:844] Serialized 10592 byte log entry
0709 12:10:35.198946 (+109306us) op_driver.cc:464] REPLICATION: finished
0709 12:10:35.285292 (+ 86346us) write_op.cc:301] APPLY: starting
0709 12:10:35.285379 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:35.285898 (+   519us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:35.286006 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:35.288140 (+  2134us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:35.288476 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 12:10:35.288520 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:35.329043 (+ 40523us) log.cc:844] Serialized 182 byte log entry
0709 12:10:35.329798 (+   755us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:35.330008 (+   210us) write_op.cc:454] Released schema lock
0709 12:10:35.330068 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:35.349735 (+ 19667us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:35.349768 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":456334,"reported_tablets":51,"spinlock_wait_cycles":11590144,"child_traces":[["op",{"apply.queue_time_us":64563,"apply.run_cpu_time_us":4523,"apply.run_wall_time_us":59086,"num_ops":27,"prepare.queue_time_us":14387,"prepare.run_cpu_time_us":5618,"prepare.run_wall_time_us":17591,"replication_time_us":109824,"thread_start_us":65088,"threads_started":2}]]}
I20260709 12:10:35.505846  7885 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:35.506536  7885 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.506217  4770 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:35.511960  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:35.512481  4874 raft_consensus.cc:606] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:35.512795  4874 raft_consensus.cc:614] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:35.514262  4770 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 1 to 4, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 4 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.514840  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:35.515595  4874 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:35.517712  7885 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.518220  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:35.518678  5022 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:35.519579  4915 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:35.520608  7885 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:35.521021  7885 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:35.521421  7885 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.522338  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:35.523227  4874 raft_consensus.cc:606] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:35.525861  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:35.526389  4874 raft_consensus.cc:606] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:35.527036  4874 raft_consensus.cc:614] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:35.540918  7885 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.544885  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:35.545022  7885 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.555897  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:35.556578  4871 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:35.566921  7881 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.567373  7881 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.569296  7881 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.572340  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:35.572945  4950 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:35.582046  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:35.582782  5598 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:35.584697  7829 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:35.585060  7829 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.585378  7829 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.587152  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:35.589082  7541 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.590518  7541 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.594559  7885 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:35.596376  7829 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.597628  7631 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.598145  7631 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.599913  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:35.600680  4871 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:10:35.600725  7631 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:35.602259  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:35.603113  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:35.603381  7797 raft_consensus.cc:993] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:35.603860  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:35.608784  4874 raft_consensus.cc:606] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:35.609166  4874 raft_consensus.cc:614] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:35.609688  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:35.604315  5597 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:10:35.604460  7797 raft_consensus.cc:1081] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:35.611891  5024 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:35.604197  4871 raft_consensus.cc:1813] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Handling vote request from an unknown peer baa50eb5ed704004b7f391934a59d010
I20260709 12:10:35.611784  4988 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:35.612995  4871 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:10:35.613592  4915 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:35.615442  7882 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:35.615926  7882 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:35.618309  7631 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:35.618958  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fedd910b0097474d987abca8337e4e48"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:35.621636  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:35.622184  4874 raft_consensus.cc:606] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:35.623667  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:35.623631  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:35.624500  7749 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:35.618264  5024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:35.616743  7882 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.620343  7541 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.621614  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:35.625397  5023 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:10:35.629271  5024 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:35.632220  5024 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.635376  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:35.640501  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:35.641048  5023 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.649734  5023 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:35.653680  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:35.658435  7829 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.661315  5023 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:35.664376  7797 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:35.664953  7797 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:35.666159  7882 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:35.665802  7797 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.667121  5024 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.680768  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:35.681548  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:35.687840  7881 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.688304  7881 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.690204  7881 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.690706  5021 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:35.692090  7885 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:35.693884  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:35.694335  4950 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:35.695478  4839 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:35.696642  5024 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:35.698695  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:35.698935  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:35.699230  4871 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.699530  4871 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:35.700160  4874 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:35.700201  4871 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.701510  4871 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.698217  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:35.702769  4950 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.704954  7881 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:35.705336  7881 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.705668  7881 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.709875  4950 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:35.710055  4871 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:35.712275  7882 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:35.715548  4988 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:35.718418  7631 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.720155  7631 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:35.720952  7631 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.743470  5024 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:35.749418  7885 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:35.766644  4874 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:35.771492  7793 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.795047  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 197) took 10078 ms. Trace:
I20260709 12:10:35.785127  7793 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:35.795363  4770 rpcz_store.cc:276] 0709 12:10:25.707825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.721032 (+ 13207us) service_pool.cc:224] Handling call
0709 12:10:35.786198 (+10065166us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:35.529759 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:35.530245 (+   486us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:35.530276 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:10:35.530295 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:35.530666 (+   371us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:35.530723 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:35.530751 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:35.531073 (+   322us) tablet.cc:701] Row locks acquired
0709 12:10:35.531106 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:10:35.531237 (+   131us) write_op.cc:270] Start()
0709 12:10:35.531348 (+   111us) write_op.cc:276] Timestamp: P: 1783599035531197 usec, L: 0
0709 12:10:35.531373 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:10:35.532195 (+   822us) log.cc:844] Serialized 923 byte log entry
0709 12:10:35.534957 (+  2762us) op_driver.cc:464] REPLICATION: finished
0709 12:10:35.535358 (+   401us) write_op.cc:301] APPLY: starting
0709 12:10:35.535424 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:35.535521 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:35.535600 (+    79us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:35.535883 (+   283us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:35.536057 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:35.536107 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:35.536264 (+   157us) log.cc:844] Serialized 29 byte log entry
0709 12:10:35.536389 (+   125us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:35.536458 (+    69us) write_op.cc:454] Released schema lock
0709 12:10:35.536496 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:35.552004 (+ 15508us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:35.552037 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":125165,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":209,"apply.run_cpu_time_us":1423,"apply.run_wall_time_us":1423,"num_ops":2,"prepare.queue_time_us":340,"prepare.run_cpu_time_us":2474,"prepare.run_wall_time_us":2671,"replication_time_us":3456}]]}
I20260709 12:10:35.803694  7960 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:10:35.844254  5025 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:35.848948  7797 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:35.856030  4944 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:10:35.870702  7983 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:10:35.866703  5023 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:35.903347  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:35.861971  7797 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.869972  4769 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 4 to 5, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 5 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:35.919840  4868 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:35.911258  7749 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.921707  7348 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:35.905601  7866 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:10:35.932613  7989 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:35.933177  7989 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.935639  4949 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:35.919940  7990 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.913237  7881 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:35.913715  7797 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.927058  7793 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:35.926239  7749 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:35.969177  7797 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:35.974252  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:35.975365  5024 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:10:35.972489  7989 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:35.948444  7990 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:36.006016  4874 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:35.979326  7881 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:36.001426  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 62250.9us
I20260709 12:10:36.015494  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:36.015544  4944 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:36.021929  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:36.022472  4950 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.031833  4950 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:36.034555  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:36.049065  7990 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:36.053722  4990 consensus_peers.cc:597] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: acd2c2ca421a4b8e9629cd5b12e89e72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:36.054821  4769 catalog_manager.cc:5697] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 3 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:36.055579  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:36.057277  7720 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:36.057659  7720 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:36.057992  7720 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:36.059118  4769 catalog_manager.cc:5697] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 3 to 4, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 4 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:36.059842  8002 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:36.079535  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 160266us
I20260709 12:10:36.081406  4871 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:36.087183  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:36.091361  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:36.097167  4950 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:36.099730  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:36.073879  7724 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:10:36.133641  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 67890.1us
I20260709 12:10:36.108114  8006 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:36.130259  7866 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:36.103611  7556 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:10:36.179680  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:36.179138  7985 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:10:36.184788  7975 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:36.203751  7348 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:36.193894  7881 raft_consensus.cc:993] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:36.217381  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:36.217828  4950 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:36.217964  5021 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
W20260709 12:10:36.218924  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 120423us
I20260709 12:10:36.182708  7866 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:36.221254  7724 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:10:36.183753  8006 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:36.212213  7749 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:36.221169  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:36.218748  7882 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:36.277369  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 97753.7us
I20260709 12:10:36.282331  8006 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:36.283100  8024 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:10:36.283540  8024 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.283847  8024 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:36.332178  4915 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:36.382282  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:36.382959  5597 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:36.376641  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:36.386579  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:36.388407  5598 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:36.409898  7866 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:36.406266  7720 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:36.429539  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 256349us
W20260709 12:10:36.439682  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 52127.2us
I20260709 12:10:36.452948  7797 raft_consensus.cc:1081] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:36.477497  8026 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:36.486580  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 109250us
I20260709 12:10:36.499809  5024 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:36.500864  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:36.501415  4949 raft_consensus.cc:2368] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:10:36.499683  7720 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:36.481547  8024 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:36.543085  5597 raft_consensus.cc:2368] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:10:36.549212  4988 leader_election.cc:400] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:10:36.549575  4988 leader_election.cc:403] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.534307  8036 raft_consensus.cc:476] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Not starting pre-election -- already a leader
W20260709 12:10:36.552827  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 364727us
I20260709 12:10:36.558808  4873 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:36.559755  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:36.560650  4874 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:36.557916  4839 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:36.565886  8024 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:36.567085  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:36.557304  7881 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:36.567639  5024 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:36.554735  8007 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.577721  7797 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:36.578224  7797 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:36.579020  7797 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:36.586452  4942 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:36.586813  4942 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:36.587458  4942 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:36.590178  8023 consensus_queue.cc:1059] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:36.590811  8023 consensus_queue.cc:1243] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:36.596490  4942 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.599826  5022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fedd910b0097474d987abca8337e4e48"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:36.600390  5022 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:36.600723  5022 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.605147  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:36.607579  4942 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:10:36.607937  4942 pending_rounds.cc:85] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 4
I20260709 12:10:36.608167  4942 pending_rounds.cc:107] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:10:36.608382  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:36.609046  4871 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:10:36.608366  4942 raft_consensus.cc:2889] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.629755  8007 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:10:36.633112  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:36.644016  4867 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:10:36.633801  5022 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:36.652690  4867 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:10:36.655789  5024 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:10:36.674157  4841 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:36.676520  4841 leader_election.cc:400] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:10:36.696628  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:36.696955  5022 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:36.697475  5604 raft_consensus.cc:2368] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:10:36.679479  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:36.697873  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:36.701406  4867 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:36.706269  4841 leader_election.cc:400] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:10:36.706561  4841 leader_election.cc:403] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.707003  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:36.707434  4871 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:36.707721  4871 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:36.696591  8012 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:36.715678  4871 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:36.713114  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:36.717778  4945 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.723842  4917 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:36.724509  4945 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:36.726884  5022 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:36.734663  4771 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 9 to 11, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:36.707754  8027 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:10:36.753350  7961 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:36.713505  8003 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:10:36.737587  7987 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:36.761138  7987 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:36.761484  7987 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:36.721095  7989 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:36.722054  8012 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.767892  8012 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:36.789712  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:36.798197  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 59183.6us
W20260709 12:10:36.802899  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 59934.6us
I20260709 12:10:36.804147  4988 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:36.808477  7724 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.824745  8046 ts_tablet_manager.cc:933] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:36.778708  8027 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:36.834879  4871 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.844419  4871 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:36.833375  7724 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:36.845872  7724 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:36.847867  8027 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:36.849416  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 116468us
W20260709 12:10:36.860543  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 137914us
I20260709 12:10:36.865924  8003 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:10:36.893364  7961 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:36.903208  5022 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.898522  4945 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:36.928925  8012 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:36.930586  7987 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:36.931022  8012 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:36.931669  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:36.932251  4945 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:36.932516  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:36.933126  5604 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:36.943854  4945 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:36.944742  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:36.946921  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:36.948735  4870 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10.
I20260709 12:10:36.951206  4917 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10.
I20260709 12:10:36.951581  4917 leader_election.cc:403] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.945942  4873 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:36.961544  5604 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:36.963577  7961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54508 (request call id 13) took 1114 ms. Trace:
W20260709 12:10:36.966490  8049 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:10:36.954679  8046 tablet_copy_client.cc:323] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:10:36.972077  7961 rpcz_store.cc:276] 0709 12:10:35.840584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.840686 (+   102us) service_pool.cc:224] Handling call
0709 12:10:35.940396 (+ 99710us) log.cc:844] Serialized 499 byte log entry
0709 12:10:36.000773 (+ 60377us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b54000274a0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a863142 00007f2a5a843eaa 00007f2a5a84ad53 00007f2a5a84acd9 00007f2a5a84ac69 00007f2a5a84ac31 00007f2a5a849dfd 0000000000388634 0000000000388479 00007f2a577fd475
0709 12:10:36.952230 (+951457us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16184,"raft.queue_time_us":25967,"raft.run_cpu_time_us":2730,"raft.run_wall_time_us":163643,"spinlock_wait_cycles":6887552,"thread_start_us":54530,"threads_started":2,"wal-append.queue_time_us":75636}
I20260709 12:10:36.954293  8050 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:36.974370  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet acd2c2ca421a4b8e9629cd5b12e89e72 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:10:36.974627  8050 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:36.975487  8050 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:36.974926  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet acd2c2ca421a4b8e9629cd5b12e89e72 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-acd2c2ca421a4b8e9629cd5b12e89e72
I20260709 12:10:36.958163  7882 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10.
I20260709 12:10:36.989979  7987 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:37.006939  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:37.007656  5604 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10.
I20260709 12:10:37.009730  4916 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10.
I20260709 12:10:37.013763  5034 tablet_copy_source_session.cc:215] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:10:37.036113  4822 auto_rebalancer.cc:629] Failed to schedule move for tablet 6f0691894555408ab3e2a8dedaa21303: Illegal state: Replica 8de40fe2bb814adcbe13958669063dc9 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } }
W20260709 12:10:37.071156  4822 auto_rebalancer.cc:629] Failed to schedule move for tablet 22be31682d204ff18c81f1e0ac60a00a: Illegal state: Replica baa50eb5ed704004b7f391934a59d010 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.079705  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:37.097326  4872 raft_consensus.cc:606] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:37.103506  4822 auto_rebalancer.cc:629] Failed to schedule move for tablet 7d89e729329948059879ed6f44a07690: Illegal state: Replica 4f3bf546572147c3abe4522189e86ce6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.105295  4945 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:37.115257  8046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd2c2ca421a4b8e9629cd5b12e89e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:37.117429  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:37.118017  4872 raft_consensus.cc:606] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:37.140360  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:37.140949  4872 raft_consensus.cc:606] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:37.141301  4872 raft_consensus.cc:614] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:37.113823  8041 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:37.155717  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:37.156311  4872 raft_consensus.cc:606] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:37.157281  4872 raft_consensus.cc:614] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:37.177114  8058 log.cc:927] Time spent T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:10:37.202572  8046 tablet_copy_client.cc:806] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:37.203194  8046 tablet_copy_client.cc:670] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:37.207060  8046 tablet_copy_client.cc:538] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:37.242120  4773 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.245488  4773 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 6, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 6 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.252763  4771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 126) took 1589 ms. Trace:
I20260709 12:10:37.259861  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:37.260875  4869 raft_consensus.cc:606] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:37.261410  4869 raft_consensus.cc:614] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:37.247848  4773 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 6, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 6 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.298334  5024 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:37.255323  4771 rpcz_store.cc:276] 0709 12:10:35.663430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.663556 (+   126us) service_pool.cc:224] Handling call
0709 12:10:35.694583 (+ 31027us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b5400240090. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c60b2 00007f2a6073f759 00007f2a606d7a76 00007f2a606a8d58 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc
0709 12:10:37.252480 (+1557897us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:36.758087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:36.758595 (+   508us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:36.758626 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:10:36.758641 (+    15us) tablet.cc:662] Decoding operations
0709 12:10:36.758955 (+   314us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:36.759005 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:36.759030 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:36.759211 (+   181us) tablet.cc:701] Row locks acquired
0709 12:10:36.759227 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:10:36.759357 (+   130us) write_op.cc:270] Start()
0709 12:10:36.759448 (+    91us) write_op.cc:276] Timestamp: P: 1783599036759316 usec, L: 0
0709 12:10:36.759467 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:36.860246 (+100779us) log.cc:844] Serialized 533 byte log entry
0709 12:10:36.924346 (+ 64100us) op_driver.cc:464] REPLICATION: finished
0709 12:10:36.925075 (+   729us) write_op.cc:301] APPLY: starting
0709 12:10:36.925153 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:36.925246 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:36.925341 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:36.925519 (+   178us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:36.925659 (+   140us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:36.925700 (+    41us) write_op.cc:312] APPLY: finished
0709 12:10:36.925872 (+   172us) log.cc:844] Serialized 23 byte log entry
0709 12:10:36.926014 (+   142us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:36.926098 (+    84us) write_op.cc:454] Released schema lock
0709 12:10:36.926133 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:36.984179 (+ 58046us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e5e28 00007f2a5e320581 00007f2a5e31fd58 00007f2a5e3249f1 00007f2a5e3249a9 00007f2a5e324939 00007f2a5e324901 00007f2a5e323b2d 0000000000388634 0000000000388479
0709 12:10:36.984382 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:36.984410 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":385167,"reported_tablets":1,"spinlock_wait_cycles":6171392,"child_traces":[["op",{"apply.queue_time_us":495,"apply.run_cpu_time_us":1315,"apply.run_wall_time_us":1314,"num_ops":1,"prepare.queue_time_us":81,"prepare.run_cpu_time_us":4812,"prepare.run_wall_time_us":242866,"replication_time_us":146951,"spinlock_wait_cycles":89250048}]]}
I20260709 12:10:37.305660  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:37.346902  8000 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:37.390313  8046 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:37.411763  5021 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:10:37.413712  8027 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:37.358803  4773 catalog_manager.cc:5697] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 6, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 6 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.457653  4942 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:37.471859  4874 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:37.504050  8036 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:37.566926  4773 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 7, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.565016  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:37.569895  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:37.568614  4773 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.573655  4773 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:37.582506  5604 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:37.586481  8022 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:37.603345  4873 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:10:37.609018  8035 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:37.617327  4773 catalog_manager.cc:5697] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 6, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:37.611917  8021 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:10:37.619442  4773 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 1 to 7, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.696607  4945 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:37.698606  7881 raft_consensus.cc:993] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:37.699250  7881 raft_consensus.cc:1081] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:37.697943  4773 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 3 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.715564  4773 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 6, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.724831  7720 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:10:37.745949  4948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:37.746510  4948 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:37.746867  4948 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:37.754491  7720 raft_consensus.cc:993] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:37.755479  8022 raft_consensus.cc:1081] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:37.757339  4773 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:37.758816  4773 catalog_manager.cc:5697] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 9, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 9 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.760447  4773 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 6 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.765815  4773 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.767143  4773 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.768378  4773 catalog_manager.cc:5697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 6, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 6 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:37.788615  4948 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:37.799077  4943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:37.799613  4943 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:37.799938  4943 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.804106  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:37.804728  4870 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:37.805006  4870 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:37.805780  4870 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:37.806847  4870 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:37.822542  4870 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:37.848347  4943 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:37.848845  4769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 214) took 9057 ms. Trace:
I20260709 12:10:37.851009  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:37.851563  4871 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:37.851836  4871 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:37.852610  4871 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:37.854135  4871 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.854348  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:37.855463  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:37.855988  5019 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.857923  7988 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:37.858405  7988 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:37.859328  7988 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:37.849391  4769 rpcz_store.cc:276] 0709 12:10:28.790904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.798471 (+  7567us) service_pool.cc:224] Handling call
0709 12:10:37.848626 (+9050155us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:36.481931 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:36.482454 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:36.482485 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:10:36.484564 (+  2079us) tablet.cc:662] Decoding operations
0709 12:10:36.488239 (+  3675us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:36.488292 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:36.488318 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:36.488616 (+   298us) tablet.cc:701] Row locks acquired
0709 12:10:36.488635 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:10:36.488752 (+   117us) write_op.cc:270] Start()
0709 12:10:36.488881 (+   129us) write_op.cc:276] Timestamp: P: 1783599036488708 usec, L: 0
0709 12:10:36.488900 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:36.496454 (+  7554us) log.cc:844] Serialized 1308 byte log entry
0709 12:10:36.513736 (+ 17282us) op_driver.cc:464] REPLICATION: finished
0709 12:10:36.699688 (+185952us) write_op.cc:301] APPLY: starting
0709 12:10:36.699770 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:36.699894 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:36.700007 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:36.700406 (+   399us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:36.700576 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:36.700618 (+    42us) write_op.cc:312] APPLY: finished
0709 12:10:36.700800 (+   182us) log.cc:844] Serialized 35 byte log entry
0709 12:10:36.700965 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:36.701052 (+    87us) write_op.cc:454] Released schema lock
0709 12:10:36.701087 (+    35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":18830,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":185717,"apply.run_cpu_time_us":1690,"apply.run_wall_time_us":1691,"num_ops":3,"prepare.queue_time_us":228539,"prepare.run_cpu_time_us":2915,"prepare.run_wall_time_us":14781,"replication_time_us":24677,"thread_start_us":354622,"threads_started":2}]]}
I20260709 12:10:37.864682  4871 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:37.857460  8018 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Committing config change with OpId 8.8: config changed from index 3 to 8, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:37.871407  4917 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:37.875272  5598 raft_consensus.cc:2955] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 3 to 8, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:37.882071  4948 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:37.886623  8002 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:37.887120  8002 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:37.887926  8002 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:37.911782  5019 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:37.914498  4943 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:37.936019  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:37.940032  5604 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:38.000589  8046 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:38.001557  8046 tablet_bootstrap.cc:492] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:38.002259  8046 ts_tablet_manager.cc:1403] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.786s	user 0.029s	sys 0.020s
I20260709 12:10:37.988672  8018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39302 (request call id 76) took 4237 ms. Trace:
I20260709 12:10:38.007172  8018 rpcz_store.cc:276] 0709 12:10:33.751472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.751592 (+   120us) service_pool.cc:224] Handling call
0709 12:10:33.908683 (+157091us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b540045ca20. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a867520 00007f2a5a8f0b42 00007f2a5a8ef800 00007f2a5a8e89fa 00007f2a5f8b04c9 00007f2a58e2cc54 00007f2a58e2cbe2 00007f2a58e2cb11 00007f2a58e2ca8c 00007f2a58e2bd42
0709 12:10:34.025593 (+116910us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b540045ca20. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8674b1 00007f2a5a8ef863 00007f2a5a8e89fa 00007f2a5f8b04c9 00007f2a58e2cc54 00007f2a58e2cbe2 00007f2a58e2cb11 00007f2a58e2ca8c 00007f2a58e2bd42 00007f2a58c2548c
0709 12:10:34.158895 (+133302us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b2c000014c8. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a591e3a11 00007f2a591f2a0a 00007f2a591f2693 00007f2a591f2631 00007f2a5a925902 00007f2a5a9256dd 00007f2a5a8f0f3f 00007f2a5a8f06b3 00007f2a5a8e89fa 00007f2a5f8b04c9 00007f2a58e2cc54
0709 12:10:34.170919 (+ 12024us) log.cc:844] Serialized 494 byte log entry
0709 12:10:34.383331 (+212412us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b18003f5380. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a57777c0a 00007f2a60eb7219 00007f2a577ffa40 00007f2a577fa4e4 00007f2a577fa455 00007f2a5a843b0b 00007f2a5a8c8b63 00007f2a5a8f0752 00007f2a5a8e89fa
0709 12:10:37.988550 (+3605219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52205,"raft.queue_time_us":74305,"raft.run_cpu_time_us":1086,"raft.run_wall_time_us":21374,"spinlock_wait_cycles":138751232,"thread_start_us":142116,"threads_started":1,"wal-append.queue_time_us":165080,"wal-append.run_cpu_time_us":2112,"wal-append.run_wall_time_us":1062125}
I20260709 12:10:38.035861  5604 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:38.037130  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36177f71106c42f98afc1b375e5f6838 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 2)
I20260709 12:10:38.058557  8046 raft_consensus.cc:359] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:38.059454  8046 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:38.060096  8046 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:38.072187  8046 ts_tablet_manager.cc:1434] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.001s
I20260709 12:10:38.074473  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-acd2c2ca421a4b8e9629cd5b12e89e72 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:10:38.075006  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-acd2c2ca421a4b8e9629cd5b12e89e72 on tablet acd2c2ca421a4b8e9629cd5b12e89e72 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:38.137655  4771 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 11 to 13, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 13 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.205482  4770 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:38.210774  4770 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 4 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } }
I20260709 12:10:38.215731  4770 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 4 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:38.217306  4770 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 3 to 8, term changed from 6 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65), VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:38.220923  4770 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:38.225328  4773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 222) took 2664 ms. Trace:
I20260709 12:10:38.247475  4771 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:38.226562  4773 rpcz_store.cc:276] 0709 12:10:35.561339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.619479 (+ 58140us) service_pool.cc:224] Handling call
0709 12:10:35.711699 (+ 92220us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5400240090. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c60b2 00007f2a6073f759 00007f2a606d7a76 00007f2a606a8d58 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc
0709 12:10:35.749679 (+ 37980us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b5400240090. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5e9c 00007f2a577c60f6 00007f2a6073f759 00007f2a606d7a76 00007f2a606a8d58 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc
0709 12:10:38.225258 (+2475579us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:37.964822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:37.965376 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:37.965420 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:10:37.965439 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:37.970716 (+  5277us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:37.970791 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:37.970822 (+    31us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:10:37.972125 (+  1303us) tablet.cc:701] Row locks acquired
0709 12:10:37.972158 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:10:37.972323 (+   165us) write_op.cc:270] Start()
0709 12:10:37.972454 (+   131us) write_op.cc:276] Timestamp: P: 1783599037972267 usec, L: 0
0709 12:10:37.972476 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:37.973186 (+   710us) log.cc:844] Serialized 6694 byte log entry
0709 12:10:38.098414 (+125228us) op_driver.cc:464] REPLICATION: finished
0709 12:10:38.113120 (+ 14706us) write_op.cc:301] APPLY: starting
0709 12:10:38.113195 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:38.113499 (+   304us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:38.113646 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:38.127929 (+ 14283us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:38.128238 (+   309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:10:38.128280 (+    42us) write_op.cc:312] APPLY: finished
0709 12:10:38.128701 (+   421us) log.cc:844] Serialized 119 byte log entry
0709 12:10:38.129482 (+   781us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:38.129644 (+   162us) write_op.cc:454] Released schema lock
0709 12:10:38.129715 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:38.130073 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:38.130100 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":509393,"reported_tablets":40,"spinlock_wait_cycles":52022528,"child_traces":[["op",{"apply.queue_time_us":14474,"apply.run_cpu_time_us":6828,"apply.run_wall_time_us":16932,"num_ops":17,"prepare.queue_time_us":97561,"prepare.run_cpu_time_us":17716,"prepare.run_wall_time_us":72662,"raft.queue_time_us":47922,"raft.run_cpu_time_us":2389,"raft.run_wall_time_us":13521,"replication_time_us":125709,"spinlock_wait_cycles":1076352,"thread_start_us":181353,"threads_started":4,"wal-append.queue_time_us":72784}]]}
I20260709 12:10:38.255026  4771 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:38.302932  4769 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 9, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:38.319334  5021 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:38.321003  8002 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:38.309674  4769 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 6 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.328773  4769 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 4 to 7, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.356276  4769 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:10:38.357574  4870 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:38.359445  8006 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:38.366110  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 198) took 1738 ms. Trace:
I20260709 12:10:38.366525  4770 rpcz_store.cc:276] 0709 12:10:36.627756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.628201 (+   445us) service_pool.cc:224] Handling call
0709 12:10:36.803414 (+175213us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:38.366043 (+1562629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:38.227883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:38.228361 (+   478us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:38.228391 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:10:38.228406 (+    15us) tablet.cc:662] Decoding operations
0709 12:10:38.229033 (+   627us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:38.229090 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:38.229117 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:10:38.229594 (+   477us) tablet.cc:701] Row locks acquired
0709 12:10:38.229608 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:10:38.229749 (+   141us) write_op.cc:270] Start()
0709 12:10:38.229846 (+    97us) write_op.cc:276] Timestamp: P: 1783599038229708 usec, L: 0
0709 12:10:38.229863 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:10:38.230777 (+   914us) log.cc:844] Serialized 2070 byte log entry
0709 12:10:38.232525 (+  1748us) op_driver.cc:464] REPLICATION: finished
0709 12:10:38.232867 (+   342us) write_op.cc:301] APPLY: starting
0709 12:10:38.232934 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:38.233072 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:38.233158 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:38.233745 (+   587us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:38.233925 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:10:38.233967 (+    42us) write_op.cc:312] APPLY: finished
0709 12:10:38.234160 (+   193us) log.cc:844] Serialized 47 byte log entry
0709 12:10:38.234290 (+   130us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:38.234385 (+    95us) write_op.cc:454] Released schema lock
0709 12:10:38.234424 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:38.234744 (+   320us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:38.234770 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31681,"reported_tablets":45,"spinlock_wait_cycles":336326912,"child_traces":[["op",{"apply.queue_time_us":161,"apply.run_cpu_time_us":1839,"apply.run_wall_time_us":1838,"num_ops":5,"prepare.queue_time_us":720,"prepare.run_cpu_time_us":2946,"prepare.run_wall_time_us":3179,"replication_time_us":2544,"spinlock_wait_cycles":868096}]]}
I20260709 12:10:38.366930  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 36177f71106c42f98afc1b375e5f6838 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:55706
I20260709 12:10:38.381549  5604 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:38.384217  8026 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:38.409338  8087 tablet_replica.cc:333] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:10:38.410584  8087 raft_consensus.cc:2243] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:38.414206  8087 raft_consensus.cc:2272] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:38.426748  4870 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:38.427911  8037 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:38.451890  5604 raft_consensus.cc:1217] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:10:38.459249  8087 ts_tablet_manager.cc:1916] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:38.471036  4770 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.476862  4770 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 10, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:38.558707  8087 ts_tablet_manager.cc:1929] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 12:10:38.559279  8087 log.cc:1199] T 36177f71106c42f98afc1b375e5f6838 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/36177f71106c42f98afc1b375e5f6838
I20260709 12:10:38.577814  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 36177f71106c42f98afc1b375e5f6838 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:38.905004  8035 raft_consensus.cc:1064] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:38.907769  8035 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:38.986428  4943 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:38.990082  5604 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:38.994029  7724 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:38.996364  7724 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.011909  4870 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:39.019686  8035 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:39.045192  4948 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.055349  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:39.044000  8035 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.095651  4771 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.119457  5598 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.155686  4871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:39.156243  4871 raft_consensus.cc:606] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:39.166422  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:39.166958  4948 raft_consensus.cc:606] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:39.170708  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:39.171283  4948 raft_consensus.cc:606] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:39.174077  4871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:39.174572  4871 raft_consensus.cc:606] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:39.175644  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:39.177261  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:39.178040  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:39.183105  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 93798.4us
I20260709 12:10:39.209492  8002 raft_consensus.cc:993] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:39.209961  8095 raft_consensus.cc:1081] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:39.237227  5021 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:39.246762  5598 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:39.248625  8035 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:39.255537  4871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:39.256009  4871 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:39.256354  4871 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:39.257709  7724 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.268250  5598 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.278964  4943 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:39.286374  8035 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:39.292045  4943 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.263176  4871 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.301646  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:39.302157  4948 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:39.302428  4948 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:39.303254  4948 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.304306  4948 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:39.304932  4871 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:39.308979  4870 raft_consensus.cc:2955] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.315196  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:39.315713  5021 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:39.322355  8026 raft_consensus.cc:993] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:39.322733  4948 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:10:39.325057  4839 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:39.326066  8099 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:39.326560  8099 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:39.327426  8099 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.329126  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet acd2c2ca421a4b8e9629cd5b12e89e72 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:39.322813  8026 raft_consensus.cc:1081] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:39.348259  4771 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:39.376829  4769 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 10 to 11, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.380861  5021 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:10:39.389683  4875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:39.390250  4875 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:39.390583  4875 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.401260  4875 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:39.404820  4875 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:39.405767  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:39.406683  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:39.406859  5598 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.407712  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet acd2c2ca421a4b8e9629cd5b12e89e72 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:39302
I20260709 12:10:39.408075  4948 raft_consensus.cc:3055] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:39.408406  4948 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:39.409214  4948 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:39.410595  4948 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.413815  5598 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:39.415091  4841 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:39.415809  8092 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:39.416272  8092 raft_consensus.cc:697] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:39.417137  8092 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:39.420985  4948 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:39.429286  4769 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 4 to 5, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 5 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:39.435583  8105 tablet_replica.cc:333] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:10:39.444348  8105 raft_consensus.cc:2243] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:39.445072  8105 raft_consensus.cc:2272] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:39.452003  8092 raft_consensus.cc:993] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:39.452494  8092 raft_consensus.cc:1081] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:39.456117  8105 ts_tablet_manager.cc:1916] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:39.457360  5021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:39.457881  5021 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:39.458225  5021 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.464318  5021 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.477555  5021 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:39.478513  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:39.479429  4948 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.491671  8105 ts_tablet_manager.cc:1929] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:10:39.492950  4948 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:39.493625  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:39.499253  8105 log.cc:1199] T acd2c2ca421a4b8e9629cd5b12e89e72 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/acd2c2ca421a4b8e9629cd5b12e89e72
I20260709 12:10:39.499517  4872 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:39.499858  4872 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:39.500476  4872 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.501732  4872 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.503047  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet acd2c2ca421a4b8e9629cd5b12e89e72 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:39.511569  4872 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:39.512665  4991 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:39.513478  8035 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.513937  8035 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:39.514734  8035 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.536221  8092 raft_consensus.cc:993] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:39.536671  8092 raft_consensus.cc:1081] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:39.538763  5021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:39.539242  5021 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:39.539554  5021 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.550804  5021 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.565078  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:39.565610  4872 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:39.565883  4872 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:39.566846  5021 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:39.566579  4872 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.567411  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:39.567605  4872 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.568044  4948 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.573848  4948 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:39.575678  4988 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:39.576546  8090 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:39.577031  8090 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:39.577922  8090 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:39.573633  4872 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:39.609781  4769 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 6 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:39.637297  4769 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:39.723264  5019 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:10:39.726140  8091 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:39.780335  4948 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:10:39.781991  8099 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:39.853801  4943 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:39.856564  8092 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.866499  5604 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:39.869973  8092 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.908056  4873 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:39.909533  8090 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:39.958061  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 73090.3us
I20260709 12:10:39.999259  4943 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:40.003831  8093 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:40.103530  4873 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:40.107013  8090 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:40.135927  4949 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:40.137485  8035 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:40.323975  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:40.572381  4873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:40.572996  4873 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:40.575893  4873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "951f0af961a844849af172b241003482"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:40.576390  4873 raft_consensus.cc:606] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:40.581094  5021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:10:40.581642  5021 raft_consensus.cc:606] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:40.583163  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:40.584750  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:40.585410  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:40.642442  4949 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:10:40.665817  4916 consensus_peers.cc:597] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da27e3db08424ba7a8f3d771f12de9a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:40.666424  5021 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:40.668002  4873 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:40.668275  8002 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:40.674842  8099 raft_consensus.cc:993] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:40.675307  8099 raft_consensus.cc:1081] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:40.677222  8026 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:40.681376  4943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "951f0af961a844849af172b241003482"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:40.681882  4943 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:40.682209  4943 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.731251  4943 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:40.733741  8002 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:40.742285  4872 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:40.736974  5019 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:40.772961  4770 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 6 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:40.796833  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:40.797400  4870 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.797686  4870 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:40.798358  4870 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:40.799486  4870 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.800642  4943 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:40.805768  4870 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:40.811596  8035 raft_consensus.cc:993] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:40.813623  8035 raft_consensus.cc:1081] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:40.818125  4917 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:40.822270  8002 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:40.823451  4873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:10:40.823827  8002 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:40.823978  4873 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:40.824362  4873 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.798914  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:40.824990  5021 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.826726  4875 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:40.836894  4873 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:40.841159  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:40.841723  4943 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.842110  5021 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:40.848479  4943 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:40.849593  4873 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:40.849903  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:40.851351  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:40.851912  5021 raft_consensus.cc:3055] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.852232  5021 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:40.853060  8092 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:40.853576  8092 raft_consensus.cc:697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:40.854386  8092 consensus_queue.cc:237] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:40.855618  5021 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:40.856961  5021 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.871035  5019 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:40.872853  5021 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
W20260709 12:10:40.874266  4841 consensus_peers.cc:597] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 008a4803b16b4c108fa5d52753a9f9a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:40.874977  8099 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:40.879987  4943 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:40.863530  8002 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:40.885257  8120 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:40.924582  4771 catalog_manager.cc:5697] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 6 to 7, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:40.935137  8099 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:40.936133  5019 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:40.953246  4771 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 9, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 9 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:40.957690  4769 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 3, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:10:40.973341  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 52098.1us
I20260709 12:10:40.997151  4949 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:41.010739  4943 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:41.076987  8099 raft_consensus.cc:993] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:41.077456  8099 raft_consensus.cc:1081] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:41.078893  5022 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:41.080293  8037 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:41.081183  4949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:41.081676  4949 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:41.081980  4949 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.080596  4875 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:41.084136  4916 consensus_peers.cc:597] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93239e0814394381aa73ef05e3ce06f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:41.085314  8037 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:41.088155  4949 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.090611  4949 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:41.091929  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:41.092475  5021 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.093144  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:41.093717  4873 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:41.094002  4873 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:41.094638  4873 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.096792  4873 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.101145  5021 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:41.101393  8037 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:41.103044  4873 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:41.103319  4915 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:41.104115  8002 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.104598  8002 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:41.105466  8002 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.110333  4875 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:41.162206  4770 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 4, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 5 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:41.192777  4771 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.235225  8147 ts_tablet_manager.cc:933] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:41.253291  8144 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:10:41.256155  4949 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:41.284405  8147 tablet_copy_client.cc:323] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:10:41.285028  5022 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:41.286427  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet da27e3db08424ba7a8f3d771f12de9a7 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:10:41.287288  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet da27e3db08424ba7a8f3d771f12de9a7 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-da27e3db08424ba7a8f3d771f12de9a7
I20260709 12:10:41.296242  4961 tablet_copy_source_session.cc:215] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:41.305310  8147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da27e3db08424ba7a8f3d771f12de9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:41.305574  5021 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:41.317952  8037 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.323336  4875 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:41.323591  4873 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:41.325505  8026 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:41.327593  4916 consensus_peers.cc:597] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3b5f40fd4fa49619588c424099a9a3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:41.327687  8143 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.323917  5022 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:41.334210  8037 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.380407  4948 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:41.382462  8138 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.384394  8026 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:41.400246  5019 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:41.401881  8137 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:41.410420  5022 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:41.423534  4771 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 5, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.461735  4872 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:41.489012  8147 tablet_copy_client.cc:806] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:41.491372  8147 tablet_copy_client.cc:670] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:41.524641  8147 tablet_copy_client.cc:538] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:41.549518  8147 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:41.591709  8169 ts_tablet_manager.cc:933] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:10:41.601992  8170 ts_tablet_manager.cc:933] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:41.605225  4870 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:41.606920  8026 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:41.620870  8170 tablet_copy_client.cc:323] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:10:41.621879  8169 tablet_copy_client.cc:323] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:10:41.630488  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet 93239e0814394381aa73ef05e3ce06f0 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:10:41.631021  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet 93239e0814394381aa73ef05e3ce06f0 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-93239e0814394381aa73ef05e3ce06f0
I20260709 12:10:41.639287  4961 tablet_copy_source_session.cc:215] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:41.643208  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 008a4803b16b4c108fa5d52753a9f9a3 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:10:41.643734  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 008a4803b16b4c108fa5d52753a9f9a3 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-008a4803b16b4c108fa5d52753a9f9a3
I20260709 12:10:41.653880  4885 tablet_copy_source_session.cc:215] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:41.656998  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:41.663619  8170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93239e0814394381aa73ef05e3ce06f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:41.665115  8169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008a4803b16b4c108fa5d52753a9f9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:41.676398  5019 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:41.681734  8026 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:41.749496  8147 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:41.751003  8147 tablet_bootstrap.cc:492] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:41.751843  8147 ts_tablet_manager.cc:1403] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.203s	user 0.024s	sys 0.008s
I20260709 12:10:41.756045  8170 tablet_copy_client.cc:806] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:41.763860  8170 tablet_copy_client.cc:670] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:41.761636  8176 ts_tablet_manager.cc:933] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:41.752441  8169 tablet_copy_client.cc:806] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:41.765422  8169 tablet_copy_client.cc:670] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:41.762832  8147 raft_consensus.cc:359] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:41.766010  8147 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:41.766742  8147 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:41.769022  8147 ts_tablet_manager.cc:1434] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:10:41.771390  4943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:41.771924  4943 raft_consensus.cc:606] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:41.776459  4943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:41.776984  4943 raft_consensus.cc:606] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:41.787055  4870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:41.787568  4870 raft_consensus.cc:606] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:41.788825  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:41.790396  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:41.791105  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:41.794874  4960 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-da27e3db08424ba7a8f3d771f12de9a7 received from {username='slave'} at 127.0.0.1:43248
I20260709 12:10:41.795085  8170 tablet_copy_client.cc:538] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:41.795395  4960 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-da27e3db08424ba7a8f3d771f12de9a7 on tablet da27e3db08424ba7a8f3d771f12de9a7 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:41.815518  8169 tablet_copy_client.cc:538] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:41.828181  8169 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:41.833992  8176 tablet_copy_client.cc:323] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:10:41.835000  8170 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:41.837316  4960 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet b3b5f40fd4fa49619588c424099a9a3b from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:10:41.837832  4960 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet b3b5f40fd4fa49619588c424099a9a3b from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-b3b5f40fd4fa49619588c424099a9a3b
I20260709 12:10:41.846192  8037 raft_consensus.cc:993] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:41.846634  8037 raft_consensus.cc:1081] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:41.848770  4870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:41.849251  4870 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:41.849586  4870 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.858619  4870 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.870499  4870 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:41.871326  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:41.871862  5019 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.879556  5019 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:41.880640  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:41.880774  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:41.881337  4948 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:41.881479  8137 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.882004  8137 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:41.882915  8137 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.883365  4948 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:41.884132  4948 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.885352  4948 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.851711  4960 tablet_copy_source_session.cc:215] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:41.895871  4948 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:41.908363  4771 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 8, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.911288  8178 raft_consensus.cc:993] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:41.911827  8092 raft_consensus.cc:1081] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:41.914882  5019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:41.915396  5019 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:41.916606  8176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b5f40fd4fa49619588c424099a9a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:41.917328  5019 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.924244  5019 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.925990  5019 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:41.926806  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:41.927353  4870 raft_consensus.cc:3055] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:41.927651  4870 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:41.927848  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:41.928548  4948 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.928310  4870 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.931238  4870 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.935268  4948 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:41.936448  4988 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:41.942073  4870 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:41.947798  8151 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.948307  8151 raft_consensus.cc:697] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:41.949090  8151 consensus_queue.cc:237] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:41.971246  4771 catalog_manager.cc:5697] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:42.006861  8169 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:42.011932  8169 tablet_bootstrap.cc:492] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:42.014155  8169 ts_tablet_manager.cc:1403] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.186s	user 0.027s	sys 0.017s
I20260709 12:10:42.019995  8169 raft_consensus.cc:359] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:42.022383  8169 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:42.022033  8170 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:42.028309  8170 tablet_bootstrap.cc:492] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:42.029048  8170 ts_tablet_manager.cc:1403] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.015s
I20260709 12:10:42.030043  8037 raft_consensus.cc:993] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:42.030694  8150 raft_consensus.cc:1081] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:42.031983  8170 raft_consensus.cc:359] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:42.033617  8170 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:42.034325  8170 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:42.026548  8169 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:42.035300  4872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:42.037890  4872 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:42.038221  4872 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.055347  4872 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:42.058312  8169 ts_tablet_manager.cc:1434] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.000s
I20260709 12:10:42.062489  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:42.063004  4943 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:42.060132  8170 ts_tablet_manager.cc:1434] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.001s
I20260709 12:10:42.063285  4943 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:42.064039  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-008a4803b16b4c108fa5d52753a9f9a3 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:10:42.064580  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-008a4803b16b4c108fa5d52753a9f9a3 on tablet 008a4803b16b4c108fa5d52753a9f9a3 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:42.064041  4943 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:42.065760  4943 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.069968  4872 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:42.071128  8176 tablet_copy_client.cc:806] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:42.071655  8176 tablet_copy_client.cc:670] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:42.073405  4943 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:42.074836  4960 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-93239e0814394381aa73ef05e3ce06f0 received from {username='slave'} at 127.0.0.1:43248
I20260709 12:10:42.074833  4839 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:42.076107  8137 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:42.077422  8137 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:42.077674  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:42.075300  4960 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-93239e0814394381aa73ef05e3ce06f0 on tablet 93239e0814394381aa73ef05e3ce06f0 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:42.081755  5021 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.085935  8176 tablet_copy_client.cc:538] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:42.089075  8137 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:42.090924  5021 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:42.096629  8176 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:42.098912  5597 raft_consensus.cc:1217] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:10:42.118858  4769 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 8, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:42.163789  8176 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:42.164649  8176 tablet_bootstrap.cc:492] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:42.165300  8176 ts_tablet_manager.cc:1403] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.008s
I20260709 12:10:42.168232  8176 raft_consensus.cc:359] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:42.169032  8176 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:42.169636  8176 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:42.175199  8176 ts_tablet_manager.cc:1434] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:10:42.176743  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-b3b5f40fd4fa49619588c424099a9a3b received from {username='slave'} at 127.0.0.1:43248
I20260709 12:10:42.177152  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-b3b5f40fd4fa49619588c424099a9a3b on tablet b3b5f40fd4fa49619588c424099a9a3b with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:42.186060  5597 raft_consensus.cc:1217] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 12:10:42.268016  5597 raft_consensus.cc:1217] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 12:10:42.284052  5021 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:42.286314  8137 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:42.329663  4943 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:42.331095  8120 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:42.577462  8187 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:10:42.650933  8092 raft_consensus.cc:1064] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:42.653787  8092 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:42.722018  4875 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:10:42.728451  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 215607us
I20260709 12:10:42.760466  4943 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:42.904568  5597 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:42.906210  8120 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:42.916419  4948 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:42.929703  5021 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:10:42.930255  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 193968us
I20260709 12:10:42.935410  8189 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:42.954022  5021 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:42.960135  8178 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:42.974051  8092 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:43.013144  5597 raft_consensus.cc:1217] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 12:10:43.013660  8092 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:43.029409  8202 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:43.038630  8120 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.040127  5019 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.053504  4948 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:43.063905  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:43.058094  5597 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.098053  4771 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 3 to 4, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:43.116415  8156 raft_consensus.cc:1064] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:43.125152  8156 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:43.134557  8198 raft_consensus.cc:1064] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:43.141444  8198 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:43.122201  8193 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 12:10:43.205211  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 102590us
W20260709 12:10:43.230867  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 72657.7us
W20260709 12:10:43.252140  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 72812.1us
I20260709 12:10:43.379169  5019 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:43.381685  4872 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:43.381995  5019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:10:43.382556  5019 raft_consensus.cc:606] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:43.390954  4948 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.433647  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:43.434300  4872 raft_consensus.cc:606] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:43.409065  8198 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:10:43.442345  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 158235us
I20260709 12:10:43.457552  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:43.458078  4872 raft_consensus.cc:606] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:43.445827  8150 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:43.482707  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:43.505088  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:43.509574  8092 raft_consensus.cc:993] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:43.510994  8092 raft_consensus.cc:1081] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:43.527556  5598 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:43.531172  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 247986us
I20260709 12:10:43.542215  4943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:43.542802  4943 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:43.543213  4943 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.544090  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:43.557214  8196 raft_consensus.cc:993] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:43.557653  8196 raft_consensus.cc:1081] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:43.572734  5597 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:43.578346  4943 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:43.584582  4874 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:43.585774  4943 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:43.602870  8150 raft_consensus.cc:1064] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:43.604988  8203 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:43.594570  8198 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 12:10:43.608335  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 160344us
I20260709 12:10:43.612347  4948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:43.612941  4948 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:43.613312  4948 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.616112  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:43.618615  4874 raft_consensus.cc:3055] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.618908  4874 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:43.619652  4874 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:43.620643  4874 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.630051  8037 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:43.636297  4948 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:43.641964  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:43.642472  4873 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.642735  4873 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:43.688951  4972 debug-util.cc:398] Leaking SignalData structure 0x7b0800398000 after lost signal to thread 3728
I20260709 12:10:43.693336  8150 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:43.704425  4874 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
W20260709 12:10:43.711789  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08000cede0 after lost signal to thread 4808
W20260709 12:10:43.717550  4972 debug-util.cc:398] Leaking SignalData structure 0x7b080030da00 after lost signal to thread 4900
W20260709 12:10:43.719070  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba180 after lost signal to thread 4975
W20260709 12:10:43.720178  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08003662c0 after lost signal to thread 5049
W20260709 12:10:43.721334  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6080 after lost signal to thread 5630
W20260709 12:10:43.721861  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08003218e0 after lost signal to thread 8176
I20260709 12:10:43.699756  4873 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:43.724443  4873 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.736974  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:43.752482  4873 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:43.763387  8203 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.763903  8203 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:43.764765  8203 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:43.768524  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.818260  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:43.819095  4948 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:43.819371  8037 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.819837  8037 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:43.820583  8037 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:43.833335  8156 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.847430  4874 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.861775  4870 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:43.867115  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 243041us
I20260709 12:10:43.878018  4769 catalog_manager.cc:5697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 4 to 5, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 5 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:43.881165  5598 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:43.885046  5601 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:43.887661  4770 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 5 to 6, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.888479  8220 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:43.892580  8206 raft_consensus.cc:993] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:43.893427  8206 raft_consensus.cc:1081] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:43.895462  8226 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.897583  8198 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:43.901499  5598 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.902148  5605 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.924001  4773 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 4 to 5, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 3 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.928166  5021 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:43.945261  5021 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:43.944393  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:43.948776  5024 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.955156  4870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:10:43.956100  4870 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:43.956471  4870 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:43.956971  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:43.957495  5022 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.958503  5024 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:43.961120  4872 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:43.966517  5022 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:43.973593  5024 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:43.976949  8197 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:44.006466  8197 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:44.019690  8150 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:43.968173  4870 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:44.043450  4870 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:44.042917  5019 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.052335  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 008a4803b16b4c108fa5d52753a9f9a3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:44.053303  4770 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 4 to 5, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 5 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:44.055370  8204 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:44.063990  8226 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:44.063151  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 008a4803b16b4c108fa5d52753a9f9a3 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:52362
W20260709 12:10:44.072420  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 53377us
I20260709 12:10:44.130115  4870 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:44.138471  4875 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.146063  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:44.146728  5024 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:44.147059  5024 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:44.147897  5024 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:44.152565  5024 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.153035  8256 tablet_replica.cc:333] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:10:44.157110  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:44.157630  4942 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.169804  4942 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:44.153589  5597 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.202735  5024 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:44.206246  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:44.208048  8092 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:44.208455  8092 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:44.215888  4942 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:44.212291  8092 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:44.222298  4770 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:44.274376  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 68191.9us
W20260709 12:10:44.286794  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 98482.1us
W20260709 12:10:44.287529  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 66834.6us
I20260709 12:10:44.298120  5022 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.316588  5020 raft_consensus.cc:2955] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.307808  8203 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:44.365906  8250 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 12:10:44.396027  8256 raft_consensus.cc:2243] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:44.396787  8256 raft_consensus.cc:2272] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:10:44.401826  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.404021  8256 ts_tablet_manager.cc:1916] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:44.408387  4770 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 9, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:44.458330  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 185757us
W20260709 12:10:44.459656  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 238198us
I20260709 12:10:44.478343  5597 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:44.492436  4949 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:44.496012  5019 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:44.497514  5019 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:44.497730  4870 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:44.499485  4870 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:44.504225  4875 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:44.512176  4770 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 4 to 5, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:44.524080  8268 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:44.527586  8268 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:44.530800  5019 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.531059  5597 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.531109  8268 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:10:44.538023  5598 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:44.545370  8260 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:44.547362  8260 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:44.550730  4875 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.553336  5019 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:44.563802  8268 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:44.565809  4942 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:44.568198  8256 ts_tablet_manager.cc:1929] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:10:44.572685  8260 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:44.585021  5597 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:44.588311  8260 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:44.596266  4871 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:44.603207  8150 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:44.604897  8257 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.605041  8150 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.613678  8199 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:44.568619  8256 log.cc:1199] T 008a4803b16b4c108fa5d52753a9f9a3 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/008a4803b16b4c108fa5d52753a9f9a3
I20260709 12:10:44.618616  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 008a4803b16b4c108fa5d52753a9f9a3 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:44.620167  5598 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.623973  4871 raft_consensus.cc:2955] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.638670  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b3b5f40fd4fa49619588c424099a9a3b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:44.640179  5605 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.648932  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da27e3db08424ba7a8f3d771f12de9a7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:44.653898  4770 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 6 to 7, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:44.665971  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet b3b5f40fd4fa49619588c424099a9a3b with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:55706
I20260709 12:10:44.658731  4773 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 6 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.691738  8275 tablet_replica.cc:333] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:10:44.703089  8264 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.726043  4871 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.729355  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet da27e3db08424ba7a8f3d771f12de9a7 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:39302
I20260709 12:10:44.736562  5023 raft_consensus.cc:2955] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.738518  8275 raft_consensus.cc:2243] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:44.739224  8275 raft_consensus.cc:2272] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:44.747241  5020 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:44.751148  8092 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:44.759717  8277 tablet_replica.cc:333] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:10:44.760776  8277 raft_consensus.cc:2243] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:44.761564  8277 raft_consensus.cc:2272] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:44.766177  4949 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:44.767087  8277 ts_tablet_manager.cc:1916] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:44.767570  5605 raft_consensus.cc:2955] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.756349  4770 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 5 to 6, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 5 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:44.818015  8092 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:44.829166  8277 ts_tablet_manager.cc:1929] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 12:10:44.829632  8277 log.cc:1199] T da27e3db08424ba7a8f3d771f12de9a7 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/da27e3db08424ba7a8f3d771f12de9a7
I20260709 12:10:44.831248  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet da27e3db08424ba7a8f3d771f12de9a7 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:44.862512  8275 ts_tablet_manager.cc:1916] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:44.862528  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 93239e0814394381aa73ef05e3ce06f0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:44.873245  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 93239e0814394381aa73ef05e3ce06f0 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:55706
I20260709 12:10:44.968456  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:44.995028  8275 ts_tablet_manager.cc:1929] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 12:10:44.995569  8275 log.cc:1199] T b3b5f40fd4fa49619588c424099a9a3b P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/b3b5f40fd4fa49619588c424099a9a3b
I20260709 12:10:44.997249  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet b3b5f40fd4fa49619588c424099a9a3b (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:45.004882  8275 tablet_replica.cc:333] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:10:45.043658  4942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:45.044246  4942 raft_consensus.cc:606] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:45.046752  4942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "951f0af961a844849af172b241003482"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:45.047243  4942 raft_consensus.cc:606] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:45.050935  4870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c480da15ff054400bdd09744d494717c"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:45.051332  4870 raft_consensus.cc:606] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:45.052361  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:45.053828  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:45.054773  8275 raft_consensus.cc:2243] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:45.055498  8275 raft_consensus.cc:2272] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:45.059031  8275 ts_tablet_manager.cc:1916] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:45.079334  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:45.116988  8275 ts_tablet_manager.cc:1929] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 12:10:45.117463  8275 log.cc:1199] T 93239e0814394381aa73ef05e3ce06f0 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/93239e0814394381aa73ef05e3ce06f0
I20260709 12:10:45.119088  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 93239e0814394381aa73ef05e3ce06f0 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:45.239054  8092 raft_consensus.cc:993] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:45.239550  8283 raft_consensus.cc:1081] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:45.241009  5022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c480da15ff054400bdd09744d494717c"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:45.241532  5022 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:45.241853  5022 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.248379  5022 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.253055  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:45.253566  4875 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.253856  4875 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:45.254535  4875 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.255524  4875 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.268602  4875 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:45.281986  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:45.282555  4942 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.283316  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:45.288235  8151 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:45.288697  8151 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:45.292608  8151 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.282584  5022 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:45.288707  4942 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:45.306483  4773 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:45.494745  8150 raft_consensus.cc:993] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:45.495217  8150 raft_consensus.cc:1081] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:45.505411  4875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "951f0af961a844849af172b241003482"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:45.505918  4875 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:45.506240  4875 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:45.519677  4875 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.532601  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:45.533152  5023 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:45.533478  4875 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:45.533401  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:45.535203  4942 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:45.535480  4942 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:45.536183  4942 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.537180  4942 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:45.538985  5023 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:45.547735  4840 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:45.549245  8193 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:45.549710  8193 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:45.550486  8193 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.580542  8260 raft_consensus.cc:993] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:45.581012  8260 raft_consensus.cc:1081] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:45.585520  4870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:45.586040  4870 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:45.586409  4870 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.606714  4942 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:45.620170  4870 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.622515  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:45.623067  4942 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:45.623394  4942 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:45.626219  4942 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.627214  4942 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.632440  4870 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:45.633914  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:45.634402  5023 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.638705  4942 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:45.639794  4839 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:45.639997  5023 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:45.640484  8092 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:45.640933  8092 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:45.641618  8092 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:45.659646  4773 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:45.688282  4773 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 8, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:45.795327  4942 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:45.798782  8151 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:45.838341  4875 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:45.843005  8284 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:45.935338  4942 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:45.936769  8193 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:45.988226  5020 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:45.992147  8283 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:46.106716  5020 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:10:46.123894  4990 consensus_peers.cc:597] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97f05b369a3a4067afed9c87ba39f448. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:46.126354  4948 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:46.127043  4871 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:46.128422  8035 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:46.129633  8284 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:46.173079  4948 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.174098  8284 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.174117  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:46.195596  4773 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.201382  4871 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.214033  5020 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:46.215246  8266 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:46.267093  4875 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:46.290139  4950 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:46.292637  8300 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:46.307945  4841 consensus_peers.cc:597] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d89e729329948059879ed6f44a07690. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:46.308254  5023 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:46.310842  8283 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:46.330433  4950 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:46.332352  8092 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.333248  5023 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.342759  8266 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:46.361122  5023 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:46.362288  4942 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.393524  4773 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:46.415696  4990 consensus_peers.cc:597] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee4c2e710f7a41958315091dfd907d8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:46.417508  4871 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:46.418824  8035 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:46.419160  4942 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:46.421106  8035 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:46.468601  8035 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.479699  4950 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.493621  4870 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.495823  4875 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:46.524513  5023 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:46.525558  4948 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:46.523901  4771 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 7, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.531798  8092 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:46.533996  8092 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:10:46.541182  4841 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3994e4d9351c414cb95b2a6e7bd76142. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:46.546845  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:46.547443  4872 raft_consensus.cc:606] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:46.555882  8313 ts_tablet_manager.cc:933] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:46.556981  5022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:10:46.561190  5022 raft_consensus.cc:606] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:46.584311  8092 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.586357  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:46.586889  4872 raft_consensus.cc:606] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:46.586089  5022 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.594954  4950 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:46.599684  8284 raft_consensus.cc:993] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:46.600183  8284 raft_consensus.cc:1081] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:46.602401  4875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:10:46.602881  4875 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:46.603202  4875 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.605787  4770 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.607365  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:46.614452  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:46.618678  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:46.621868  4875 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:46.623718  4875 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:46.624338  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:46.624593  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:46.624913  4942 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.625646  5022 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:46.625949  5022 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:46.626619  5022 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:46.627748  5022 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.646170  4942 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:46.647267  4839 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:46.648056  8300 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:46.648527  8300 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:46.649458  8300 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:46.654207  5022 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:46.683085  8313 tablet_copy_client.cc:323] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:10:46.684744  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 97f05b369a3a4067afed9c87ba39f448 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:10:46.685240  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 97f05b369a3a4067afed9c87ba39f448 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-97f05b369a3a4067afed9c87ba39f448
I20260709 12:10:46.692050  5034 tablet_copy_source_session.cc:215] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:46.700234  8313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f05b369a3a4067afed9c87ba39f448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:46.706081  4773 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.745746  8313 tablet_copy_client.cc:806] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:46.746338  8313 tablet_copy_client.cc:670] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:46.753682  8313 tablet_copy_client.cc:538] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:46.768471  8313 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:46.793048  8092 raft_consensus.cc:993] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:46.793535  8300 raft_consensus.cc:1081] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:46.796401  4948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:46.796944  4948 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:46.797261  4948 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.818889  4948 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:46.822857  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:46.823390  4872 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:46.823642  4872 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:46.824343  4872 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:46.826469  4948 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:46.826821  4872 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.826052  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:46.829098  5023 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:46.840358  4872 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:46.843822  5023 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:46.848244  4915 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:46.850708  8150 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:46.851146  8150 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:46.851902  8150 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:46.860527  8266 raft_consensus.cc:993] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:46.861038  8300 raft_consensus.cc:1081] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:46.862776  4942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:46.863273  4942 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:46.863592  4942 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.894682  4942 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:46.898607  4942 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:46.899461  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:46.902196  5023 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.908738  5023 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:46.909700  4915 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:46.911520  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:46.912097  4872 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:46.912357  4872 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:46.913054  4872 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:46.914405  4872 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.924247  8321 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:46.924767  8321 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:46.933945  4872 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:46.925984  8321 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:46.967832  8313 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:46.971984  8313 tablet_bootstrap.cc:492] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:46.972837  8313 ts_tablet_manager.cc:1403] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.205s	user 0.031s	sys 0.002s
I20260709 12:10:46.975644  8313 raft_consensus.cc:359] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:46.977100  4773 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 10, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:46.993759  8313 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:46.996577  8313 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:47.004717  8313 ts_tablet_manager.cc:1434] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:10:47.011111  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-97f05b369a3a4067afed9c87ba39f448 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:10:47.011519  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-97f05b369a3a4067afed9c87ba39f448 on tablet 97f05b369a3a4067afed9c87ba39f448 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:47.050812  8313 ts_tablet_manager.cc:933] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:47.050869  8323 ts_tablet_manager.cc:933] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:10:47.065125  4773 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 9, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 9 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:47.079564  5022 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:47.095073  8266 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:47.096777  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52362
I20260709 12:10:47.097340  4948 raft_consensus.cc:606] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Received request to transfer leadership
I20260709 12:10:47.103855  4950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52362
I20260709 12:10:47.104168  8323 tablet_copy_client.cc:323] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:10:47.112022  4950 raft_consensus.cc:606] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Received request to transfer leadership
W20260709 12:10:47.113317  4758 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 7d89e729329948059879ed6f44a07690 already in progress [suppressed 6 similar messages]
I20260709 12:10:47.145195  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:52362
I20260709 12:10:47.145977  4948 raft_consensus.cc:606] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Received request to transfer leadership
W20260709 12:10:47.174613  4822 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:10:47.175002  4822 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 7d89e729329948059879ed6f44a07690 already in progress
W20260709 12:10:47.175274  4822 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 7d89e729329948059879ed6f44a07690 already in progress
I20260709 12:10:47.193724  4948 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:47.202437  8266 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:47.243574  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 3994e4d9351c414cb95b2a6e7bd76142 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:10:47.244143  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 3994e4d9351c414cb95b2a6e7bd76142 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-3994e4d9351c414cb95b2a6e7bd76142
I20260709 12:10:47.258275  4885 tablet_copy_source_session.cc:215] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:47.264585  8313 tablet_copy_client.cc:323] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:10:47.270746  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet ee4c2e710f7a41958315091dfd907d8d from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:10:47.271286  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet ee4c2e710f7a41958315091dfd907d8d from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-ee4c2e710f7a41958315091dfd907d8d
I20260709 12:10:47.279633  5034 tablet_copy_source_session.cc:215] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:47.283218  8313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee4c2e710f7a41958315091dfd907d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:47.309409  8323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3994e4d9351c414cb95b2a6e7bd76142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:47.346608  8313 tablet_copy_client.cc:806] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:47.349273  8313 tablet_copy_client.cc:670] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:47.365710  8313 tablet_copy_client.cc:538] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:47.393407  8323 tablet_copy_client.cc:806] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:47.393991  8323 tablet_copy_client.cc:670] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:47.404451  8313 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:47.409968  5020 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:47.413300  8320 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:47.414417  4871 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:47.424499  5598 raft_consensus.cc:1217] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
W20260709 12:10:47.478914  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 62940.7us
W20260709 12:10:47.558277  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 73513.8us
W20260709 12:10:47.624089  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 73829.1us
I20260709 12:10:47.642436  8320 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:47.685005  8323 tablet_copy_client.cc:538] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:47.702242  5023 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:47.723187  4872 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:47.738200  8150 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:47.745052  4916 consensus_peers.cc:597] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d89e729329948059879ed6f44a07690. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:47.751566  8313 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:47.752686  8313 tablet_bootstrap.cc:492] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:47.777998  8343 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:47.778647  8313 ts_tablet_manager.cc:1403] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.374s	user 0.042s	sys 0.005s
I20260709 12:10:47.785569  8323 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:47.798754  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:47.808276  8313 raft_consensus.cc:359] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:47.816623  8313 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:47.820432  8313 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:47.834360  8313 ts_tablet_manager.cc:1434] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:10:47.850746  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-ee4c2e710f7a41958315091dfd907d8d received from {username='slave'} at 127.0.0.1:54512
I20260709 12:10:47.851364  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-ee4c2e710f7a41958315091dfd907d8d on tablet ee4c2e710f7a41958315091dfd907d8d with peer ab9da67236874634be59ebfd05b18255
W20260709 12:10:47.870525  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 59937.3us
I20260709 12:10:47.887385  8320 raft_consensus.cc:993] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:47.887873  8320 raft_consensus.cc:1081] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:47.890342  8333 raft_consensus.cc:1064] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:47.890602  4872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:47.891242  4872 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:47.891561  4872 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.893376  8333 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:47.915620  4872 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:47.927001  5602 raft_consensus.cc:1217] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 12:10:47.933737  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:47.934407  4950 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:47.934763  4950 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:47.935678  4950 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:47.942471  4950 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:47.949816  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:47.943449  4872 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:47.966491  4950 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:47.997244  4839 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:47.997434  5597 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:47.998541  8301 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:47.999027  8301 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:47.999890  8301 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:48.004462  8337 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:10:48.026901  4872 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:48.031805  4950 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:48.036512  8333 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.040829  8151 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.050184  4771 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:48.090005  8333 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.107576  8323 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:48.119136  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:48.119771  4874 raft_consensus.cc:606] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:48.128737  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:48.129287  4948 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:48.107709  4872 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.133143  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:48.133646  4948 raft_consensus.cc:606] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:48.138365  5597 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.142261  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:48.143927  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:48.144858  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:48.117617  8323 tablet_bootstrap.cc:492] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:48.146586  8323 ts_tablet_manager.cc:1403] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.361s	user 0.034s	sys 0.032s
I20260709 12:10:48.150679  8323 raft_consensus.cc:359] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:48.155586  4773 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.151921  8323 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:48.173184  8323 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:48.181149  8323 ts_tablet_manager.cc:1434] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:10:48.182919  4949 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.187798  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-3994e4d9351c414cb95b2a6e7bd76142 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:10:48.188220  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-3994e4d9351c414cb95b2a6e7bd76142 on tablet 3994e4d9351c414cb95b2a6e7bd76142 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:48.275238  5019 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:48.284341  5597 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:48.286288  4949 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:48.286392  8151 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:10:48.294766  8337 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:48.306981  8336 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.312896  4949 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.316303  5597 raft_consensus.cc:2955] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.345500  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97f05b369a3a4067afed9c87ba39f448 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:48.358139  4769 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 7 to 8, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.374266  8150 raft_consensus.cc:993] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:48.374701  8150 raft_consensus.cc:1081] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:48.376470  4874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:48.376998  4874 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:48.377322  4874 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.385793  4874 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.388128  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:48.388736  4949 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:48.389027  4949 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:48.389233  8337 raft_consensus.cc:1064] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:48.389760  4949 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.390787  4949 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.391810  8337 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:48.388082  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 97f05b369a3a4067afed9c87ba39f448 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:39302
I20260709 12:10:48.399930  4949 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:48.404572  4839 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:48.410988  8092 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:48.411418  8092 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:48.412118  8092 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.414191  4874 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:48.420410  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:48.420975  5019 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.422246  4950 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:48.425426  8283 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:10:48.428779  4841 consensus_peers.cc:597] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d89e729329948059879ed6f44a07690. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:48.446238  5019 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:48.450254  5602 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:48.451506  8358 tablet_replica.cc:333] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:10:48.452258  4944 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:48.452793  4874 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:48.454463  8339 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:48.457576  8151 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:48.459952  8339 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:48.461628  8358 raft_consensus.cc:2243] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:48.462334  8358 raft_consensus.cc:2272] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:48.474977  8347 raft_consensus.cc:993] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:48.475446  8347 raft_consensus.cc:1081] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:48.478716  4875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:48.479188  4875 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:48.479516  4875 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.492972  4875 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.495782  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:48.496330  4944 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.496616  4944 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:48.498536  4875 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:48.500111  4944 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.502080  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:48.502585  5019 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.504864  4769 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 9, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:48.506592  5023 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.510447  4944 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.519421  5597 raft_consensus.cc:1217] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:10:48.521838  8301 raft_consensus.cc:993] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:48.522253  8301 raft_consensus.cc:1081] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:48.527282  5024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:48.527750  5024 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:48.528065  5024 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.533188  4944 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:48.534552  4839 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:48.535293  8283 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:48.535679  5023 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:48.535894  8283 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:48.535989  5024 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.539611  5019 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:48.540023  8283 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.540921  5024 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:48.542526  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:48.543219  4950 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.544977  8092 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.542532  8339 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.546841  8358 ts_tablet_manager.cc:1916] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:48.548903  5602 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.562496  4944 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.564007  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:48.564585  4875 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:48.564889  4875 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:48.565601  4875 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.566571  4875 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:48.581277  4950 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:48.582036  4949 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:48.582353  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:48.583149  8151 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:48.583570  8151 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:48.584321  8151 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:48.587623  4874 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.587867  4769 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.610685  4875 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:48.631412  8358 ts_tablet_manager.cc:1929] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:10:48.643579  8358 log.cc:1199] T 97f05b369a3a4067afed9c87ba39f448 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/97f05b369a3a4067afed9c87ba39f448
I20260709 12:10:48.645447  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 97f05b369a3a4067afed9c87ba39f448 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:48.652868  4769 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 9 to 10, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.664631  4771 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 6, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:48.685726  5024 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:48.705510  5602 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:48.706902  8151 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:48.714924  8339 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.718138  5597 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.745134  4771 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 8 to 9, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.746833  4944 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:48.758528  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet ee4c2e710f7a41958315091dfd907d8d with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:39302
I20260709 12:10:48.759461  8358 tablet_replica.cc:333] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:10:48.760469  8358 raft_consensus.cc:2243] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:48.761579  8337 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:48.764914  8358 raft_consensus.cc:2272] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:48.768410  4944 raft_consensus.cc:2955] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:48.776759  8358 ts_tablet_manager.cc:1916] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:48.801635  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee4c2e710f7a41958315091dfd907d8d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:48.825603  4944 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:48.826944  8266 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.837706  8358 ts_tablet_manager.cc:1929] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.8
I20260709 12:10:48.838214  8358 log.cc:1199] T ee4c2e710f7a41958315091dfd907d8d P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/ee4c2e710f7a41958315091dfd907d8d
I20260709 12:10:48.839819  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet ee4c2e710f7a41958315091dfd907d8d (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:48.873649  5024 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:48.876081  8283 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.929358  8370 ts_tablet_manager.cc:933] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:10:48.947238  8370 tablet_copy_client.cc:323] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:10:48.948873  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 7d89e729329948059879ed6f44a07690 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:10:48.949397  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 7d89e729329948059879ed6f44a07690 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-7d89e729329948059879ed6f44a07690
I20260709 12:10:48.963837  4885 tablet_copy_source_session.cc:215] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:48.969319  8370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d89e729329948059879ed6f44a07690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:48.996096  8283 raft_consensus.cc:1064] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:48.998777  8283 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:49.013437  5024 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:49.015184  8300 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:49.026244  4875 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:49.026592  8370 tablet_copy_client.cc:806] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:49.027105  8370 tablet_copy_client.cc:670] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:49.030229  8339 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:49.046443  8370 tablet_copy_client.cc:538] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:49.056360  8370 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:49.127921  4950 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:49.129998  5602 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:10:49.133759  8266 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:49.136678  5023 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:10:49.141044  4950 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:10:49.142867  8283 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:10:49.163460  8266 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:49.145685  8339 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:10:49.206127  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 63173.5us
W20260709 12:10:49.206624  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 52619.2us
I20260709 12:10:49.225957  4949 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:10:49.268712  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 86377.1us
I20260709 12:10:49.274648  8092 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:49.355218  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:49.394240  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 137239us
W20260709 12:10:49.402608  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 104781us
W20260709 12:10:49.410708  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 141439us
I20260709 12:10:49.442462  8370 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:49.443383  8370 tablet_bootstrap.cc:492] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:49.444025  8370 ts_tablet_manager.cc:1403] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.388s	user 0.034s	sys 0.024s
W20260709 12:10:49.527144  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 101005us
I20260709 12:10:49.517045  8092 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:49.521832  5023 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:49.557690  8370 raft_consensus.cc:359] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:49.558616  8370 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:49.559271  8370 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:49.582140  8370 ts_tablet_manager.cc:1434] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.115s	user 0.005s	sys 0.001s
W20260709 12:10:49.621006  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 48502.1us
I20260709 12:10:49.622251  5602 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:49.672350  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:49.672984  4875 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:49.700457  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 65217.9us
W20260709 12:10:49.707108  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 92599.2us
I20260709 12:10:49.722631  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:49.723196  4875 raft_consensus.cc:606] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:49.748379  4950 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:49.781710  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-7d89e729329948059879ed6f44a07690 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:10:49.782166  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-7d89e729329948059879ed6f44a07690 on tablet 7d89e729329948059879ed6f44a07690 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:49.814711  4770 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:49.831868  5020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4428def03fb45c99d3538acc2628494"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:10:49.832477  5020 raft_consensus.cc:606] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:49.838445  4872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:49.839071  4872 raft_consensus.cc:606] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:49.840183  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:49.850699  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:49.851435  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:49.867939  5602 raft_consensus.cc:1217] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Deduplicated request from leader. Original: 9.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 12:10:49.919500  8404 raft_consensus.cc:993] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:49.920858  8300 raft_consensus.cc:1081] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:49.924036  4949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:49.924571  4949 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:49.924957  4949 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.934626  4949 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:49.939853  4949 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:49.940991  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:49.941679  5602 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.947831  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:49.948419  4874 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:49.948751  4874 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:49.949651  4874 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:49.950775  4874 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.955116  8151 raft_consensus.cc:993] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:49.955530  8151 raft_consensus.cc:1081] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:49.961409  4872 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4428def03fb45c99d3538acc2628494"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:10:49.961490  4874 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:49.961932  4872 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:49.962293  4872 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.962746  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:49.963541  8347 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:49.964051  8347 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:49.963483  5602 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:49.967415  8347 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:49.968247  4872 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:49.971066  4872 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:49.971850  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:49.972307  5024 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:49.972507  5024 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:49.974123  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:49.974664  4949 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.974713  4874 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:49.978334  5024 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:49.979475  5024 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.986893  5024 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:49.989270  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:49.990173  8404 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:49.990631  8404 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:49.991412  8404 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:49.999743  8400 raft_consensus.cc:993] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:50.000176  8389 raft_consensus.cc:1081] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:50.006685  5602 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:10:50.006817  4944 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:10:50.008002  8389 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:10:50.008777  8400 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:10:50.009187  4950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:50.012460  4950 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:50.025467  4950 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.025775  8400 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:50.032001  5597 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:50.040176  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3994e4d9351c414cb95b2a6e7bd76142 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:50.041412  4944 raft_consensus.cc:2955] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:50.047343  4770 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.052706  4774 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 9, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.051477  4773 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 10 to 11, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:50.026995  4949 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:50.067023  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 3994e4d9351c414cb95b2a6e7bd76142 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55706
I20260709 12:10:50.066134  4950 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:50.073469  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:50.073995  5020 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.074580  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:50.075096  4874 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:50.075344  4874 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:50.076045  4874 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:50.077220  4874 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.083760  4874 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:50.085273  4917 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:50.086094  8347 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:50.086560  8347 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:50.086624  5020 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:50.087396  8347 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:50.096365  4950 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:50.119889  8400 raft_consensus.cc:993] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:50.120330  8300 raft_consensus.cc:1081] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:10:50.121958  4950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:10:50.122462  4950 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:50.122778  4950 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.124737  8424 tablet_replica.cc:333] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:10:50.130124  4950 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:50.132561  4950 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:50.133652  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:50.133788  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:50.134220  5020 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.134302  4874 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.134795  4874 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:50.135460  4874 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:50.134320  4773 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 10, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.136409  4874 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.140434  5020 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:50.141896  4915 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:50.142725  8347 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.143189  8347 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:50.143958  8347 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:50.147086  4874 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:50.148723  8424 raft_consensus.cc:2243] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:50.149577  8424 raft_consensus.cc:2272] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:50.167999  8424 ts_tablet_manager.cc:1916] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:50.168479  4773 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 9, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 9 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.185922  8424 ts_tablet_manager.cc:1929] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:10:50.192263  8424 log.cc:1199] T 3994e4d9351c414cb95b2a6e7bd76142 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/3994e4d9351c414cb95b2a6e7bd76142
I20260709 12:10:50.195341  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 3994e4d9351c414cb95b2a6e7bd76142 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:10:50.336414  8404 raft_consensus.cc:1064] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:10:50.367702  5597 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:50.371503  8347 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:10:50.404197  8404 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:50.416625  4950 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:50.418972  8300 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:51.138342  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:51.370402  4841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.001s	sys 0.009s
W20260709 12:10:51.370904  4841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.001s	sys 0.009s
W20260709 12:10:51.377035  4839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.015s	sys 0.021s
W20260709 12:10:51.377480  4839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.015s	sys 0.021s
I20260709 12:10:51.518301  8436 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:10:51.536991  4842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.000s	sys 0.010s
W20260709 12:10:51.650336  4842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.000s	sys 0.011s
I20260709 12:10:51.565238  8430 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:10:51.566493  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08002920e0 after lost signal to thread 3728
I20260709 12:10:51.652962  8430 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.655567  8430 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:51.633834  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 98670us
I20260709 12:10:51.569233  8432 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.660279  8432 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.661633  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 588) took 1265 ms. Trace:
I20260709 12:10:51.662528  8432 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.650262  8436 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.668056  8436 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.677634  8440 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:51.683723  8435 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:51.690980  8432 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:51.701956  8438 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:51.709277  8434 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:51.713938  8400 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.811596  8439 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:51.662134  4874 rpcz_store.cc:276] 0709 12:10:50.396107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.660870 (+1264763us) service_pool.cc:224] Handling call
0709 12:10:51.661176 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.661336 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.661361 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:51.661406 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:51.661436 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.661483 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.661578 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:51.814568  8436 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:51.825244  3730 debug-util.cc:398] Leaking SignalData structure 0x7b080000f420 after lost signal to thread 5597
W20260709 12:10:51.828212  3730 kernel_stack_watchdog.cc:198] Thread 5597 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 396ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:10:51.823946  8439 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.823817  8432 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.818645  8438 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.831627  8432 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.816340  8440 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.818408  8435 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.820595  8434 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.825266  8400 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.846378  8400 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.846856  8400 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:51.824234  8436 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.849254  8436 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:51.849728  8436 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.850185  8436 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.852084  8436 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.852514  8436 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:51.853381  8400 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.940245  8432 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.952093  8432 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.952762  8439 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.954388  8432 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.955928  8440 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:51.957409  8435 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:51.958789  8434 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:51.960163  8445 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.960698  8445 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.962750  8445 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.963932  8438 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.965637  8400 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.929450  8436 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.968030  8436 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.968550  8443 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:51.969084  8443 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.971127  8443 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:51.972580  8347 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.973135  8347 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.976074  8347 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.976933  8444 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.977492  8444 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.979506  8436 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:51.980203  8436 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.982280  8436 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:51.983791  8436 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.984298  8436 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.986290  8436 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.989459  8283 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:51.989806  8400 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:51.989948  8283 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:51.990346  8400 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:51.991869  8283 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:51.992111  8400 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:51.992328  8283 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:51.992780  8283 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.993253  8446 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:51.993767  8446 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.995498  8283 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:51.995914  8446 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:51.997967  8438 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:51.998560  8438 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.000990  8438 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.002514  8427 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.002995  8427 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.003587  8438 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.004086  8438 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.005544  8427 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.005908  8438 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.006601  8438 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.009895  8438 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:52.011021  5597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.625s	user 0.013s	sys 0.033s
W20260709 12:10:52.011382  5597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.625s	user 0.013s	sys 0.033s
I20260709 12:10:52.011579  8401 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.012122  8401 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.014232  8401 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.014732  8401 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.015154  8401 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:51.979570  8444 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.024405  8401 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.026006  8445 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.026571  8445 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:52.028532  8445 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.029541  8401 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.030292  8444 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.030061  8401 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.030826  8444 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.031991  8438 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.035046  8401 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.035207  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57006 (request call id 602) took 1661 ms. Trace:
I20260709 12:10:52.035847  8429 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:52.036381  8429 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.045516  8401 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.048974  8438 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.051373  8401 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.051551  8438 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:52.053385  8401 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.053815  8429 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.035607  5597 rpcz_store.cc:276] 0709 12:10:50.373492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.385508 (+ 12016us) service_pool.cc:224] Handling call
0709 12:10:50.385798 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.011690 (+1625892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.011720 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.012152 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.033465 (+ 21313us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:52.033499 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.033563 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.034993 (+  1430us) raft_consensus.cc:1685] finished
0709 12:10:52.035010 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.035129 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":419,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":1646423,"threads_started":2,"wal-append.queue_time_us":21152}
I20260709 12:10:52.056233  8452 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.056713  8451 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.059249  8427 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.032740  8444 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.029971  8448 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.068674  8451 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.059505  8453 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.080583  8454 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.078855  8429 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.069993  8427 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.081514  8438 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.092315  8389 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.089243  8454 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.094363  8454 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.094940  8454 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.095455  8454 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.089596  8429 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.097820  8454 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.098418  8454 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.098902  8454 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.099550  8429 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.100852  8454 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.076689  8451 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.102991  8444 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.110102  8455 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:52.109974  8444 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.092854  8389 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.110682  8455 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.112509  8389 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.068814  8452 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.114125  8451 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.114614  8451 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.115127  8452 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.115641  8452 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:52.116106  8452 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.116415  8451 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.084769  8453 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.118794  8451 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.119297  8451 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.120368  8453 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.120890  8445 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.121192  8451 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.121292  8461 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.121521  8443 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.121649  8453 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.109928  8427 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.121973  8451 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.122139  8453 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.122153  8461 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.116820  8401 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.122048  8443 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.123538  8401 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.124529  8444 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.122491  8451 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.124732  8443 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.106559  8454 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.069797  8448 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.122391  8450 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.129014  8450 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.129418  8451 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.129638  8461 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.129015  8401 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.130549  8459 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.131088  8459 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.121345  8445 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.118433  8455 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.143778  8468 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.144450  8466 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.144380  8468 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.144982  8466 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.146745  8468 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.146860  8466 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.141191  8430 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.157986  8453 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.158195  8450 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.149354  8430 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.167481  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.168129  4948 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:52.169028  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.170135  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.170478  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.171123  4946 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:52.171314  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.171566  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.171823  8459 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.172686  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.173997  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 2121) took 1752 ms. Trace:
I20260709 12:10:52.174340  4944 rpcz_store.cc:276] 0709 12:10:50.421427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.425564 (+  4137us) service_pool.cc:224] Handling call
0709 12:10:50.425880 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.426233 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.426271 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.079121 (+1652850us) log.cc:844] Serialized 26 byte log entry
0709 12:10:52.117141 (+ 38020us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:52.117187 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.117261 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.173794 (+ 56533us) raft_consensus.cc:1685] finished
0709 12:10:52.173809 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.173922 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":641,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":35057,"threads_started":1,"wal-append.queue_time_us":67855}
I20260709 12:10:52.175153  8445 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.163017  8427 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.175908  8427 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.136225  8454 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.177109  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.215864  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.204941  4870 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:52.179409  4872 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:52.237519  5597 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:52.241604  4875 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:52.243160  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.240933  4945 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:52.210224  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.205490  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.209271  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.209762  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.249828  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.249758  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.251026  4948 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:52.245908  4872 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:52.248545  4943 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:52.167582  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.207139  8427 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.212353  8464 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.180967  8443 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.203212  8450 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.205651  8452 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.213814  8448 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.205865  8462 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.212083  8456 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.210721  8460 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.210294  8461 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.208508  8430 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.211822  8459 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.363490  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.367024  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.367655  5602 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:52.365578  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.369436  5597 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:52.348755  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.207175  8389 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.362128  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.361709  8456 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.258548  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.384756  4945 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:52.364857  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.373438  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:52.385602  4942 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:52.385695  4948 raft_consensus.cc:606] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:52.373553  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.212461  8444 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.210889  8453 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.406049  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.409063  4875 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:52.375887  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.376597  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.411587  4874 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:52.372035  8459 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.377353  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.377599  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.377206  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.373272  8461 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.378010  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:52.373958  8389 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.416208  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.418571  8459 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.418855  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.418998  8389 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.419656  8449 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.419891  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.420416  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.419814  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.413682  8453 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.421906  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.422848  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.423774  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.424310  4945 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:52.413471  5599 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:52.426070  8454 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.428253  8455 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.383128  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.430496  8448 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.430986  8449 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:52.431149  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.431416  8449 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.432257  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "951f0af961a844849af172b241003482"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:52.432801  4869 raft_consensus.cc:606] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:52.433264  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:52.434126  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:52.434592  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.267933  8467 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:52.435708  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.416265  8469 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.435985  8467 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.436782  8469 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:52.437945  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080017eba0 after lost signal to thread 4808
I20260709 12:10:52.438822  8469 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:52.439148  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800106ce0 after lost signal to thread 4900
W20260709 12:10:52.439455  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800106de0 after lost signal to thread 4901
I20260709 12:10:52.414930  5606 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:10:52.417023  8470 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:52.410398  8443 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.374197  8464 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.415812  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.439779  4944 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:52.435895  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.452373  4875 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:52.415548  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.443535  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:52.449950  5020 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:52.454923  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:52.457037  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.457971  4870 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:52.406373  8466 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:52.458936  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.457947  4916 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:52.448894  8400 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.381788  8450 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.462333  5605 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:10:52.461037  4916 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:52.463073  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.466632  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:52.465560  4916 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:52.467155  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.362172  8462 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.428718  8455 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.461683  8458 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.461153  8467 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.448923  8449 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.461545  8441 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.460726  8452 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:52.469290  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.430998  8448 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.477213  4947 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:52.477804  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.478449  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.478610  4839 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:52.454854  8444 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.485085  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:52.463846  8436 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.470952  8430 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.469671  8451 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.489909  8451 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.375057  8460 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.490640  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.490882  8471 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.491379  8471 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.492658  8453 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.479275  8458 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.495515  8458 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.496994  4948 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:52.497633  8436 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.498430  8460 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.498795  8464 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.473495  8434 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.482446  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.470937  8446 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.470809  8347 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.459232  8470 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.483112  5020 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:52.486359  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:52.463728  8400 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.473551  8283 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.470605  8469 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.490356  8455 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.482321  5602 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:52.479844  8432 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:52.502206  4872 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:52.482890  8461 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.466434  8466 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.651137  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:52.635408  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.502779  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.615008  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.613270  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.667495  5023 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 3.
I20260709 12:10:52.613200  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.665669  4873 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:52.666612  4950 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:52.646080  4773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 308) took 2266 ms. Trace:
I20260709 12:10:52.645147  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.496919  8393 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.649121  5567 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:52.669997  5601 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:52.484112  8452 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.669122  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:52.670688  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 184362us
I20260709 12:10:52.673069  5024 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:52.616590  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.610836  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.616132  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.635041  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.620720  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.672256  4773 rpcz_store.cc:276] 0709 12:10:50.379132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.379279 (+   147us) service_pool.cc:224] Handling call
0709 12:10:52.645988 (+2266709us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:10:52.485198  8467 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.497519  8456 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.614527  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.678506  5025 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:52.670487  5022 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:52.490321  8451 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.695731  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.696329  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.696487  5567 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:52.490407  8462 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:52.624396  8404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.194s	user 0.019s	sys 0.033s
I20260709 12:10:52.693138  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.691942  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.691385  8464 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.641844  8444 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.668673  8446 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.611781  8475 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.506755  8448 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.507655  8434 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.488286  8441 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:52.925839  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.706351  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.770673  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:52.742204  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 59287us
I20260709 12:10:52.695436  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.937446  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.926115  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.937119  4916 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:52.938910  5024 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
W20260709 12:10:52.938398  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800105660 after lost signal to thread 4975
W20260709 12:10:52.943679  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080038a6e0 after lost signal to thread 5049
I20260709 12:10:52.505290  8431 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.901351  8455 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.945294  4874 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:52.673749  8283 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.503258  8472 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.945820  8431 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.945856  8283 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.691959  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.946331  8431 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.946844  8464 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.947278  8464 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.947484  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.948668  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.946374  8455 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:52.944770  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9fe0 after lost signal to thread 5630
I20260709 12:10:52.840240  8477 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:52.674373  8393 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.949878  8393 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.505513  8430 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.951232  8455 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:52.951905  8430 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.674024  8400 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.965893  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.674456  8469 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.691781  8452 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.696884  5025 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
W20260709 12:10:52.949545  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003b39e0 after lost signal to thread 8151
W20260709 12:10:52.967551  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003d93c0 after lost signal to thread 8333
I20260709 12:10:52.941762  5022 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:52.614456  8449 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.669873  8347 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:52.945829  5023 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:52.670009  8432 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:10:52.965114  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 268692us
I20260709 12:10:52.970139  5022 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:52.968076  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6a60 after lost signal to thread 8415
I20260709 12:10:52.667488  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:52.792554  8450 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:52.885116  8436 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.988636  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.964704  8468 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.695633  8439 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:52.919268  8473 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:52.960851  8445 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.920555  8470 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:52.925037  8479 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.012099  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:52.965166  8471 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:52.964843  8404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.534s	user 0.026s	sys 0.041s
I20260709 12:10:52.786065  8467 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:52.961396  8475 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.041424  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.025302  5016 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:52.977344  8432 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.020601  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:52.969872  8462 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.044598  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.032573  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:53.030673  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 76067us
I20260709 12:10:52.976697  8347 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:53.011253  8429 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.037s	sys 0.028s
W20260709 12:10:53.053026  8429 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.037s	sys 0.028s
I20260709 12:10:53.015805  8448 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:53.054090  8448 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.056005  8448 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.038268  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.039635  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.059090  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.009382  8455 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.043274  5025 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:53.047070  8462 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.047559  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.048270  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.066391  5598 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:53.067214  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.061600  5017 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:52.949826  8477 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.069577  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.070264  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.070639  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.066329  5018 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:10:53.071650  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.073195  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.073969  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.074128  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.074944  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.048158  8441 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.076761  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.077226  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.077659  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.078481  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.078646  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.079525  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.079680  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.075706  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:53.025293  8473 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.009133  8283 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.051676  8393 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.030335  8391 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.052565  8469 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:53.046522  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:53.047211  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:52.946146  8472 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.017565  8445 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.061864  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.031741  8416 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.065577  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.034318  8479 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.081921  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.035588  8439 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.026031  8468 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.082513  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.259032  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.105715  8401 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.155s
I20260709 12:10:53.260833  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.234465  8451 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.262074  4946 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.263044  8468 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:53.092068  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.080771  8462 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.123160  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.090808  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.266151  4875 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:53.123561  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.266971  5567 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:53.085951  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.070200  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.268461  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.079708  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.130048  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.087096  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.071633  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:53.271136  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 224671us
I20260709 12:10:53.269035  4943 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:53.101733  4841 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:53.274852  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.271095  4950 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:10:53.275846  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.277899  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:53.267994  5567 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:10:53.278716  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 62220.9us
I20260709 12:10:53.280893  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.281548  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.282192  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.283377  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.285360  5020 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:53.288185  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.288729  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.289553  5567 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:53.292007  4949 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.292763  4873 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:53.293156  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.293429  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.294574  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.296967  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.288827  4943 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:53.270603  8466 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.318254  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.319344  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.319744  8430 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.320115  8430 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.320284  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.088080  8475 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:53.273010  8453 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.274209  8445 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.092070  8450 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.303368  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.304138  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.306027  8443 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.103929  8455 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.306209  8472 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:53.241449  8452 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.307353  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.277091  8389 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.097591  8432 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:53.309638  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.274648  8479 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.310149  8460 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.277431  8416 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.106353  8438 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.193s
I20260709 12:10:53.281172  8391 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:53.311394  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 209722us
I20260709 12:10:53.312062  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.313784  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.313948  8283 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.359186  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.314932  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.114979  8431 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.111526  8464 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.315749  8434 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.105989  8437 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.210s
I20260709 12:10:53.316620  4990 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.317344  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.299643  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.321470  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.351763  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:53.351213  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47917.1us
I20260709 12:10:53.244109  8400 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.367009  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.368013  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.350237  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.353093  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.292876  8454 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.353626  5018 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:53.351646  8389 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.324079  8453 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.324045  5568 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:53.300792  8401 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.323892  8430 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.381781  8400 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.384028  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.387873  5020 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:53.360960  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.389559  8453 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.391755  5016 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:10:53.392971  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 68997.9us
I20260709 12:10:53.365578  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.366009  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.394064  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.364645  5025 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:53.356765  8460 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.355131  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.395150  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.369364  4875 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
W20260709 12:10:53.374140  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 57705.7us
I20260709 12:10:53.370224  4917 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:10:53.374444  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 89272.9us
I20260709 12:10:53.353590  8450 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.377099  8485 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.379323  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.402107  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:53.380851  4870 raft_consensus.cc:2393] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:53.388800  8462 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.373131  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.357677  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.395691  5605 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.400043  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.407887  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.405372  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.410197  4841 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.407629  8440 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:10:53.411892  8393 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.388897  8401 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.412680  8401 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.413290  8485 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.413968  8452 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.411983  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.414951  4875 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:53.415272  8485 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.400949  4876 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.404173  8450 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.417608  8461 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:53.418135  8464 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.419840  8416 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.395761  8389 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.395514  8469 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:53.421134  8451 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.373211  8454 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.421976  8454 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.423635  8431 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.424252  8467 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:53.410895  8488 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.412432  8484 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:53.405293  8400 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.395375  8347 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.425908  4946 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.426673  8462 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.427135  8473 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:53.427275  5597 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.412510  8439 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.402787  8460 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.402163  8456 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:53.429445  8456 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.429808  8456 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:53.431622  8391 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.433475  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:53.401403  8432 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:53.434717  8347 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.433782  8446 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.424997  8488 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.362736  8387 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.437244  8488 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.437505  8387 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.437884  8387 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.438947  8446 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.439586  4841 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.440268  8446 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.441632  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.444336  4867 raft_consensus.cc:1240] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:53.445271  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.445868  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.427485  8455 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.451140  8477 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.453990  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.455243  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:53.456230  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51374.6us
I20260709 12:10:53.455669  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.457437  8455 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:53.458000  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.458384  8473 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.458637  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.458808  8473 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:53.459443  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.459637  8473 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.460772  8473 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.460955  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.462061  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.462632  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.463131  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:53.465006  8401 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.465427  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.466118  4950 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:53.466877  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.468159  4988 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.468786  8439 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.470165  8468 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:53.471057  8468 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.471340  4839 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:53.471603  8468 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.471987  8468 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:53.472229  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.472910  4945 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:53.474610  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.476629  8472 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:10:53.477062  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 43657.7us
I20260709 12:10:53.474948  5567 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:53.477211  8443 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.477628  8443 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.477962  8443 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.478065  4917 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:53.475607  8489 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.479022  8347 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.492988  8347 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.493381  8347 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.495270  8430 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.497011  8430 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.498622  8443 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:53.499752  8347 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.481496  8446 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.496917  8453 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.500880  8446 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.501305  8446 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.502868  8453 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.478958  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.504958  8443 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.466887  8401 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:53.485574  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 91568.2us
I20260709 12:10:53.507690  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.482139  8489 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.488853  8462 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:53.519827  8462 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.520236  8462 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:53.523238  4916 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.524026  8437 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:53.524447  8437 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.489084  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.489418  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.524798  8437 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:53.525799  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.489614  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.489959  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:53.472661  8468 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.527770  4916 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:53.528218  8468 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.528462  8438 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.528934  8438 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.529328  8438 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.479995  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.509057  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.511200  5568 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.516217  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.538072  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.539824  5598 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:53.509212  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:10:53.541111  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 61253.8us
I20260709 12:10:53.541544  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.541988  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.543808  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.545449  4870 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.507417  8389 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.546306  4915 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.548334  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.549006  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.546449  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.546038  8450 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.559240  8387 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.559540  8445 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.560467  4944 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.504999  8456 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.561625  8300 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.562424  8456 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.562984  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.564028  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.564481  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.549985  4943 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:53.564306  4946 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.550216  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.566844  5601 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:53.567627  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.568295  4868 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:53.513043  8451 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.550194  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.564570  4874 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:10:53.571185  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.571380  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.572058  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.573115  4872 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:53.552315  8440 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:53.547703  8488 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.574556  8440 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.574970  8440 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:53.539654  8464 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:53.577054  4951 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.540468  8489 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.547374  8391 consensus_queue.cc:1059] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:10:53.577104  8401 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.549592  8444 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.578259  8401 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.507577  8479 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.578333  8444 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.578694  8401 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.579264  8444 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.572182  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.580542  8479 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.581959  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.582290  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.540167  8461 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.582544  4875 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:53.582875  4867 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:53.583508  8478 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:53.583675  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.585207  8448 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.588874  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.589447  4874 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:53.569917  4915 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.590726  8454 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.591780  5602 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.572422  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.592514  4873 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:53.574024  8389 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.584619  4876 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:53.593910  4874 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.582109  8460 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.595362  8462 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.597088  8393 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.597491  8393 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.597819  8393 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.602825  8446 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.603852  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.604492  4870 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.605069  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.605388  8440 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.606119  8446 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.589262  8391 raft_consensus.cc:3055] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.606736  8391 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:53.607141  8387 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.607779  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.607530  8391 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.608834  8391 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.609401  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.609684  8462 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:53.610611  4873 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.610764  8444 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.596663  8460 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.613545  8444 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.591887  4915 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.614334  8445 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.614887  8445 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.592615  8454 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.615047  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.615329  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.610944  8401 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.618000  8401 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.607370  8440 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.616801  4915 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.621922  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.622148  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.623167  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.624095  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.624891  8445 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.625142  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.605334  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:53.626441  8489 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.627310  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.628312  8489 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.625310  8445 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.629918  8451 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.628225  8438 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.635165  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.633128  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.636021  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.635712  5022 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:53.635069  8387 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.637066  8487 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.639165  8387 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.640120  8443 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:53.621905  8437 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.641713  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.637724  8489 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.642601  4943 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.642294  5016 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
W20260709 12:10:53.644027  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 109043us
I20260709 12:10:53.643428  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.639482  4948 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.648558  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.644655  4915 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.650063  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.650916  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.653898  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.642333  8387 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.658373  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.659220  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.660247  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.660410  8450 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.661288  8438 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.662264  8448 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:53.662530  8472 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.663618  8448 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:53.664554  8448 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:53.664891  8448 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:53.665136  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.662135  8477 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.665656  8448 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.666419  8432 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:53.666755  8448 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.666975  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.667122  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.667284  8479 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:53.667649  8479 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:53.668164  8347 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.639691  8487 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.668381  8479 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.669000  8487 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.663196  8472 consensus_queue.cc:1059] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:10:53.669039  4942 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.670738  8393 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.641366  8451 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.685076  8451 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.685424  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:53.540405  8455 consensus_queue.cc:1175] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab9da67236874634be59ebfd05b18255" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:53.686493  8393 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.673354  8479 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.674793  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.676321  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.676268  4991 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.677081  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:53.677481  8488 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.677704  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.690052  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.669098  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.690847  8473 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.653286  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.691418  8473 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:53.680645  4990 consensus_peers.cc:597] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3da8832a07224abb9a1f8815f3dcd745. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:53.669480  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.692613  5021 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:53.693215  8473 consensus_queue.cc:1059] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:53.685451  8451 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.695360  8437 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.695935  5568 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:53.696110  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.696730  8456 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:53.697214  8456 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:53.697412  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.698693  4948 raft_consensus.cc:2393] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:53.688851  8444 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.679574  8472 raft_consensus.cc:3055] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.698261  8456 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.699404  8472 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:53.700238  8472 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.701508  8472 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.705036  8452 raft_consensus.cc:993] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:53.705446  8452 raft_consensus.cc:1081] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:53.706816  8437 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.708057  8437 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.709198  8387 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.709228  8437 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.713400  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:53.714151  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 63312.4us
I20260709 12:10:53.714067  4948 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.730824  4950 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.731807  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.714648  8444 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.733156  8444 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.733959  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.733821  8493 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:53.735051  5570 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.736677  8460 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.737038  8493 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.741456  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.741578  8444 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.742156  8491 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.742285  4915 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:53.743100  8440 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.743481  8440 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.736990  8454 raft_consensus.cc:3055] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:53.723172  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.725190  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.726038  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.744029  8454 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:53.726313  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.745051  8391 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.745496  8391 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.733619  8455 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:10:53.732769  8487 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.727233  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.730763  8468 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.749063  8468 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.746387  4947 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:53.749841  8468 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.745078  8454 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.644369  8489 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:53.751608  8489 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.743955  8387 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.743901  8440 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.745831  8391 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.714421  5016 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:53.683336  5024 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:53.757536  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.726769  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.761649  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.762182  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.762756  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.763401  4869 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:53.760275  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.751811  8454 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.765343  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.765990  4871 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:53.766134  4867 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:53.765408  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.759490  5568 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:53.766009  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.765028  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:53.772056  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 228654us
I20260709 12:10:53.772372  5568 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:53.775072  4875 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:53.776659  5602 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:53.771685  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.780274  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.780409  5021 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:53.776654  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.780623  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.782513  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.781323  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:53.786029  5570 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.775455  8453 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:53.781225  8491 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:53.787516  8497 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.804668  4948 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.806035  4947 raft_consensus.cc:1240] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:53.806123  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.807518  4947 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:53.788267  8468 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.783937  8467 consensus_queue.cc:1059] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:10:53.775115  8473 consensus_queue.cc:1059] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:53.792057  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.792699  4870 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:10:53.743414  8444 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.794425  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.794256  4991 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.817096  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.795774  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.794489  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.797107  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.817935  5016 raft_consensus.cc:2393] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:53.808265  4942 raft_consensus.cc:2393] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:53.779438  8462 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:53.809055  4944 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:10:53.820417  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.810974  4950 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:53.791512  8460 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.814783  5021 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:53.815558  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.823820  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.775581  8448 consensus_queue.cc:1059] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:10:53.824985  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.815735  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.815982  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.815083  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.825773  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.784754  8487 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.819096  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:53.814494  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.822355  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.822777  4841 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.795439  8464 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:53.830292  4944 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:53.824054  4943 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:53.783985  8493 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:10:53.799517  8477 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:53.827469  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.829613  4950 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:53.815196  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 112260us
I20260709 12:10:53.831655  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:53.811969  8430 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:10:53.834789  8478 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:53.833669  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.815591  8491 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:53.843693  5602 raft_consensus.cc:1240] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:53.836617  8448 raft_consensus.cc:3055] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:53.840483  8440 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.847638  5019 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:53.856963  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.857255  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.851035  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.831001  8462 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:53.830875  8453 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.874501  5567 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.846072  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.889912  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.891451  5017 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.858253  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:53.843030  8446 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.930383  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.893723  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.928540  5018 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
W20260709 12:10:53.933013  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 50002us
I20260709 12:10:53.843640  8485 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.843724  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.932401  8446 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:53.935009  8446 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:53.937583  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 63160.4us
W20260709 12:10:53.937924  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 94270.9us
I20260709 12:10:53.938553  4917 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:10:53.940239  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 145810us
I20260709 12:10:53.853523  8430 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:10:53.942242  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.847792  8484 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.890007  8477 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:10:53.845412  8448 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:53.956121  8448 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.957391  8448 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.961261  8462 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.936259  8389 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:10:53.896901  8434 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:10:53.852800  8468 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.930635  8478 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.965523  8484 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:53.951489  8443 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.965941  8484 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:53.885775  8451 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.966746  8484 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.970060  8484 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.970773  8451 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:53.884425  8498 consensus_queue.cc:1059] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:10:53.845290  8491 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.943800  8430 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:53.975996  8502 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.139s	user 0.003s	sys 0.000s
I20260709 12:10:53.939733  8347 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.978689  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:53.950942  8300 raft_consensus.cc:993] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:53.844398  8283 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:10:53.889954  8473 consensus_queue.cc:1059] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:10:53.885530  8400 consensus_queue.cc:1059] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:10:53.954079  8439 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 6 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:53.944795  8475 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.944615  8460 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.988287  5017 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:53.990573  8460 raft_consensus.cc:3055] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:53.946621  8387 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.849548  8437 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:53.985023  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 139020us
I20260709 12:10:53.995087  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:53.984730  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 91086.6us
I20260709 12:10:53.949877  8485 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:10:53.984915  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 99426.4us
I20260709 12:10:53.976181  8391 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:53.986464  8473 raft_consensus.cc:3055] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.990980  8460 raft_consensus.cc:740] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:54.013190  8473 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:54.013749  8460 consensus_queue.cc:260] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.014290  8391 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:54.014047  8473 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.987627  8440 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:53.988339  8498 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:54.015309  8460 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:53.947002  8477 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:54.015923  8477 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:10:54.015236  8416 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.016464  8416 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:54.017234  8416 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.018517  8416 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.022467  8504 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:54.022854  8504 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:54.023361  5602 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.015956  5021 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:10:54.026125  5025 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:53.993690  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 53620.1us
I20260709 12:10:54.028389  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.044006  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:54.059577  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 121050us
W20260709 12:10:54.059852  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 64852.3us
I20260709 12:10:54.060639  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:54.061712  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 118082us
I20260709 12:10:54.062477  5567 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:53.999689  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:53.991321  8432 raft_consensus.cc:1081] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:54.001035  8456 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:10:53.996311  8387 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:53.945118  8445 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:53.991065  8400 raft_consensus.cc:3055] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.976126  8430 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.006145  4950 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.006629  8472 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.010344  4770 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 8 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.011781  8471 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.989324  8489 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.065446  5602 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:10:54.069128  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 69747.4us
I20260709 12:10:54.069797  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.069180  8468 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.110997  4915 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.069362  8440 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.100612  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.061254  8391 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:54.070672  8387 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:54.106549  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 164731us
I20260709 12:10:54.112866  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.066829  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.113590  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.065670  8493 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:10:54.118549  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.073158  8400 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:10:54.128180  5570 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.732s (SENT)
I20260709 12:10:54.023605  8504 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.123292  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:54.126055  4840 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.126549  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.124497  8391 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.127050  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:54.107203  8404 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.127542  8461 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.128163  4946 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.105300  8437 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:54.104625  8472 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:54.087873  8510 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:54.137976  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 71216.1us
I20260709 12:10:54.111829  8471 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:54.157925  4915 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.137313  8461 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:54.123505  8441 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.134708  8467 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.163878  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.165498  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.119925  8401 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.167471  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.163141  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.168430  8521 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.113463  8434 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:54.133088  8432 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:54.173820  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 50894.6us
I20260709 12:10:54.175086  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:54.119640  8485 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:10:54.159792  8440 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.182338  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.184018  8469 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.184607  8507 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.181640  4840 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.189668  4950 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.197400  4943 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:54.198551  4991 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.170931  8437 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.180043  8300 raft_consensus.cc:3055] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.200067  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.175854  8467 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:54.185297  8510 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.127482  8447 consensus_queue.cc:1059] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:10:54.150318  8477 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.219451  8477 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.211318  8482 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.212103  8461 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.203867  8404 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:54.189517  8400 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.189105  8469 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:54.197770  8401 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.209141  8467 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.241925  8518 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.202634  8300 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.244197  8300 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.244887  8500 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:54.245330  8300 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.246557  8504 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.216131  8508 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.248986  8508 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:54.249379  8508 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.231513  8469 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.227160  8404 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.257683  8404 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.258759  8404 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.202898  8468 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:54.220929  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:54.227448  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45877.4us
I20260709 12:10:54.228875  8521 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.229545  8515 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.200974  8478 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.234310  8505 raft_consensus.cc:3055] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.276309  8505 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:54.277240  8505 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.278682  8505 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.237520  8473 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.216647  8516 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:54.261168  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 133005us
I20260709 12:10:54.251943  8489 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:54.210703  8510 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:54.262267  8524 ts_tablet_manager.cc:933] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:54.275997  5020 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
I20260709 12:10:54.295303  8493 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:54.296311  8493 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:10:54.296626  8493 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:54.297451  8493 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.298549  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.224599  8482 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:54.274590  8400 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.220073  8455 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:10:54.268415  8468 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:54.203845  8472 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:54.283887  8500 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:54.292119  8510 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.280756  8391 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:54.215807  8387 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.314939  8387 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:54.303637  8468 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.315411  4951 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:54.316162  8471 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.317387  8471 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:54.291457  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 126027us
I20260709 12:10:54.231732  8445 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.300465  8430 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:54.278532  8446 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.300642  8389 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:54.263157  8401 raft_consensus.cc:697] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:54.299346  8482 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.301652  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.301731  5021 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:54.302706  8455 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:54.306975  8500 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.326771  8441 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.330016  4915 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:54.343259  8441 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.353969  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:54.355724  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:54.298695  8493 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:10:54.328171  8389 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:54.343598  8455 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:54.347235  8484 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.359221  8445 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:54.374977  4951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:54.375586  4951 raft_consensus.cc:606] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:54.373867  8461 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.378367  8441 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.379525  8441 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:54.380730  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 79080.3us
I20260709 12:10:54.382059  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:54.382436  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.364923  8432 raft_consensus.cc:3055] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:54.362574  8389 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.383920  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:54.392465  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.384575  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:54.385800  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:54.390141  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.346073  8507 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:10:54.359817  8387 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:54.396113  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:54.396385  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.401379  4840 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.392575  8432 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.400418  8455 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:54.403268  4840 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:54.405145  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 223500us
I20260709 12:10:54.400581  8430 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:54.409030  8430 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:54.409392  8430 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.410362  8446 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.403489  8484 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:54.411700  8484 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:54.412050  8484 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.401865  8401 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.395725  8445 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:54.414649  8445 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.401844  8283 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.416066  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:54.419314  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.418567  4916 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.405651  8451 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:54.421267  8446 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.422541  8440 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.423393  4942 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.425478  8451 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:54.429817  8437 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.429572  8451 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.430698  8451 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.434631  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:54.417425  8524 tablet_copy_client.cc:323] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:10:54.461512  4873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d89e729329948059879ed6f44a07690"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:54.462535  4873 raft_consensus.cc:606] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.463014  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:54.462939  4944 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.462102  4840 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.468712  4942 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:54.438112  8446 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.470106  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.473258  4946 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.473423  4950 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.472940  4951 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:54.474874  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.432200  8508 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.475095  8447 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.468602  8300 consensus_queue.cc:1059] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 12:10:54.483718  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.483366  8467 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.459995  8471 consensus_queue.cc:1059] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:54.475320  8283 consensus_queue.cc:1059] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:54.484824  8471 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:10:54.484632  8527 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:54.485276  8471 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:54.475250  8439 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.466847  8455 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.490734  5025 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.488516  4773 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 6 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.487562  4942 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:54.487555  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.472441  8466 consensus_queue.cc:1059] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:10:54.489354  8447 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.468602  8472 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.489768  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:54.485778  8518 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.449209  8504 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:10:54.501279  4916 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.483856  8468 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.501776  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:54.490396  8300 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:54.502135  8469 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.507032  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:54.502645  8283 raft_consensus.cc:3055] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.461963  8400 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:54.421386  8432 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.506352  5024 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.477797  8461 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:10:54.507076  8300 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.516585  8466 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:54.521797  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.527251  5020 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.527930  5022 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:54.533042  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 3da8832a07224abb9a1f8815f3dcd745 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:10:54.533634  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 3da8832a07224abb9a1f8815f3dcd745 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-3da8832a07224abb9a1f8815f3dcd745
W20260709 12:10:54.534233  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.539256  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.517207  8283 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.523962  8437 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.547144  4870 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.546715  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.548283  5570 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.509406  8507 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:10:54.509246  8446 consensus_queue.cc:1059] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:10:54.524694  8466 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:54.500449  8471 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.537266  8514 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:10:54.545516  8521 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.563337  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:54.556730  4917 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:54.567013  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.562780  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.543959  8477 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:54.568133  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.568606  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.559895  5025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "951f0af961a844849af172b241003482"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:10:54.550879  8431 consensus_queue.cc:1059] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:54.585031  5025 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:54.585433  5025 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.569469  8506 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.569696  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:54.569316  8522 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.570430  8283 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.568612  8487 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.589697  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.578832  8469 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.555713  8462 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:54.592114  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.579627  8468 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:54.579520  8466 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.584612  4873 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.586359  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.586819  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:54.558256  8432 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:54.588342  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:54.590154  4869 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:54.592900  4876 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.607213  4869 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:54.593853  4875 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.596055  8484 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.597122  8467 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.585325  8477 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:54.592247  8521 raft_consensus.cc:3055] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.560354  8300 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.581861  8508 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.598229  8510 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.599084  8430 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.617177  8521 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.620994  8466 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.621351  4870 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.588522  8471 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.588625  8518 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.601239  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.607577  4869 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.636178  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:54.611902  5019 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:54.613168  4872 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:54.614221  4943 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.614715  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:54.618305  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.622404  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.625680  4946 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.601636  8482 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.640985  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.626883  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.629271  4868 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:54.642367  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:54.632278  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.633453  8300 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.647683  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.638074  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.625185  8514 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:10:54.647054  8404 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.650207  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.651183  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.651952  8389 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.635725  8487 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:10:54.656143  8477 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:54.657745  4874 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:54.650049  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:54.658689  4873 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:10:54.657732  4867 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:54.661310  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.662355  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.659961  4869 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.663062  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.663316  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.663841  8477 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.664402  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.665042  4869 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.665446  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.665670  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.666031  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.666399  8477 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.666558  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.666846  8477 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:54.667239  8477 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.667572  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.668277  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.668838  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.669377  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.669565  8468 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:10:54.670212  8468 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.670411  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.671139  4873 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:54.671872  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:54.674409  8477 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.647899  8400 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:54.681480  4991 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.675870  4917 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.676316  5017 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.649718  8440 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.657864  8505 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:10:54.713883  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:54.715730  8525 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.726754  5020 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.717473  8468 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.717082  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.674795  4873 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:54.718035  8516 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.714254  8387 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.657691  8508 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.660775  8493 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.641289  8467 consensus_queue.cc:1059] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:10:54.727833  4872 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:54.714118  8400 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.769695  8400 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.771159  8400 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.772426  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:54.772682  4945 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:54.715212  8521 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:54.775471  8537 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:10:54.777227  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:54.777783  5603 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.781993  8491 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:54.660176  8389 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.712527  8437 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:54.736059  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:54.736660  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:54.751509  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.762992  8416 raft_consensus.cc:3055] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.786032  5024 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:54.787782  4988 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.675428  8461 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 12:10:54.793653  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 76652.3us
I20260709 12:10:54.795619  4947 raft_consensus.cc:3055] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.795888  4871 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:10:54.798442  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:54.716445  8430 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:54.736356  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:54.808491  4917 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.809927  4947 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:54.725442  8462 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:10:54.826311  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:54.802562  8516 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.799567  8437 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:54.799288  8416 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:54.827231  4947 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.835796  4947 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.833120  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.837726  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.840010  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.841217  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:54.844908  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.803792  8507 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:10:54.799777  8505 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:10:54.848716  5603 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:54.834050  8440 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:54.853255  8516 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.867446  5598 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:54.836455  8510 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.856114  8460 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.874542  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.842936  8487 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.843163  8445 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:54.858439  4944 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:54.861459  4841 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:54.855427  8416 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.879431  8416 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.869267  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.881078  8467 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.882983  8430 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:54.883487  8430 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.883944  8482 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:54.884341  8430 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.886302  8487 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:54.887195  8487 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.892560  8455 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:54.893049  8455 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.894963  8455 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:54.878108  5020 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:10:54.896016  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.878082  4841 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:54.896977  8434 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:54.897467  8434 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:54.898303  8434 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.873486  8460 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:54.900086  8460 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:54.901508  8460 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.909435  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:54.872915  5025 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:54.899173  8283 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.925047  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:54.925606  4875 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:54.927501  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:54.928090  5023 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:54.929874  5025 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:54.932554  5017 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:54.935773  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.876533  8497 raft_consensus.cc:3055] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:54.943246  5018 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:54.948365  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:54.948886  8389 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:54.944278  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:54.956607  5020 raft_consensus.cc:2393] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:54.959913  4874 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:10:54.960927  5023 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:54.972956  4990 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.974392  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:54.975440  4948 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:54.975440  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.986580  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:55.005940  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:55.006736  4944 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:55.004546  4839 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:55.011102  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:54.943059  8447 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:54.953524  8497 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:54.973263  8455 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.985895  8468 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.049278  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:54.986120  8498 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.061975  4868 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:55.054976  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:54.986006  8471 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:55.059398  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 188727us
I20260709 12:10:55.060449  4942 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.004060  8389 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:55.062812  4946 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:55.018697  8482 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.064402  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:55.074322  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:54.920424  8437 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.022814  8400 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:10:55.125958  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 51715.3us
I20260709 12:10:55.129186  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:55.023602  8510 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:55.053606  8447 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:55.091588  8416 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.113437  4770 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 8 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.100281  8441 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:55.126535  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 144881us
I20260709 12:10:55.132153  4770 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 8 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:55.136619  4874 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:55.118410  8513 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:55.058620  8477 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.017709  8491 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:10:55.005831  8514 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 12:10:55.125674  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 100484us
I20260709 12:10:55.059230  8440 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:55.157869  8440 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.140141  5019 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.121268  8389 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:55.151062  8472 consensus_meta.cc:287] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.647s	user 0.001s	sys 0.005s
I20260709 12:10:55.153103  8438 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:55.157009  8514 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.092520  8505 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:10:55.076647  8498 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.061766  8455 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.130604  8401 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.143544  8513 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:55.162305  8400 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:55.165035  8510 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:55.205885  8400 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.207065  8510 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.170006  8514 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:55.205902  8389 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:55.209587  8514 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.211064  8514 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.187582  8438 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:55.215957  8438 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.220106  8508 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:55.220567  8508 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.222216  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.222563  8508 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:55.222812  4875 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:10:55.224314  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:55.224917  5598 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:55.169821  8300 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.194973  8539 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:10:55.198383  4947 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:55.182587  8477 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:55.241174  8477 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.242985  8477 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.178336  8491 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:10:55.203554  8466 consensus_meta.cc:287] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.002s
I20260709 12:10:55.204082  8498 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.204996  8551 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:55.244475  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.245615  8300 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.266525  8300 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:55.266626  5034 tablet_copy_source_session.cc:215] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:55.255980  4990 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:55.249430  8543 log.cc:927] Time spent T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 12:10:55.239601  8493 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:10:55.249606  8542 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.083s	user 0.000s	sys 0.003s
I20260709 12:10:55.274488  8508 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:55.325628  8508 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:55.326025  8508 raft_consensus.cc:3060] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:55.334326  8506 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:55.334656  8524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da8832a07224abb9a1f8815f3dcd745. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:10:55.335602  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 181314us
I20260709 12:10:55.270916  8477 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.333647  8508 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.338924  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.349050  5598 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:55.350124  5018 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:55.337082  8467 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.343832  8539 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:55.338168  8401 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:55.342348  8506 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.380492  8506 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:55.382252  4876 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:55.342262  8477 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.384554  8477 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.385140  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.385726  4876 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:55.399763  8484 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:55.401067  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:55.402215  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:55.403313  4761 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7d89e729329948059879ed6f44a07690 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4f3bf546572147c3abe4522189e86ce6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:55.404197  8466 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.404587  8466 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:55.404937  8466 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.407596  8472 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:55.408448  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:55.409497  5019 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 10: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:55.345136  8555 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:10:55.413363  5570 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:55.414935  8507 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:55.415163  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 63319.9us
I20260709 12:10:55.416981  8489 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:55.417749  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.417896  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:55.418605  5023 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:55.418793  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.419041  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.419422  8489 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:55.419580  4947 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:55.415313  8507 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.420327  8507 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.420699  5016 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.421780  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.422262  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:55.422950  4917 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:55.422963  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.418640  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.423905  4942 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:55.424187  4946 raft_consensus.cc:2393] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:55.417217  4951 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.422366  4950 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:10:55.429963  8561 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:55.430166  8550 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:55.430877  8440 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.431229  8440 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:55.431999  8440 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.433454  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.434069  4945 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:55.434916  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:55.435513  5016 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:55.435843  4988 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:55.439131  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:55.440155  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.433367  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.443444  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:55.443725  4942 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.445256  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:55.446489  8472 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.447258  8468 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.447649  8468 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.447971  8468 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.448570  8455 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:55.449292  8525 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:55.449780  8525 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:55.449904  4917 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:55.450613  8525 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.451125  8438 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:55.446417  8506 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.452713  8506 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.453058  8506 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.453718  8552 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.454362  8556 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:55.429939  8447 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.456667  8447 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.456893  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:55.457451  5603 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:55.454383  8438 raft_consensus.cc:993] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:55.403131  4773 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 6, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:55.460110  4773 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 6 to 7, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:55.466708  5603 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:55.468175  8400 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:55.473836  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.484874  5023 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:55.472599  8431 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.473533  8300 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.489976  8400 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:10:55.508257  4945 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:55.508204  8552 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:55.481684  8438 raft_consensus.cc:1081] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:10:55.482568  8514 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.518803  8477 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.534626  5601 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.522722  8506 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.524956  8401 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.378274  8467 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.505569  8440 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.541838  8300 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:10:55.541563  8477 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:55.551729  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.552342  4876 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:55.553786  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.555301  8472 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.555677  8472 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.555996  8472 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.561623  8466 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.562625  4990 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:55.563381  8416 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.563745  8416 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.564108  8416 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.565052  8498 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.565671  8467 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.565537  8498 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:55.566782  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 127203us
I20260709 12:10:55.567480  8498 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.571089  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.571673  4942 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:55.572561  8456 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:55.573441  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.574697  4876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:10:55.575238  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:55.576256  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.576525  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.575237  4876 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:55.577096  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:55.577001  4871 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:55.577510  4876 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.573076  8456 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:55.563828  8552 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.537811  8514 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.582719  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:55.582981  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.583312  5567 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:55.588428  4942 raft_consensus.cc:2393] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:55.589174  4950 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:55.592154  4872 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:55.574424  8477 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.602197  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:55.602406  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:55.602790  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:55.606331  4946 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.605175  4951 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:55.578783  8467 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:55.587652  8508 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:55.596863  8505 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.615245  8513 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.616345  8506 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:55.616523  8431 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:55.618579  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.620898  8472 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:55.615162  8416 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.623831  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:55.625531  5602 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:55.579874  8456 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.572561  8507 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.620328  4876 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.635020  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.636114  4942 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:55.639685  5022 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.650025  4876 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:55.651021  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:55.651170  8513 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.651548  5024 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.652951  8477 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.653424  8477 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:55.654174  8477 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.656083  8472 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.657567  8468 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.659441  8468 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.632555  8505 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.663968  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:55.664605  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:55.672024  4872 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.672087  4875 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.670604  4946 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:10:55.672961  5597 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:55.674540  4990 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:55.663092  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:55.677209  4942 raft_consensus.cc:3055] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.677659  4942 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:55.679857  4872 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:55.673544  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:55.683243  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.684818  5024 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:55.685855  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.640451  8508 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:55.695742  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.630091  8467 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.709620  4875 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:55.706339  8431 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:55.739570  8431 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:55.740381  8431 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.707531  5016 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:55.745858  8416 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:55.747488  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:55.748073  5602 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:55.749495  8568 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:10:55.682322  8468 raft_consensus.cc:2804] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:55.753424  5019 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:55.744576  5022 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:10:55.681021  8505 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.756301  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.762861  8484 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:55.763231  5601 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:55.688527  8472 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.706110  4942 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.766018  8416 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:55.768041  8514 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:55.768409  8521 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.768960  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:55.769516  5019 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:10:55.771898  8468 raft_consensus.cc:697] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:55.772789  8468 consensus_queue.cc:237] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.773742  8497 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.775044  8497 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.681051  8447 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:10:55.779911  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:10:55.766042  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:55.688117  8508 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.738045  8456 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.707963  8471 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.708038  8510 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.804241  4876 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:55.805797  4868 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:10:55.806854  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.765050  8493 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.764321  8300 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:10:55.807552  8514 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.803889  8508 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.828039  8524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37900 (request call id 834) took 1654 ms. Trace:
I20260709 12:10:55.855018  8524 rpcz_store.cc:276] 0709 12:10:54.160511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.160703 (+   192us) service_pool.cc:224] Handling call
0709 12:10:54.324272 (+163569us) ts_tablet_manager.cc:934] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
0709 12:10:55.332882 (+1008610us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:55.522935 (+190053us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:55.523056 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:55.681207 (+158151us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:55.757980 (+ 76773us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:55.810696 (+ 52716us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:55.815077 (+  4381us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":23651,"tablet-copy.queue_time_us":91745,"thread_start_us":99731,"threads_started":2}
I20260709 12:10:55.856308  8524 tablet_copy_client.cc:806] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:55.856792  8524 tablet_copy_client.cc:670] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:55.814965  8500 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:10:55.860708  8467 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.816524  8451 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:10:55.819342  8493 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.872695  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.873407  4868 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:55.839959  4875 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:55.879948  5598 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:10:55.829077  8510 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:55.881847  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:55.810329  8471 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.889712  4875 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.913923  5597 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:10:55.915187  4875 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:10:55.915813  4946 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:55.916321  5570 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:55.919195  5602 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:55.923733  8510 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.927874  8505 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.931465  8471 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:55.932869  8460 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:55.933408  8460 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:55.889397  8416 raft_consensus.cc:697] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:55.936662  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:55.941583  4875 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:55.836289  8514 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.942822  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.917714  8455 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.922416  8477 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:55.904668  8516 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:55.934566  8472 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:55.917557  8445 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:55.948665  8471 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.920292  8545 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:10:55.934223  8460 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:55.953202  8585 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.965662  8416 consensus_queue.cc:237] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:55.981662  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:55.982436  4869 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:56.014358  4868 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.956220  8455 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.018839  4875 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:55.976526  8585 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.020437  8585 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.029213  8466 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.032698  8595 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.033169  8595 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:56.035590  8595 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.037904  5019 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:56.038053  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.038615  4875 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:10:56.035668  4942 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.960127  8477 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.011227  8521 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.045082  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:55.974875  8471 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.051373  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:56.062539  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.068046  8462 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:10:56.068291  8524 tablet_copy_client.cc:538] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:56.068675  8595 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:56.069211  8595 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.070808  8400 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:56.071064  8462 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:56.060277  8582 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:10:56.071399  8400 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:56.053236  8583 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:10:56.073413  8400 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.073729  8595 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.057142  8497 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.075016  8497 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.075822  8432 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:56.076167  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.076757  5019 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:56.077397  8437 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.077683  8510 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:56.078449  4872 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:56.078262  8510 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.079391  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.079994  4876 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:56.080788  8510 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.081081  5598 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 4: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:56.061331  8589 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:56.081729  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:56.058995  8477 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.077787  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.083122  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.082149  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.083868  8498 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:56.084059  4874 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:56.084381  8498 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.084924  8493 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.076282  8432 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.071445  8462 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:10:56.085723  5019 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:56.077369  8497 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.057456  8525 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:56.092228  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.052618  8506 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:10:56.093102  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:56.094091  8477 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:56.086648  8432 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.095369  8477 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:56.095722  8477 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.096382  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.097764  8498 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.098282  8432 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.101171  8432 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:56.104440  8505 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.105141  8472 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:10:56.052752  8584 log.cc:927] Time spent T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:10:56.117905  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.118513  5023 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:56.119642  5568 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:56.044430  8508 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.082235  8589 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.120391  8498 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:56.120709  8589 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:56.121094  8498 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.054529  8521 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.104142  8432 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.096014  8477 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.070803  8471 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.102221  8506 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:56.114326  8455 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.116971  8514 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.124516  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.160750  8505 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.148550  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.194164  5601 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:56.151844  4942 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
W20260709 12:10:56.153419  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 96014.1us
I20260709 12:10:56.154121  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.161510  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.196302  5019 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:56.165524  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.197578  4874 raft_consensus.cc:2393] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:56.165535  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.198311  5022 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:10:56.199213  5568 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:56.167968  5016 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:56.188897  4871 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
I20260709 12:10:56.190258  5018 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.165177  8510 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.131117  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:56.153505  8467 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.203866  4868 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.191921  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.192270  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.195626  4841 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:56.204461  4870 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:10:56.200002  5568 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:56.191354  5023 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:56.111609  8585 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.166256  8506 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:56.215096  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "231547812bf34f17b386898e6451cc49"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:56.215621  4867 raft_consensus.cc:606] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:56.215937  4867 raft_consensus.cc:614] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:56.217171  5018 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:56.199064  8505 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.190675  8522 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:10:56.219434  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:56.202491  8556 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.202666  8514 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.212062  8431 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.213022  8493 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:56.223795  8505 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.242949  8508 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.235508  8493 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.246760  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.229645  8514 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:56.214445  8467 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.248524  5023 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:10:56.235261  8431 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:56.254316  8431 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.255956  8467 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.214624  8510 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.257741  4872 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:10:56.258333  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:56.258944  4874 raft_consensus.cc:606] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:56.259284  4874 raft_consensus.cc:614] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:56.252938  8521 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.253551  8525 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:56.250593  8604 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:10:56.251296  8514 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.264429  8510 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.266108  8585 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.266844  8524 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:10:56.268827  8462 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.249742  8493 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.258555  8437 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 12:10:56.270938  8580 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.422s	user 0.008s	sys 0.000s
I20260709 12:10:56.233786  8556 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.341910  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.281412  8431 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.343809  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.344347  4950 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.286065  8507 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.289462  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.345901  5604 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:56.289695  4874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4428def03fb45c99d3538acc2628494"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:10:56.346680  4874 raft_consensus.cc:606] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:56.346911  4874 raft_consensus.cc:614] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:56.267232  8432 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.317997  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.310016  8589 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:56.348184  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.342960  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.349465  4945 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:56.337051  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 119837us
I20260709 12:10:56.338935  8609 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.341367  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.354203  4942 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.342991  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.343075  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.345228  5603 raft_consensus.cc:2368] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15.
I20260709 12:10:56.356223  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.355688  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.357216  4947 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:56.357237  4949 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.358132  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.359316  4946 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.357748  4943 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:56.360764  5604 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:56.358191  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.328095  8521 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:10:56.361327  4947 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.366144  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.370244  4942 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:10:56.364954  4950 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:10:56.370322  4949 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:56.368134  8589 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.375178  8484 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:56.376091  4947 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:56.378145  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.382720  4950 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:56.379050  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.383471  4946 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:56.378156  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.383574  4942 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:56.382409  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.385196  4943 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:56.394915  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.395433  4946 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:56.395727  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.396327  4947 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:10:56.396622  4942 raft_consensus.cc:1275] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:56.384147  4949 raft_consensus.cc:2376] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8. Re-sending same reply.
I20260709 12:10:56.395793  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.398718  4950 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:10:56.377415  8467 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:56.394600  8484 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.358357  8609 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.407635  8547 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.408033  8525 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.473393  8460 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.514907  4943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:10:56.515471  4943 raft_consensus.cc:606] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:10:56.482358  8508 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:56.519412  4951 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
W20260709 12:10:56.528885  8605 log.cc:927] Time spent T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:10:56.532763  8556 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.536511  8521 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.537024  8521 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.539196  8521 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.517421  8507 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:56.540402  8507 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.540774  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.545673  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.546416  5018 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:56.473493  8608 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 12:10:56.488301  8477 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.518904  8460 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.592327  4945 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:56.551249  8521 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.559299  8619 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:10:56.559021  8607 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.520397  8525 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.520674  8547 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.547128  8508 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.625388  8556 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.649029  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:56.637149  8467 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.637746  8510 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.625056  8521 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.640590  8607 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.652748  8431 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:56.738623  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 67029.9us
I20260709 12:10:56.747422  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.647861  8615 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.744870  5598 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:56.656718  8556 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.739205  8300 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.758937  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:56.759588  5022 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:10:56.741215  8608 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.760059  4841 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:56.764216  8477 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.747180  8522 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:56.765427  8609 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:56.766855  8505 consensus_meta.cc:287] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.002s
I20260709 12:10:56.767964  8460 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.747426  8400 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:10:56.770287  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 401976us
I20260709 12:10:56.663589  8467 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.663807  8510 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.778891  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:56.791178  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:56.785805  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.773370  8431 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.793795  5605 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:56.792798  5018 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:56.794361  5022 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:10:56.794488  4988 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:56.797529  4988 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:56.777520  8484 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.800091  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:56.771862  8300 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.761171  8615 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.801430  4988 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:56.773303  8608 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.808959  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.809561  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:56.843537  4950 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:56.785120  8505 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.810068  4945 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:10:56.852073  4950 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:10:56.835477  4949 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:56.835794  5567 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:56.789529  8400 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.777876  8522 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.802227  8477 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.798578  8471 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:56.794032  8521 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.806504  8472 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:56.806324  8587 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:56.893006  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 57311.1us
I20260709 12:10:56.848896  8589 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.911886  5599 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:56.914070  5567 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:56.892572  8508 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:56.905279  8609 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.920981  4949 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:56.920017  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:56.916707  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.923592  5600 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:10:56.924492  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:56.926203  8630 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.926610  8630 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:56.926957  8630 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.931505  8498 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.932085  8498 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:56.934510  8630 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.935155  8466 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:56.935722  8466 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:56.926616  8556 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.937726  8630 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.938395  8400 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.943100  8522 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.944527  8510 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.913527  8460 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.945212  8498 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:56.945550  8300 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.946977  8608 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.922088  8626 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.907637  8525 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.950872  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:57.022876  4875 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:10:56.954525  8493 consensus_meta.cc:287] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.611s	user 0.004s	sys 0.004s
I20260709 12:10:56.913758  8497 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.961962  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:56.956332  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:57.031363  4874 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.034324  8634 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.034880  8634 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.036986  8634 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:56.956395  8484 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.010722  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:57.038355  8484 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.038867  4874 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:57.040453  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.962231  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:57.040937  8484 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.041237  4874 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:56.960793  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:56.954612  4869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 1758) took 2362 ms (client timeout 2001 ms). Trace:
W20260709 12:10:57.018946  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 54262.5us
I20260709 12:10:57.041574  8431 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:56.954293  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:57.041738  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:57.042001  4869 rpcz_store.cc:269] 0709 12:10:54.591670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.665775 (+ 74105us) service_pool.cc:224] Handling call
0709 12:10:56.954414 (+2288639us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540031bad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:56.954519 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2993332992}
W20260709 12:10:57.042763  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 241379us
I20260709 12:10:57.037760  8472 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:57.043061  4872 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:57.041896  4876 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.043473  4869 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:56.948768  8615 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.043747  8472 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.044941  8431 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:56.957165  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:56.939826  8432 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.042380  5020 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 3.
I20260709 12:10:57.031297  4867 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.048667  4873 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:10:57.049779  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.050765  8472 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.051115  8472 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.051427  8472 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:56.950873  8612 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.466s	user 0.005s	sys 0.002s
I20260709 12:10:57.041378  4868 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.054327  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.054877  5601 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:57.055570  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.056066  5601 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
W20260709 12:10:56.967923  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 113714us
I20260709 12:10:57.057648  4839 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:57.058130  5601 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:10:56.980368  8508 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:57.059332  5022 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:10:57.059787  4990 consensus_peers.cc:597] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:57.061331  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.061899  5024 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:57.062378  5025 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:10:57.062651  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.064352  4875 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:10:57.066313  5602 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:56.954077  8462 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.069732  4950 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:57.070344  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:57.079697  4946 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:10:57.080531  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:57.081585  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:57.070992  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:57.071208  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:56.954816  8587 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:57.084384  4942 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:57.086130  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:57.090430  4867 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:57.017483  8400 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.093573  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:57.072397  4868 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:10:57.057543  8626 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:57.071832  4876 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:57.100386  4839 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:56.920825  8589 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.100925  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.102792  5018 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:57.109606  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:57.110366  4951 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:57.025110  8607 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:56.964881  8609 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:57.112718  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 53903.8us
I20260709 12:10:57.113402  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.115487  5020 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:57.115695  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:10:57.023751  4761 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7d89e729329948059879ed6f44a07690 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4f3bf546572147c3abe4522189e86ce6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:57.118772  5022 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.118917  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.119864  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.119923  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:57.105218  8628 log.cc:927] Time spent T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 12:10:57.121263  4876 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:57.101238  8300 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:57.092308  8510 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.020933  8460 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.024029  8498 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.121263  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.127267  5021 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.132952  8632 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.104800  8439 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:57.030548  8493 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.133471  8471 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:57.134670  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.100976  8634 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:10:57.163923  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.140799  4947 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:57.167568  5022 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.117012  8508 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:57.121260  8607 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.109283  8522 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:57.104619  8587 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.106710  8400 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.099856  8638 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:10:57.209960  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.165416  8439 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:57.124797  8639 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:10:57.206890  5597 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:57.184346  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.130892  8300 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.163930  8633 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:10:57.209007  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 74395.2us
I20260709 12:10:57.224244  4841 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:57.204334  8607 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.190412  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.125083  8595 consensus_queue.cc:1048] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:10:57.219084  8439 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.221220  5017 raft_consensus.cc:2368] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
W20260709 12:10:57.128723  4761 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 107984us
I20260709 12:10:57.186584  8466 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.229166  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.227427  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:57.234496  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.234676  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:57.217489  8505 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.230760  5603 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 742) took 1082 ms. Trace:
I20260709 12:10:57.231583  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.168239  8471 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.241495  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.242152  5018 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:57.211385  5600 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:57.162303  8510 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.223161  8300 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.237323  5603 rpcz_store.cc:276] 0709 12:10:56.148450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.191677 (+ 43227us) service_pool.cc:224] Handling call
0709 12:10:57.230592 (+1038915us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400483854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:57.230709 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321350528}
W20260709 12:10:57.250255  8627 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:10:57.225004  8484 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.223376  8633 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.251545  8633 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.253547  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.166046  8632 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.255961  8632 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.228422  8607 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.238085  5022 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:57.251327  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:57.257827  4951 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.256467  8300 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:57.236449  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 75359.7us
I20260709 12:10:57.261938  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:57.263113  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:57.251302  8484 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:57.263407  8300 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.263765  8484 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.265712  5020 raft_consensus.cc:2393] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.267395  8447 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:57.267792  8447 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.268107  8447 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.269106  8631 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.269629  8631 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:57.261255  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37900 (request call id 850) took 1088 ms. Trace:
I20260709 12:10:57.273646  4950 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.272114  5599 rpcz_store.cc:276] 0709 12:10:56.153534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.153883 (+   349us) service_pool.cc:224] Handling call
0709 12:10:57.240709 (+1086826us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b540065e0d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:57.241718 (+  1009us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615181184}
I20260709 12:10:57.239853  8630 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.272393  8466 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:57.279991  4950 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:10:57.205832  8626 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.282217  8400 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.283936  5570 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.284775  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:57.252532  8510 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.286026  4951 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:57.296013  8642 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:10:57.296535  8642 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:57.297338  8642 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:57.292115  8637 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:10:57.306679  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 71430.6us
I20260709 12:10:57.277487  8630 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:57.302793  8514 consensus_meta.cc:287] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.973s	user 0.010s	sys 0.000s
I20260709 12:10:57.308027  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:10:57.309576  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 74968us
I20260709 12:10:57.313629  8431 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.313658  4841 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:57.314143  8431 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.314515  8431 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.315230  4841 leader_election.cc:400] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15.
I20260709 12:10:57.315518  4841 leader_election.cc:403] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.316941  8510 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.317994  8510 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15.
I20260709 12:10:57.312330  8630 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.319458  8623 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:57.319850  8623 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:57.320178  8623 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.321741  8648 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.322189  8648 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.271894  8432 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:10:57.270450  8631 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.311154  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.318862  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.285306  8634 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:10:57.335707  8466 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:57.336086  8658 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.328949  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.338874  8655 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:57.337388  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:57.272595  8472 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.294150  8632 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:10:57.323730  8589 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.272792  8508 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.324302  8514 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.339700  8400 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:57.357610  8589 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:57.355803  8432 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.367959  8636 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.368484  8636 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.371841  8507 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.373824  8623 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.376341  8623 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.378988  8431 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.381631  8589 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:57.382527  8589 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.355109  8498 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.358814  8648 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.385419  8648 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.385855  8648 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.388715  8431 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.391742  4840 leader_election.cc:400] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
I20260709 12:10:57.392019  4840 leader_election.cc:403] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.393069  8522 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.393533  8522 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.394598  8652 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
I20260709 12:10:57.395434  8522 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.396071  8545 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.398511  8466 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:57.399135  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 2867) took 1324 ms. Trace:
I20260709 12:10:57.399518  4871 rpcz_store.cc:276] 0709 12:10:56.074422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.077563 (+  3141us) service_pool.cc:224] Handling call
0709 12:10:57.398973 (+1321410us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b5400335ed4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:57.399063 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180989184}
I20260709 12:10:57.396508  8545 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.401180  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.401530  8651 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:57.403205  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.403831  4871 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:10:57.404654  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.406337  4871 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:57.407918  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:57.409349  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.410338  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.411072  4874 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.408681  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:57.403117  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.357874  8587 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.414788  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.415294  5606 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:57.416260  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.359918  8460 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.418725  4871 raft_consensus.cc:2393] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:57.418627  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.420018  4870 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:10:57.420665  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.420841  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.423483  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.424026  4870 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:57.419467  4874 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:57.436357  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.436964  4867 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:10:57.359876  8595 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:10:57.371892  8636 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.448238  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:57.423995  8587 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.454471  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.455027  5023 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:10:57.349406  8658 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.414661  8484 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.459403  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.460004  5022 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 6.
I20260709 12:10:57.436986  8487 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:10:57.463142  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.471632  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.453954  8471 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.455786  8636 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:57.478817  4868 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:57.474808  5024 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:57.443120  8633 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.478451  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:57.459069  8608 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.458841  8621 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:57.479446  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.481693  4944 raft_consensus.cc:2368] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:10:57.482944  5022 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:10:57.484513  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:57.494549  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 79824us
I20260709 12:10:57.494767  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 529) took 1143 ms. Trace:
I20260709 12:10:57.495167  4944 rpcz_store.cc:276] 0709 12:10:56.339465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.341772 (+  2307us) service_pool.cc:224] Handling call
0709 12:10:57.478320 (+1136548us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b58001d5b98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5e9c 00007f2a577c5a5b 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:10:57.482967 (+  4647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361344}
I20260709 12:10:57.494750  5018 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.498548  5025 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.457983  8587 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.475174  8589 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.480383  8662 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.479066  8636 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:57.482154  8471 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.504528  8589 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:57.494601  8545 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:57.508914  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 60739.9us
I20260709 12:10:57.510564  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:10:57.503626  8477 consensus_meta.cc:287] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.003s
I20260709 12:10:57.496004  8621 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.534183  4917 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:57.536302  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.551720  5022 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:10:57.552420  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.505824  8650 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.552798  5022 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.506596  8649 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.510306  8472 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.552778  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:57.508498  8636 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:57.565837  5022 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:57.518968  8514 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.522801  8589 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.536916  8648 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.533524  8547 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.541863  8487 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.518474  8510 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.544116  8587 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.520793  8477 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.584196  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.600988  5018 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.554987  8545 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:57.538067  8658 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.561012  8650 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.582661  8529 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.536257  8630 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.517925  8471 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.540745  8607 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.583415  8451 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:57.605189  5017 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:10:57.508548  8662 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.540916  8506 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.611445  8439 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.603123  8545 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:57.603571  8666 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:10:57.611150  8633 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.603439  8529 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.652405  4876 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:57.624928  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:57.565833  8649 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.640236  8621 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.647362  5606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 746) took 1107 ms. Trace:
I20260709 12:10:57.649386  8447 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.628726  8545 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.599843  8510 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.660187  8514 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:57.603166  8650 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.630682  4915 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:57.657729  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:57.658389  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.661346  5606 rpcz_store.cc:276] 0709 12:10:56.540362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.540516 (+   154us) service_pool.cc:224] Handling call
0709 12:10:57.647193 (+1106677us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b540051f754. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:57.647304 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009766272}
I20260709 12:10:57.664566  5602 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:57.668453  5599 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.640129  8471 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.670096  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:57.672062  5018 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:10:57.658916  8529 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.646117  8439 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.665185  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:57.621698  8484 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.682313  8649 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.670814  8621 raft_consensus.cc:2764] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:10:57.687178  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:57.687692  5604 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.683879  8609 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.643021  8636 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.689563  5602 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:57.686421  5600 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:10:57.694919  8616 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.852s	user 0.000s	sys 0.003s
I20260709 12:10:57.698938  5599 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:57.704377  8524 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 12:10:57.705295  8661 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:10:57.707691  8636 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.708952  8662 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.709820  8510 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.709867  8467 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.714368  8493 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.731501  8589 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.732761  8630 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.731986  8650 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:57.734211  8653 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.396s	user 0.000s	sys 0.002s
I20260709 12:10:57.736753  8589 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.737823  8650 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:57.736799  8665 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:10:57.738943  8607 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.769410  4875 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 5: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:10:57.769346  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 99575.4us
I20260709 12:10:57.769917  4841 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:57.818925  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.822925  4773 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 6 to 7, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:57.829617  4991 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.831050  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.834156  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.834517  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.835367  5017 raft_consensus.cc:2393] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.835563  5016 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 10: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:57.836354  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.838059  5020 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:10:57.840446  5023 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:57.850092  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.850777  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.851050  5017 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:10:57.851794  5019 raft_consensus.cc:2368] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:10:57.858394  4841 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:57.858596  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.858904  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:57.859742  4841 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:57.860369  5021 raft_consensus.cc:2368] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:10:57.862020  5568 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:57.863356  5568 leader_election.cc:400] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:10:57.863670  5568 leader_election.cc:403] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.866789  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:57.867170  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.866720  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.868086  5601 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:57.868142  5603 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:57.859665  5022 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.820394  4915 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:57.870724  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.868330  5605 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:10:57.877614  8507 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.878683  8507 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.882498  8552 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.882956  8552 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.883330  8552 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.871169  8460 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.885126  8432 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.886003  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.885892  8432 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.887364  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:57.888281  8432 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.885325  8460 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.885283  5601 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:57.891479  8498 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.891773  8460 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:57.891873  8498 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.892274  5601 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:10:57.892865  8439 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:10:57.892313  8498 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.898233  8400 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.898928  8400 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.899724  8507 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.902030  8439 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.902860  8439 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.905279  8510 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:57.888478  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:57.908193  8510 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.910037  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.867345  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.909543  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.913334  8521 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:57.919032  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47298 (request call id 19) took 1431 ms. Trace:
I20260709 12:10:57.919320  8607 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.919718  8633 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.722225  8545 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.920500  8633 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.921422  8400 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.922729  8545 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.923067  8633 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.924535  8589 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:57.925086  8589 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.919979  8607 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.925570  8589 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.926658  8645 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.927188  8645 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.927587  8645 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.927680  8607 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.911659  5023 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:57.919004  8521 raft_consensus.cc:697] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:57.910915  4839 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:57.932928  5568 leader_election.cc:400] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:10:57.935066  5568 leader_election.cc:403] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.935724  8521 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.936120  8456 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:10:57.937021  8456 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.937531  8456 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.938452  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57006 (request call id 686) took 1104 ms. Trace:
I20260709 12:10:57.939589  5600 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
W20260709 12:10:57.941854  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 76823.3us
I20260709 12:10:57.942528  8506 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.902266  8484 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.945201  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.944916  8484 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:57.928819  4943 rpcz_store.cc:276] 0709 12:10:56.487487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.498104 (+ 10617us) service_pool.cc:224] Handling call
0709 12:10:57.775470 (+1277366us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b540002f420. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a867520 00007f2a5a8e4652 00007f2a5f8b260a 00007f2a58e387d4 00007f2a58e38762 00007f2a58e38691 00007f2a58e3860c 00007f2a58e378c2 00007f2a58c2548c 00007f2a58c248c6
0709 12:10:57.918050 (+142580us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b540002f420. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8655e7 00007f2a5a8e4c68 00007f2a5a8e484a 00007f2a5f8b260a 00007f2a58e387d4 00007f2a58e38762 00007f2a58e38691 00007f2a58e3860c 00007f2a58e378c2 00007f2a58c2548c
0709 12:10:57.918774 (+   724us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88158720}
I20260709 12:10:57.947132  8484 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.947636  8484 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.948382  8629 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.941977  8456 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:57.920040  8588 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:57.951439  5568 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:57.958107  8629 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.956231  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:57.908777  8510 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:57.950954  5567 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:57.955672  8524 tablet_bootstrap.cc:492] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:10:57.938827  5598 rpcz_store.cc:276] 0709 12:10:56.834221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.844149 (+  9928us) service_pool.cc:224] Handling call
0709 12:10:56.844458 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.844738 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.844764 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.853583 (+  8819us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.042101 (+188518us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:10:57.042368 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.937752 (+895384us) spinlock_profiling.cc:243] Waited 93 ms on lock 0x7b540044c8a0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a865733 00007f2a5a8eadbf 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c
0709 12:10:57.937828 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.937961 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.938032 (+    71us) raft_consensus.cc:1685] finished
0709 12:10:57.938135 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.938286 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21003,"prepare.queue_time_us":292,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":114513,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":20688,"spinlock_wait_cycles":213964544,"thread_start_us":186439,"threads_started":2,"wal-append.queue_time_us":134032}
I20260709 12:10:57.972839  8525 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:57.955297  5602 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
W20260709 12:10:57.936164  5597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 743) took 1675 ms (client timeout 2187 ms). Trace:
I20260709 12:10:57.949317  8651 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.973074  8524 ts_tablet_manager.cc:1403] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 1.707s	user 0.037s	sys 0.013s
W20260709 12:10:57.975126  5597 rpcz_store.cc:269] 0709 12:10:56.260377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.260515 (+   138us) service_pool.cc:224] Handling call
0709 12:10:57.935805 (+1675290us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400645fd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:10:57.935998 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975223040}
I20260709 12:10:57.954030  8447 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:57.959982  8460 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:10:57.948294  8484 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:57.976035  8456 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.981798  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:57.948921  8642 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:10:57.986661  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:57.989163  8505 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.991634  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:57.992377  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 95893.2us
I20260709 12:10:57.994319  4875 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:57.980520  8651 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:58.011166  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 59871.9us
I20260709 12:10:58.000892  8456 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.958604  8588 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.007330  5604 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:58.015661  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:58.016407  4872 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:58.016583  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:58.017467  5025 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:58.017827  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:58.008037  8505 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:58.033751  4868 raft_consensus.cc:2410] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:58.006475  8651 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.018227  8456 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.039336  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:58.026058  8439 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.048338  5021 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
W20260709 12:10:58.053382  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 102722us
I20260709 12:10:58.054850  4875 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:58.062611  5022 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:10:58.069000  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 534) took 1092 ms. Trace:
I20260709 12:10:58.069907  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:10:58.071180  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 251019us
I20260709 12:10:58.072144  8644 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.072626  8644 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:58.073091  8644 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.077250  8505 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.081280  8510 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.084736  8300 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.085239  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:58.085868  5024 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 3.
I20260709 12:10:58.091650  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:58.099649  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:58.085207  8300 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.102428  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:58.107409  8488 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.107939  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 69084.8us
I20260709 12:10:58.108067  8488 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.109602  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:58.110190  8488 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.107630  4869 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:58.113243  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:58.113204  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:58.069432  4948 rpcz_store.cc:276] 0709 12:10:56.964356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.966660 (+  2304us) service_pool.cc:224] Handling call
0709 12:10:56.966925 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.967215 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.967242 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.795236 (+827994us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b2c00010c48. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a591e3a11 00007f2a591f3372 00007f2a5a925a01 00007f2a5a8ea43a 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2
0709 12:10:57.816274 (+ 21038us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.969327 (+153053us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:57.969382 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.969493 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.046923 (+ 77430us) raft_consensus.cc:1685] finished
0709 12:10:58.046940 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.057131 (+ 10191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":336,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":39265,"spinlock_wait_cycles":51774336,"thread_start_us":143747,"threads_started":1,"wal-append.queue_time_us":190274}
I20260709 12:10:58.112785  4872 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:10:58.118264  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:58.119004  8552 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.119515  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:58.120707  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:58.123804  5568 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:58.124557  4871 raft_consensus.cc:2368] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:58.125874  8626 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:58.126304  8626 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.127291  8552 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.129132  8518 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:58.129740  8518 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.131669  8518 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.135015  8506 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.135598  8506 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.137885  8506 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.138478  4915 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:58.141129  8620 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.141284  8629 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:58.141088  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:58.141649  8620 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.132450  8595 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.138387  8506 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.156945  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 47451.1us
I20260709 12:10:58.141440  8488 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:58.147557  8626 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:58.164304  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 65547.5us
I20260709 12:10:58.159257  5567 leader_election.cc:400] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:10:58.162168  8506 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.168154  4873 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 10: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:58.157136  8300 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.170862  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:58.155561  8620 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.129702  8525 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:58.177165  8629 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:58.181214  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:58.184926  8633 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.185582  4867 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:10:58.186962  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:58.173828  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:58.187137  8681 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:10:58.188292  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:58.188983  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:58.191457  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:58.192845  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:58.194180  8506 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.197005  8484 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.197402  8498 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.197902  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:58.187582  8529 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.213372  8629 raft_consensus.cc:697] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:58.318226  4946 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:10:58.334728  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 217776us
I20260709 12:10:58.214103  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:10:58.325814  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.215139  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 100861us
I20260709 12:10:58.326617  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:58.214617  4990 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:58.322891  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.225193  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.223721  4944 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:58.221397  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.224376  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.224982  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.350679  4948 raft_consensus.cc:2393] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:58.289767  5023 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:58.317173  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.205181  8633 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.321420  8588 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.225244  8506 raft_consensus.cc:2764] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:10:58.358832  4950 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.335517  8642 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.361771  5021 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:10:58.364946  8493 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.365646  8650 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.365538  8493 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.366072  8650 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.366417  8650 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.367681  8493 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:58.368655  4945 raft_consensus.cc:2368] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:10:58.369573  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:58.371790  4950 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:10:58.332726  8645 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.175751  8595 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.325539  8620 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.358462  8633 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.375016  4841 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:58.374778  8493 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:10:58.377854  8588 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:10:58.378806  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.328869  8644 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.226683  8525 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.383472  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.214402  8629 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.353271  8589 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.378293  8588 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:58.388770  5025 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.334407  8524 raft_consensus.cc:359] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 8 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.385926  4948 raft_consensus.cc:2368] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:10:58.219745  8651 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.396016  5017 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:10:58.394387  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 179926us
I20260709 12:10:58.399684  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.400491  4950 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:58.400843  8488 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.401499  8488 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.403446  8488 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.389808  8518 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.385660  8642 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.411306  4869 raft_consensus.cc:2368] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:10:58.408968  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.420852  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.427114  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.427831  4950 raft_consensus.cc:2368] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:10:58.417515  8460 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.431283  4948 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:58.434096  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:58.431668  8498 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.446123  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.447118  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.443928  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:58.449800  4947 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:58.447896  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:58.450481  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.467845  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.468469  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:10:58.429662  8518 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:10:58.498996  8524 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:10:58.500130  8645 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.499841  8524 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:58.501116  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.442644  8460 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:58.503659  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 59647.9us
W20260709 12:10:58.505035  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 62109.4us
I20260709 12:10:58.452212  8529 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.513870  4948 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:58.518512  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.520290  8431 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:58.520884  8431 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:58.521808  8615 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:58.522419  8615 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.525008  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.521833  8431 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.525607  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.526280  4947 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:58.529134  8518 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.529361  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.529832  8525 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.530581  4840 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:58.524565  8615 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.533018  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.533615  4948 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:58.535461  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.506595  8510 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.509366  8644 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.539736  4948 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:58.512466  8620 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.545641  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.546294  4916 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:58.550115  4950 raft_consensus.cc:2368] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:10:58.448375  8588 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.510227  8432 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.547260  4946 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:58.553205  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.517776  8506 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.555116  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.534829  8589 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:58.557541  4948 raft_consensus.cc:2368] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:10:58.537961  8447 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:58.551354  8615 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:58.560099  4950 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:10:58.564399  4947 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:10:58.565248  8506 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.566370  5605 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:58.591861  4942 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:58.594548  8506 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:58.595227  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 170008us
I20260709 12:10:58.566272  8651 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.602208  8626 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.603132  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.570688  8510 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.604283  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.604979  4945 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:58.609221  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.609045  8432 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.597610  8524 ts_tablet_manager.cc:1434] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.596s	user 0.003s	sys 0.008s
I20260709 12:10:58.667940  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.668879  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.566744  8447 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.675684  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.670626  4946 raft_consensus.cc:2368] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:58.676434  4942 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:58.671715  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.677281  8447 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.678316  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.679314  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.682458  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:58.683468  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 259868us
I20260709 12:10:58.684216  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:58.683194  8691 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:10:58.689225  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.690155  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:10:58.686982  8456 consensus_meta.cc:287] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.002s
W20260709 12:10:58.674826  8524 ts_tablet_manager.cc:1467] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Tablet startup took 687ms
I20260709 12:10:58.691097  4945 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:58.688154  8505 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.699640  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.700225  4945 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:58.693604  8432 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.704391  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.706713  4950 raft_consensus.cc:2410] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:10:58.705070  5602 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:58.708194  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:10:58.709553  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 177782us
I20260709 12:10:58.710242  4945 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:58.714238  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.714900  5602 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:58.698292  8642 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:58.696566  8456 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.740437  5604 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:58.730983  8589 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:58.744552  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.732157  8510 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.748781  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.711899  8505 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.746723  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.778007  5025 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:10:58.749616  8460 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.785763  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.799538  8704 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:58.800395  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.800715  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:58.800424  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:10:58.801285  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54115.7us
I20260709 12:10:58.744009  8650 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.802784  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:58.804979  5601 raft_consensus.cc:2368] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:10:58.748234  8589 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.801640  5600 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.812889  8708 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:58.813467  8708 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:58.814227  8715 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:10:58.815145  8703 log.cc:927] Time spent T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:58.815702  8708 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:10:58.816664  8702 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:58.813386  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.823216  4990 leader_election.cc:400] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:10:58.823531  4990 leader_election.cc:403] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:58.825628  5606 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:58.790071  8620 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:10:58.837393  5600 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:10:58.839883  8650 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.841828  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.844982  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.844993  8719 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:10:58.847218  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.849587  8456 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.851049  8505 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:58.855537  4916 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:58.868367  5597 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 8 LEARNER]: Advancing to term 9
W20260709 12:10:58.870057  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 72169.4us
I20260709 12:10:58.869501  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:58.872083  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.873473  5567 leader_election.cc:400] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:10:58.874871  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.878340  4951 raft_consensus.cc:2393] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:10:58.879592  8705 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 12:10:58.879839  8714 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:10:58.871286  8615 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.876029  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:58.888141  8431 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:58.891899  8595 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:58.894146  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:58.895016  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:58.881247  8589 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:58.896737  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:58.892560  8626 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.896741  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:58.870769  8447 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.899693  4988 leader_election.cc:400] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:10:58.877935  8620 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.900420  4950 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:58.898849  8595 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:58.903755  8620 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.898312  8615 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.895658  8719 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:58.909689  8716 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:58.908128  8719 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:58.912595  8633 consensus_meta.cc:287] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.521s	user 0.004s	sys 0.004s
I20260709 12:10:58.913007  8633 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.913175  8719 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.913103  8716 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.913894  8716 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.907613  8615 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:58.914830  8633 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.910868  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.916556  8615 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.927855  4988 leader_election.cc:400] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:10:58.927477  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:58.930121  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:10:58.932935  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.937938  4840 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:58.942678  8607 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:58.943507  8447 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:58.942588  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:58.947652  4990 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:58.949579  8518 consensus_queue.cc:1059] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:58.950635  8518 raft_consensus.cc:3055] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:58.950963  8518 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:10:58.942683  8700 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.272s	user 0.001s	sys 0.002s
W20260709 12:10:58.695456  8524 ts_tablet_manager.cc:1469] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Trace:
0709 12:10:54.160511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.160703 (+   192us) service_pool.cc:224] Handling call
0709 12:10:54.324272 (+163569us) ts_tablet_manager.cc:934] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
0709 12:10:55.332882 (+1008610us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:55.522935 (+190053us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:55.523056 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:55.681207 (+158151us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:55.757980 (+ 76773us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:55.810696 (+ 52716us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:55.815077 (+  4381us) inbound_call.cc:177] Queueing success response
0709 12:10:56.266047 (+450970us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:10:58.008702 (+1742655us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:10:58.121296 (+112594us) tablet_replica.cc:261] Starting instrumentation
0709 12:10:58.150963 (+ 29667us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":23651,"raft.queue_time_us":3998,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2973,"tablet-copy.queue_time_us":91745,"tablet-download-pool.queue_time_us":531,"tablet-download-pool.run_cpu_time_us":921,"tablet-download-pool.run_wall_time_us":210482,"thread_start_us":99731,"threads_started":2}
I20260709 12:10:58.943981  8607 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:58.960182  8633 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.966456  4988 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:58.955032  8716 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.968935  8655 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:58.970268  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:58.971127  8655 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.972754  8655 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.972968  4988 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:58.973271  8655 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:58.973785  8645 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:58.974267  8645 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:58.974679  8645 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.974922  4988 leader_election.cc:400] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:10:58.975220  4988 leader_election.cc:403] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:10:58.976358  8607 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:58.977121  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.964661  8518 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.965622  8719 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.978931  8607 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:58.962534  4839 leader_election.cc:400] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:58.980937  4839 leader_election.cc:403] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:10:58.982786  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:58.967446  8706 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.974093  8589 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:58.967907  8633 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.966259  8595 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:58.985405  8633 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.986162  8300 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.985090  8595 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:58.988487  8595 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:58.988855  8716 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.989231  8716 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.989656  8716 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.990260  8518 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:58.989171  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.991647  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:58.992218  5605 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
W20260709 12:10:58.992885  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 55007.8us
I20260709 12:10:58.993537  4990 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:10:59.000417  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.002784  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.006544  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.007566  4946 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:59.008061  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.009367  8719 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.010967  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.018697  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.011453  8650 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.011715  8645 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.016924  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.019073  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:59.025197  5605 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:10:59.025379  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.031999  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.033485  8432 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:59.034078  8651 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.034705  8432 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:59.035081  8432 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:59.035895  8432 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.037209  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.038224  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.039740  8432 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.026518  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.049567  8300 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:10:59.026101  5018 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
W20260709 12:10:59.050133  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 56674.8us
I20260709 12:10:59.054847  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.055195  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.059278  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.061164  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.062289  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.062908  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.076593  4875 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:10:59.076989  5018 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:10:59.063700  8716 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.064252  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.064889  5017 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:59.066915  8626 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:59.019906  8706 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:59.068842  8645 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:59.053573  8510 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.087078  5019 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 5: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:10:59.056484  8644 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.049085  8588 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.063720  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.075444  5025 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:10:59.077359  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.081785  5022 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:10:59.082747  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.029769  8607 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.094094  5024 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:59.094769  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 68320.3us
I20260709 12:10:59.096127  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.097304  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.100697  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.095682  4871 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
W20260709 12:10:59.102749  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 96266.8us
I20260709 12:10:59.098727  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.103576  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.105855  4869 raft_consensus.cc:2410] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:59.106551  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.110539  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.110773  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.111129  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.111636  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.109640  8655 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:59.095870  8607 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.112584  8607 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.120893  8589 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:59.089149  8431 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.124637  8706 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.125734  8589 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:59.125093  8655 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:59.126894  8655 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.128717  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.128901  8655 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:59.129388  4870 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:10:59.110832  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.130180  4869 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:59.130275  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.089023  8510 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:59.131389  8510 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.134418  4873 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:10:59.123358  4917 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.136003  4876 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:10:59.140393  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.093044  8644 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:59.141768  8644 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.087906  8633 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:59.099134  8719 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.146517  8719 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.146881  8719 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.148952  8588 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.149482  8588 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.090426  8552 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:59.075855  8651 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:10:59.151363  8439 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.151680  8439 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:59.152182  8588 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:59.152446  8439 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.153928  8439 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.155364  5024 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:59.155736  8716 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:59.157395  5019 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.159710  8547 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.161705  4868 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:10:59.135349  8645 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:59.163976  5016 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:59.168011  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.169121  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.169672  4951 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.174430  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:59.179353  4951 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:59.187117  8650 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:10:59.159260  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.193007  4917 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.193766  8708 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.199095  4948 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:10:59.202428  5017 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:10:59.206521  5601 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:10:59.206812  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 68905.8us
I20260709 12:10:59.207684  4988 leader_election.cc:400] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:10:59.210176  8588 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:59.213037  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.214110  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:10:59.220467  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.220785  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:10:59.215102  8650 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:10:59.206022  8518 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:59.227777  8518 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:59.228669  8518 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.234087  4873 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
W20260709 12:10:59.235553  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.237962  4951 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:10:59.233461  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.159348  8510 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.245214  8633 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:59.253259  8650 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:59.255435  8633 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:10:59.256333  8633 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.246116  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.246927  8655 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.263226  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.264331  5017 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:59.219169  8439 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.242729  8719 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.276559  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.277103  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.280962  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.299098  8713 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:59.300393  5567 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:10:59.301019  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.301548  8493 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:59.302076  8493 raft_consensus.cc:697] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:10:59.302983  8493 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.303826  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.307847  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.312516  4875 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 9: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:10:59.313163  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.315850  5020 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:59.281591  8655 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:59.318100  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 72062.4us
I20260709 12:10:59.281706  8439 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:10:59.269816  8644 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.323415  4991 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.327144  4868 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.317759  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.320365  8645 raft_consensus.cc:1027] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: attempt to promote peer ab9da67236874634be59ebfd05b18255: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:10:59.325630  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.325865  5016 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:59.339936  4873 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:10:59.341638  5025 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.345502  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.347118  5021 raft_consensus.cc:2393] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:59.340065  8650 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:59.354272  4874 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:59.356299  4991 leader_election.cc:400] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:59.356603  4991 leader_election.cc:403] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:59.353992  4951 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 6 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:10:59.345006  8713 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.364239  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.364979  5016 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 9: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:10:59.372169  8510 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:59.373195  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:59.371071  8650 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 4. Current term is 5.
I20260709 12:10:59.376147  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.377133  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.380407  5568 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.382807  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.384032  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.387302  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.388654  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-3da8832a07224abb9a1f8815f3dcd745 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:10:59.388748  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.389305  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-3da8832a07224abb9a1f8815f3dcd745 on tablet 3da8832a07224abb9a1f8815f3dcd745 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.393414  5022 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:59.364305  8439 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.394183  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.395514  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.381166  8713 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.398772  8713 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:59.399533  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.398463  8607 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.414319  4869 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:59.415539  4871 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:59.416993  5568 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.423110  8725 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:59.423334  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.424201  4870 raft_consensus.cc:2410] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:59.424278  8719 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:59.469455  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 75349.9us
I20260709 12:10:59.469376  4876 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:59.472903  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.476053  4867 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.472688  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.477257  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.424403  8725 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.419866  8626 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.484581  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.485286  8607 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:59.475888  8650 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.487123  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.488149  8719 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:59.479192  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.485884  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.476540  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.488592  4773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 177) took 3160 ms. Trace:
W20260709 12:10:59.530681  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 49207.8us
I20260709 12:10:59.538937  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:59.539866  4839 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.540450  4988 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.485296  4950 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:10:59.490931  4876 raft_consensus.cc:2410] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:10:59.545399  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:10:59.554077  4991 leader_election.cc:400] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:10:59.487056  8644 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:10:59.558027  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 81560us
I20260709 12:10:59.568362  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:10:59.574947  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:10:59.556819  8749 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:10:59.577878  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 159839us
I20260709 12:10:59.555735  8595 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.551765  8588 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:59.555565  8713 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:59.574615  8439 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.569890  8615 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.543272  8706 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:59.617775  8713 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:10:59.622534  5570 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.616575  8588 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:59.627909  4761 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7d89e729329948059879ed6f44a07690 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:10:59.632110  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 72513.2us
I20260709 12:10:59.642650  4991 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:59.646708  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.545828  4773 rpcz_store.cc:276] 0709 12:10:56.327866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.328433 (+   567us) service_pool.cc:224] Handling call
0709 12:10:59.488503 (+3160070us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:58.188056 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:58.188699 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:58.188745 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:10:58.188783 (+    38us) tablet.cc:662] Decoding operations
0709 12:10:58.189197 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:58.189275 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:58.189300 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:58.189599 (+   299us) tablet.cc:701] Row locks acquired
0709 12:10:58.189643 (+    44us) write_op.cc:260] PREPARE: finished
0709 12:10:58.189814 (+   171us) write_op.cc:270] Start()
0709 12:10:58.189964 (+   150us) write_op.cc:276] Timestamp: P: 1783599058189744 usec, L: 0
0709 12:10:58.190001 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:10:58.190744 (+   743us) log.cc:844] Serialized 533 byte log entry
0709 12:10:58.886878 (+696134us) op_driver.cc:464] REPLICATION: finished
0709 12:10:58.926558 (+ 39680us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a577e00ac 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5e320ef0
0709 12:10:59.131449 (+204891us) write_op.cc:301] APPLY: starting
0709 12:10:59.131544 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:59.131653 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:59.131698 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:59.132003 (+   305us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:59.132271 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:59.132321 (+    50us) write_op.cc:312] APPLY: finished
0709 12:10:59.132547 (+   226us) log.cc:844] Serialized 23 byte log entry
0709 12:10:59.132738 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:59.133930 (+  1192us) write_op.cc:454] Released schema lock
0709 12:10:59.204948 (+ 71018us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:59.241928 (+ 36980us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:59.241959 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":244283,"apply.run_cpu_time_us":1903,"apply.run_wall_time_us":88247,"num_ops":1,"prepare.queue_time_us":190418,"prepare.run_cpu_time_us":14445,"prepare.run_wall_time_us":186739,"raft.queue_time_us":345555,"raft.run_cpu_time_us":88293,"raft.run_wall_time_us":158179,"replication_time_us":688097,"spinlock_wait_cycles":2958208,"thread_start_us":566500,"threads_started":4,"wal-append.queue_time_us":311000}]]}
I20260709 12:10:59.647307  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:10:59.648223  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.653311  5020 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:10:59.651060  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:10:59.655455  5025 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.656337  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.660784  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.658217  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.638669  8510 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:59.664215  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.664898  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.665735  4991 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.619109  8704 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:59.654150  8595 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:10:59.696767  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:59.697880  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49666.7us
I20260709 12:10:59.706575  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:10:59.705685  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51827us
I20260709 12:10:59.666798  8645 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.714974  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.720955  5025 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:10:59.721845  4840 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.661311  8753 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:59.668437  8655 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.737162  8753 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:59.739035  8753 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.746527  8753 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.748636  8753 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:10:59.754105  8751 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:10:59.664031  8589 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:10:59.756753  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.760353  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.667120  8650 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:10:59.722820  8626 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:59.669265  8510 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:10:59.755888  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 90159.1us
I20260709 12:10:59.737504  8456 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:59.765991  8743 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 12:10:59.767328  8754 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:10:59.768232  8750 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:10:59.751650  8447 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:10:59.769209  8447 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.769490  8498 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:59.770015  8498 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:59.770453  8498 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:59.771118  8447 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:59.771652  8447 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:59.771958  8447 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.772256  8447 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:59.763181  8642 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.775635  8588 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:59.776167  8588 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:59.777942  8713 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:59.782555  8510 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:59.763940  8626 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:59.783442  8626 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:10:59.769577  8740 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 12:10:59.763365  5570 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.789135  5570 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.791438  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.794482  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.736706  8595 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:59.793609  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:10:59.786463  8745 log.cc:927] Time spent T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:10:59.796458  8650 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.794209  8525 consensus_queue.cc:1059] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:10:59.812242  8525 raft_consensus.cc:3055] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.812572  8525 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:10:59.813418  8525 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.809406  8753 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:10:59.796674  8704 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:59.807009  8456 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.814442  8525 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:59.797360  8748 log.cc:927] Time spent T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.217s	user 0.002s	sys 0.002s
I20260709 12:10:59.815716  4991 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.789937  8725 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:10:59.811121  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 59157us
W20260709 12:10:59.829493  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 107725us
I20260709 12:10:59.830718  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.796165  8498 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.837157  8645 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.837690  8645 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.839635  8645 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:10:59.841915  8719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:54508 (request call id 17) took 6582 ms. Trace:
I20260709 12:10:59.842384  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.819149  8650 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.840514  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.798045  8642 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:10:59.851004  4988 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:10:59.861131  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.861863  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:10:59.858986  8713 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.863494  8713 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:59.863840  8713 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.860853  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:10:59.873586  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:10:59.874711  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.881070  5598 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:59.881995  5601 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:59.881239  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:10:59.843366  8769 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.862722  8650 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:59.892786  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 51546.2us
I20260709 12:10:59.873848  8439 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.897864  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.906894  5022 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:59.886466  8716 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:59.909046  8716 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:10:59.909408  4770 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 10, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.909413  8716 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.912318  8766 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.887020  8588 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:10:59.915720  8456 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.933633  4770 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 9, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 9 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.923594  8651 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.946801  8767 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:10:59.954504  8777 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:10:59.954999  8777 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.959434  8626 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:10:59.961971  8760 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:10:59.961414  8777 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:59.961901  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.964022  8626 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:59.965626  8447 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.967865  8626 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.842821  8719 rpcz_store.cc:276] 0709 12:10:53.268325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.390251 (+121926us) service_pool.cc:224] Handling call
0709 12:10:53.401421 (+ 11170us) log.cc:844] Serialized 499 byte log entry
0709 12:10:59.841811 (+6440390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":240,"raft.run_cpu_time_us":1524,"raft.run_wall_time_us":2164,"thread_start_us":213019,"threads_started":1,"wal-append.queue_time_us":228985,"wal-append.run_cpu_time_us":1617,"wal-append.run_wall_time_us":1001617}
W20260709 12:10:59.977828  4822 auto_rebalancer.cc:629] Failed to schedule move for tablet fedd910b0097474d987abca8337e4e48: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:59.979475  8518 raft_consensus.cc:993] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:59.979995  8518 raft_consensus.cc:1081] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:10:59.980485  8626 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:10:59.981626  5025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55722
I20260709 12:10:59.982265  5025 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:59.982597  5025 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.986001  8626 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:59.986868  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:10:59.987450  5017 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:10:59.989691  8713 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:10:59.993520  5602 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.991546  8713 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:10:59.993428  5603 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 LEARNER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:10:59.995823  5598 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.997695  8498 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:10:59.997747  8725 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.018962  8725 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:00.019757  8725 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.021266  8725 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.021194  4770 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.023039  4770 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 5 to 6, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 6 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.013427  4949 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:11:00.014207  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:00.014775  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:00.025763  5025 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.016224  8757 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:00.026829  8644 raft_consensus.cc:1064] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:00.029281  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:00.028971  8644 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.031615  5568 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:00.032439  5601 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:00.032867  5024 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:00.032953  8493 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:00.033394  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:00.031929  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:00.034277  5605 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.033388  8493 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.037029  8493 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.038164  5603 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:00.039255  8771 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:00.040568  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.042361  8525 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.042356  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.044284  5022 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:11:00.044284  8762 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:00.044938  8644 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:00.044539  8670 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.044665  8547 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:11:00.047072  4917 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.051538  8547 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.051919  8547 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:00.052187  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 154400us
I20260709 12:11:00.052234  8547 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.053802  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.054881  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.055555  5022 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:11:00.055794  8771 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.056463  8771 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.058288  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.058806  5025 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:00.059356  8518 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.059566  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:00.060119  5602 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.070232  5602 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:11:00.077606  4990 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:00.057543  4840 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.077700  5605 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:00.081866  4917 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.087203  4840 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.005303  8447 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:00.109658  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:00.087884  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 69888.5us
I20260709 12:11:00.084048  8783 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.112118  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.114017  4917 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.085134  8644 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:00.110149  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:00.120513  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:10:59.997635  8716 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:00.121140  8447 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.123322  8766 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.123694  8510 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:00.124202  8756 consensus_queue.cc:1059] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:11:00.086760  8607 consensus_queue.cc:1059] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:11:00.125072  8716 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:00.122818  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.110734  8761 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.129041  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:00.113128  8762 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.115727  8552 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.118359  8708 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:00.116137  8529 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.109045  8713 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:00.130462  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:00.132194  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:00.132735  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:00.136360  4873 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:11:00.132371  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:00.086820  8431 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:11:00.122303  8644 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:00.133905  8615 raft_consensus.cc:3055] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.130937  8447 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:00.130052  8716 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:00.133730  8708 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:00.148528  8708 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:00.143846  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:00.144362  4839 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:00.145541  8778 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:11:00.145727  8644 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.146247  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:00.137152  8762 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:00.155750  8772 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:00.161126  4874 raft_consensus.cc:2393] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:00.146265  8547 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:00.143028  8615 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:00.163072  8762 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:00.237175  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 78769.8us
I20260709 12:11:00.233893  8493 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.235507  4876 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:00.234727  8761 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:00.245677  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 85401.5us
I20260709 12:11:00.255096  8547 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:00.256098  8529 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:00.261085  8493 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:00.261797  5598 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:00.263892  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:00.264456  5016 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.267908  8615 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:00.269239  8615 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:00.271245  8789 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:11:00.280136  4950 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:00.286266  5016 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:00.287447  5568 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:00.291493  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.283789  4949 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:00.294866  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:00.301242  5602 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:00.302277  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:00.302938  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:00.303438  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:00.305651  5570 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:00.306499  4991 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:00.309365  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:00.309913  5023 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.310096  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:00.312942  4873 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:00.316063  4875 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:11:00.316398  4875 pending_rounds.cc:85] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 8
I20260709 12:11:00.331419  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.333402  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:00.338058  4950 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.338436  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:00.339763  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:00.341001  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:00.334547  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:00.343729  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:00.316602  4875 pending_rounds.cc:107] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:11:00.284478  8756 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:11:00.366286  5024 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:00.372251  4875 raft_consensus.cc:2889] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.372869  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:00.296631  8704 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:00.346405  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:00.375243  5021 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:00.282742  8447 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:00.340976  8773 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.332309  8778 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:11:00.344681  8753 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:00.345690  8777 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:00.345842  8642 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:00.346025  8633 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:00.391419  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 50488.7us
W20260709 12:11:00.388701  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 45059.6us
I20260709 12:11:00.414281  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:00.341584  8719 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:11:00.385226  8704 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:00.375300  8766 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.395433  4950 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:00.417896  4945 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.397250  8769 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.420224  4991 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:00.432665  8779 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.421502  8650 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:00.436075  8793 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:11:00.449394  4869 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:11:00.449616  8787 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:11:00.450152  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:00.450767  8704 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.453752  8792 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.454298  8792 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.456079  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:00.434974  8766 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.461232  4874 raft_consensus.cc:1240] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:00.463868  8794 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:11:00.468781  4822 auto_rebalancer.cc:629] Failed to schedule move for tablet 9752c5a68f0f415b848ef1da168f8d82: Illegal state: Replica 4f3bf546572147c3abe4522189e86ce6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
W20260709 12:11:00.469394  8795 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:11:00.470464  8670 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.470872  8670 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:00.471683  8670 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.474581  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.495110  8719 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:00.496563  4945 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:00.486073  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.524644  4840 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.532356  5023 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:00.553138  8588 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.543521  8439 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.548705  8670 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.551626  8771 raft_consensus.cc:3055] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.540591  8595 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:11:00.583599  4869 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.560221  8771 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:00.581184  8456 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:00.600262  8758 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:11:00.578526  8813 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:11:00.600126  8607 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.612061  8802 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:00.612564  8802 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.614748  8802 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:00.598773  8456 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.616992  8456 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:00.596644  8708 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:00.622821  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:00.625701  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:00.626778  8766 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:00.627578  8725 consensus_meta.cc:287] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.003s
I20260709 12:11:00.617522  8607 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:00.633965  4943 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:00.647522  8767 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:00.647985  8767 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:00.649967  8767 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:00.631848  8771 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:00.659526  8771 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.664242  8607 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.665222  8607 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.670365  8708 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:00.673540  8759 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.673946  8759 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:00.674803  8759 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.676035  8759 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.721678  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:00.727094  4942 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.727438  4942 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:00.725030  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 58749.4us
I20260709 12:11:00.734433  5016 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:00.738912  5016 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.741036  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:00.743310  4942 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.746747  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:00.751979  4942 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:00.809163  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 55379.7us
I20260709 12:11:00.742532  8651 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:00.812084  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:00.747640  8439 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:11:00.815784  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54732.4us
I20260709 12:11:00.816497  4872 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.756603  8713 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.810061  8645 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.844184  4873 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:00.809508  8792 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:00.817318  8644 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:00.825654  8813 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:00.827029  8589 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:00.813308  8716 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:00.871840  8804 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:00.875453  4839 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:00.876797  5606 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:00.883181  8793 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:00.885288  8821 log.cc:927] Time spent T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:11:00.877828  8818 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:00.887382  4948 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:00.887761  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 413987us
I20260709 12:11:00.884647  8817 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:11:00.897974  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.898948  8826 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.899585  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 281) took 3307 ms. Trace:
I20260709 12:11:00.819631  8439 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.901049  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:00.819417  8651 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.817749  8773 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:00.934206  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:00.972275  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
W20260709 12:11:00.905925  8819 log.cc:927] Time spent T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:11:00.946693  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 71335us
I20260709 12:11:00.947849  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:00.939067  8794 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 12:11:00.943687  8793 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:00.955067  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:00.956037  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:00.918203  8655 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:00.968000  4947 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:00.942375  8813 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:00.963232  8713 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:00.966135  8824 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.939203  8644 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:00.991997  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 233978us
W20260709 12:11:00.993379  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 141799us
I20260709 12:11:00.945971  8589 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:00.997089  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.969481  8792 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:00.966252  8804 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:00.962908  4770 rpcz_store.cc:276] 0709 12:10:57.591839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.591979 (+   140us) service_pool.cc:224] Handling call
0709 12:11:00.899516 (+3307537us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:00.234330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:00.263744 (+ 29414us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:00.263776 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:11:00.263793 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:00.264357 (+   564us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:00.264408 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:00.264441 (+    33us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:11:00.264831 (+   390us) tablet.cc:701] Row locks acquired
0709 12:11:00.264849 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:11:00.264969 (+   120us) write_op.cc:270] Start()
0709 12:11:00.265068 (+    99us) write_op.cc:276] Timestamp: P: 1783599060264931 usec, L: 0
0709 12:11:00.265085 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:11:00.265622 (+   537us) log.cc:844] Serialized 1684 byte log entry
0709 12:11:00.473324 (+207702us) op_driver.cc:464] REPLICATION: finished
0709 12:11:00.610868 (+137544us) write_op.cc:301] APPLY: starting
0709 12:11:00.610953 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:00.611096 (+   143us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:00.611204 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:00.611789 (+   585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:00.612004 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:11:00.612047 (+    43us) write_op.cc:312] APPLY: finished
0709 12:11:00.612244 (+   197us) log.cc:844] Serialized 41 byte log entry
0709 12:11:00.612387 (+   143us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.612478 (+    91us) write_op.cc:454] Released schema lock
0709 12:11:00.612514 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:00.612924 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.612954 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":127235,"apply.run_cpu_time_us":2037,"apply.run_wall_time_us":2037,"num_ops":4,"prepare.queue_time_us":123163,"prepare.run_cpu_time_us":5870,"prepare.run_wall_time_us":53109,"raft.queue_time_us":52256,"raft.run_cpu_time_us":25140,"raft.run_wall_time_us":133445,"replication_time_us":208072,"thread_start_us":141368,"threads_started":4,"wal-append.queue_time_us":63716}]]}
I20260709 12:11:01.011220  8651 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.026568  8439 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.027832  8813 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.031862  8793 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.033179  8793 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.035279  8644 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:01.037051  8589 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:00.970587  8817 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.041226  8817 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:00.995635  8655 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.043481  8655 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:00.995764  8824 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.045876  8824 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:00.966542  8818 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.984639  8510 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 12:11:01.004118  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.974133  8826 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.062799  8826 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.063275  8826 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:01.063745  8826 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:00.992355  8670 consensus_queue.cc:1059] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:11:01.066021  8670 raft_consensus.cc:3055] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:01.066376  8670 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:01.067133  8670 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:00.983471  8773 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.074029  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:01.051487  8804 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:01.051972  8829 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.004s
I20260709 12:11:01.003786  8833 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:01.068790  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:01.069023  4942 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:11:01.069866  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:01.070009  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:01.073424  5025 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:01.075023  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:01.096321  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:01.077139  4871 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:11:01.082376  5020 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:01.106431  4870 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:01.104261  8670 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.119187  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:01.138949  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:01.128067  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:01.140910  8832 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:11:01.144878  8447 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.145255  8447 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.145560  8447 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.152201  5605 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:01.140934  8826 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.153662  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:01.154229  5017 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:01.154989  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:01.157050  5020 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:01.159520  8773 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:01.161473  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:01.162524  8818 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.165728  5020 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:01.167117  8771 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:01.172092  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 206324us
W20260709 12:11:01.173062  4916 consensus_peers.cc:597] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f74ad2f73ca4aeda444924811dca81b. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:01.174539  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 204763us
I20260709 12:11:01.178385  5567 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:01.179507  5567 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:01.184095  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 198650us
I20260709 12:11:01.187006  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:01.187757  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:01.187877  4869 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:01.192324  4841 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:01.172668  8719 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.199640  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:01.200222  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:01.201671  5606 raft_consensus.cc:2393] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 11: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:01.202258  4943 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:11:01.203310  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.203446  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:01.207712  5606 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:01.184019  8552 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.185956  8802 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.214143  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:01.215052  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 57969.4us
I20260709 12:11:01.184113  8753 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.217229  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:01.217645  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.222280  4942 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:11:01.223176  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.224238  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.220110  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:01.224531  5567 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:01.225028  5606 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:01.225406  8769 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:01.203634  8719 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:01.205489  8784 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:01.226970  8719 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.228200  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.228791  4945 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:01.230960  8784 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.232959  8784 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:01.235455  8793 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:01.220109  8552 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.239494  8552 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.241322  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:01.241902  5605 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:01.243719  4916 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:01.248252  8745 log.cc:927] Time spent T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.431s	user 0.001s	sys 0.003s
I20260709 12:11:01.249470  8839 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.249862  8839 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.204933  8706 consensus_queue.cc:1059] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:11:01.250186  8839 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.255442  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 47352us
I20260709 12:11:01.201795  8771 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.222277  5597 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:01.259316  5606 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:01.260335  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.249894  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:01.269778  8806 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:01.270200  8838 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:01.270910  8838 consensus_queue.cc:1243] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer ab9da67236874634be59ebfd05b18255 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:01.214984  8633 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:11:01.277108  8633 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:01.277496  8633 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:01.277885  8719 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.278334  8633 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:01.279582  8633 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:01.280030  8719 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:01.281853  8447 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.288154  8447 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:01.298163  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 70797.3us
I20260709 12:11:01.299671  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:01.300112  5597 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.301494  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 115614us
I20260709 12:11:01.297542  8456 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:01.313982  4774 catalog_manager.cc:5697] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:01.317523  4774 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 6 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.326232  4774 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 10 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:01.331293  4774 catalog_manager.cc:5697] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 3 to 4, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 4 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.329706  8839 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.334821  4942 raft_consensus.cc:2368] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:11:01.333185  4774 catalog_manager.cc:5697] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.337988  4839 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:01.337296  4774 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 9 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:01.344013  8607 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:01.345122  8820 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.525s	user 0.002s	sys 0.003s
I20260709 12:11:01.347635  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.349367  5606 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:01.348583  8439 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:11:01.349251  8607 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.353574  8607 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.349341  5597 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:01.354758  8757 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:01.355159  8757 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:01.355602  8607 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:01.355970  8757 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.359658  5020 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:01.362636  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.363689  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.364986  4950 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:01.365993  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:01.366590  5016 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.366605  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:01.366670  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.366050  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.363185  4943 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
W20260709 12:11:01.353160  8835 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.319s	user 0.004s	sys 0.000s
I20260709 12:11:01.366094  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:01.371495  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:01.368754  4872 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:01.372910  4988 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:01.373034  5016 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:01.358671  4774 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 9, now has a pending config: VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65), VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66), VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67), NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 9 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:01.375523  4870 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:11:01.375828  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 72419.3us
I20260709 12:11:01.376416  4872 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:01.378492  4988 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:01.380131  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.380424  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:01.380709  4944 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:01.380985  4988 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:01.378254  4872 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.383163  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:01.383976  4872 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.384356  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:01.378113  8645 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.382989  8706 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:01.387950  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.382220  8595 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.389019  8595 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:01.387491  8785 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:11:01.391541  4915 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:01.392036  8848 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:01.392942  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:01.389436  8595 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.393638  4839 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:01.382110  8607 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:01.401001  8439 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:01.401716  8607 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:01.402276  8766 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.403573  5017 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:01.392529  8848 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.405892  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 2886) took 1116 ms. Trace:
I20260709 12:11:01.406232  4948 rpcz_store.cc:276] 0709 12:11:00.289453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.289655 (+   202us) service_pool.cc:224] Handling call
0709 12:11:00.887082 (+597427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.957744 (+ 70662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.405719 (+447975us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54001a3450. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:01.405840 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353359232}
I20260709 12:11:01.406787  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:01.406869  8848 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.408197  8848 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:01.408545  8848 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.408880  8848 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:01.409019  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:01.387735  8827 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:11:01.414523  5016 raft_consensus.cc:2393] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:01.387876  8706 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.415066  8706 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.416853  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 2927) took 1115 ms. Trace:
I20260709 12:11:01.417210  4873 rpcz_store.cc:276] 0709 12:11:00.301160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.313629 (+ 12469us) service_pool.cc:224] Handling call
0709 12:11:00.754312 (+440683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.844566 (+ 90254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.415485 (+570919us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b54001757d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:01.416648 (+  1163us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54001757d0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:01.416764 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218792064}
I20260709 12:11:01.417850  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:01.418535  4871 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:01.418913  8759 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.419294  8759 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:01.410456  8766 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:01.411161  4839 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:01.411641  8785 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:01.413261  8615 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:01.413798  4915 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:01.424142  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:01.422870  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:01.424695  5603 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.425340  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:01.426179  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:01.426560  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:01.426715  5016 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:01.429963  5017 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:01.418455  8767 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.399559  8719 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.434535  4839 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:01.441418  8850 ts_tablet_manager.cc:933] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:01.423557  8488 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:11:01.442497  8766 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:01.447279  5603 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:01.449404  5567 leader_election.cc:400] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:11:01.449702  5567 leader_election.cc:403] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:01.451992  4872 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:01.452278  4872 pending_rounds.cc:85] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 8
I20260709 12:11:01.452443  4872 pending_rounds.cc:107] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:01.452622  4872 raft_consensus.cc:2889] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:01.432927  8772 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.454396  8766 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:01.454881  8766 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.455382  8595 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.402689  8607 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.457044  8498 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.457525  8498 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.458247  8447 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 9 to 11, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:01.459448  8498 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:01.434294  8767 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:01.461537  8830 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:01.462249  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:01.462836  4871 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:01.431738  8713 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.464653  8766 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.465416  8595 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:01.465131  8759 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.466284  8759 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.466671  8766 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.421092  8839 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.433878  8439 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.471731  8439 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:01.472097  8439 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.473889  8767 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.475150  8767 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.447830  8525 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:11:01.471439  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:01.479439  8725 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.479805  8725 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.461560  8633 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:01.480792  8725 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.482080  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 47038.8us
I20260709 12:11:01.461048  8757 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:01.484105  5603 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:01.490479  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:01.491132  4871 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:01.492228  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:01.493822  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:01.495711  4916 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:01.500711  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:01.501454  5606 raft_consensus.cc:2393] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 11: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:01.502216  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:01.502588  5603 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 9 to 11, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:01.502745  5023 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.502485  8633 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:11:01.509173  8552 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:01.512894  8831 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.520995  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:01.485615  8456 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:11:01.454653  8706 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.537974  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.538581  4947 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:11:01.539674  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:01.529332  8792 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.571089  5016 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:01.572481  5023 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:01.520354  8753 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:01.581207  4950 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:11:01.560395  8651 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:01.609411  4988 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:01.610174  8650 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.610662  8650 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:01.611476  8650 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.574105  8792 raft_consensus.cc:697] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:01.627388  5021 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:01.657271  8850 tablet_copy_client.cc:323] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
W20260709 12:11:01.658954  8852 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 12:11:01.659628  8849 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:11:01.658232  8651 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:01.693262  8813 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.693776  8813 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.693917  8725 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.624553  8498 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:11:01.695947  8813 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:01.696892  8853 log.cc:927] Time spent T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:11:01.586048  8633 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 6 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:01.642057  8784 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.709645  8784 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.711689  8784 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:01.718585  4875 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:01.720014  8725 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:01.721076  5597 raft_consensus.cc:2368] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9.
I20260709 12:11:01.722381  8439 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.726893  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:01.727084  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:01.727469  4870 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:01.728302  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:01.731619  5016 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:01.731789  8447 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:01.733580  8447 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:01.733923  8447 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:01.734227  8772 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:01.734688  8447 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:01.735205  8772 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:01.735577  8772 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:01.735679  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:01.736377  8772 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:01.737859  8857 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:01.738226  4951 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 6 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:01.740363  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:01.741034  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d89e729329948059879ed6f44a07690 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:11:01.738101  8772 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.742334  8626 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.742777  8626 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.743103  8626 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.745088  8792 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.716203  8547 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:01.732161  4872 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.688482  4947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:01.736488  4942 raft_consensus.cc:2410] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:01.761960  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:01.764190  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:01.764734  4839 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:01.767197  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 250788us
I20260709 12:11:01.768642  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:01.764181  4870 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 6 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:01.774411  4872 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:01.775604  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:01.775985  8439 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.776533  8802 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.777108  8802 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:01.777948  4916 leader_election.cc:400] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9.
I20260709 12:11:01.778249  4916 leader_election.cc:403] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:01.779220  5598 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 6 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:01.779713  8848 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.783070  8848 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:01.784010  4950 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:01.747326  8706 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:01.788281  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:01.767958  5016 raft_consensus.cc:2955] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 9 to 11, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:01.797829  4944 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:01.798285  4947 raft_consensus.cc:606] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:01.800401  4947 raft_consensus.cc:614] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:01.801960  8851 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.119s	user 0.000s	sys 0.003s
I20260709 12:11:01.769456  8832 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.819217  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:01.820869  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:01.821401  5605 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:01.796046  8759 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.796376  8447 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:01.822209  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:01.852159  5605 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:01.830106  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:01.868656  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.866043  4942 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
W20260709 12:11:01.874349  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 44335.9us
I20260709 12:11:01.878381  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:01.825314  8766 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.816171  8840 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:01.857941  8488 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:02.034008  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 211857us
W20260709 12:11:02.035876  8807 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 12:11:01.900674  8816 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:01.777948  8802 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:01.899786  8832 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:02.057294  8793 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.824877  8771 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.221s
I20260709 12:11:02.038091  8756 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:02.041332  8826 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:02.039860  8840 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.075634  8826 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:02.077051  8826 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.082775  8773 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.083249  8773 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.052227  8833 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:02.085094  8773 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.085212  8833 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.027029  8766 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.040383  8488 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.110754  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.111274  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.112201  4942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "811353fb6b174f3e96608844f05794de"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:02.112733  4942 raft_consensus.cc:606] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:11:02.113088  4942 raft_consensus.cc:614] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:02.121538  5021 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:02.060289  8832 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:02.076478  8840 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.131053  4874 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:02.060272  8793 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.141018  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.100059  8725 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:02.166236  5567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.017s	sys 0.019s
W20260709 12:11:02.166555  5567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.017s	sys 0.019s
W20260709 12:11:02.166819  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 626143us
I20260709 12:11:02.187229  8713 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:02.187644  8713 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:02.188431  8713 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.198817  8713 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:02.199245  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 57406.8us
I20260709 12:11:02.212939  8863 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.213436  8863 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.218302  5605 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:02.088095  8833 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:02.126129  8716 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:11:02.236217  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:02.237824  5597 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:02.162537  8645 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:11:02.244560  5605 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:02.252045  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:02.232530  8771 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.259464  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:02.264292  8864 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:11:02.216856  8725 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:02.274784  8862 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:11:02.275974  8863 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:02.278808  8861 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:11:02.285108  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.289167  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.288672  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:02.290663  8757 consensus_meta.cc:287] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.788s	user 0.004s	sys 0.011s
I20260709 12:11:02.305732  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.308070  4944 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:02.306320  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.310436  4943 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:02.314538  4945 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
W20260709 12:11:02.299604  8547 consensus_meta.cc:287] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.546s	user 0.004s	sys 0.004s
W20260709 12:11:02.303459  8772 consensus_meta.cc:287] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.003s
I20260709 12:11:02.318917  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:02.320361  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.293450  8525 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:02.323295  4948 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:02.282661  8771 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.289265  8439 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:02.257511  8832 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.357951  4950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:02.358554  4950 raft_consensus.cc:606] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:02.364742  4916 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:02.369527  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.370100  4876 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
W20260709 12:11:02.370432  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.370311  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet 2f74ad2f73ca4aeda444924811dca81b from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:11:02.371001  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet 2f74ad2f73ca4aeda444924811dca81b from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-2f74ad2f73ca4aeda444924811dca81b
I20260709 12:11:02.372627  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:02.373896  8620 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.374300  8620 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:02.374646  8620 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.375746  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.376330  4874 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
W20260709 12:11:02.377310  8869 log.cc:927] Time spent T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:11:02.379168  8488 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.385254  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:02.386512  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.387108  5017 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:02.392241  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.405540  5025 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:02.408951  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:02.410331  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:02.419625  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:02.421160  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:02.408390  8792 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.416903  8839 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:02.428997  8773 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:02.435422  8865 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.455510  8793 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:02.458761  8838 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:02.468698  8792 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.483085  8865 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.477366  8773 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.477073  8813 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.500456  8725 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.497125  8883 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:02.511543  8773 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.514850  8883 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.516997  8883 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:02.519026  8868 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 12:11:02.520505  8877 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:11:02.522310  8626 consensus_meta.cc:287] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.779s	user 0.008s	sys 0.000s
I20260709 12:11:02.522697  8626 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.525070  8626 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.517514  8771 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.501771  8792 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.499946  8838 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:02.510421  8865 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.513509  8813 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:02.533501  8447 consensus_meta.cc:287] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 12:11:02.514022  8547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43238 (request call id 10) took 2034 ms. Trace:
I20260709 12:11:02.544560  4875 raft_consensus.cc:2410] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:02.549816  4946 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:02.550009  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:02.553332  8766 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:02.554250  8831 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:02.537189  8813 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.534271  8838 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.566610  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.573828  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.574534  5016 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:02.577589  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:02.575330  8759 consensus_meta.cc:287] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.701s	user 0.003s	sys 0.013s
I20260709 12:11:02.593379  8759 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9.
I20260709 12:11:02.603901  8838 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:02.605754  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 77731.5us
I20260709 12:11:02.582619  8773 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.545563  8547 rpcz_store.cc:276] 0709 12:11:00.473517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.474013 (+   496us) service_pool.cc:224] Handling call
0709 12:11:00.513654 (+ 39641us) log.cc:844] Serialized 499 byte log entry
0709 12:11:02.504556 (+1990902us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374184,"raft.queue_time_us":377822,"raft.run_cpu_time_us":1284,"raft.run_wall_time_us":1283}
I20260709 12:11:02.588677  8620 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.607928  4947 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
W20260709 12:11:02.611636  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 75394.9us
I20260709 12:11:02.613569  8838 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:02.614461  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:02.617470  4942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4428def03fb45c99d3538acc2628494"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:02.629633  4942 raft_consensus.cc:606] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:11:02.630219  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:02.628623  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:02.630931  5598 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:02.631567  8865 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.632943  8626 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.633378  8626 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.633993  8792 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.635236  8626 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.635936  8792 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:02.636739  4950 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:02.637135  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.638317  8620 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.641088  8865 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.641384  8651 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:02.592360  8813 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.641314  4944 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:02.645419  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:02.645934  4951 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.629582  5606 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:02.647601  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.651113  4943 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:02.651317  4951 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:02.652081  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:02.649521  5020 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:02.656738  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:02.653132  8894 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.657685  8894 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.659700  8894 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.654920  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.661422  4871 raft_consensus.cc:2368] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:11:02.657291  4868 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.667440  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.681507  4951 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:11:02.684451  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:02.685272  8784 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:02.685734  8784 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:02.686511  8784 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:02.687621  8880 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:11:02.690621  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:02.691306  5602 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:02.691577  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:02.687901  4868 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:02.693480  4961 tablet_copy_source_session.cc:215] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:02.654241  8447 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:02.697525  8813 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:02.695969  8447 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:02.699927  8447 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.702456  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:02.641839  8651 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:02.703136  5606 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:02.704831  8651 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.712549  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.714771  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:02.716493  8773 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.723865  4839 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:02.727589  5605 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:02.728437  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:02.729077  5016 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:02.727128  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:02.730871  5606 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.721264  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:02.733222  4945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:02.733806  4945 raft_consensus.cc:606] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:02.735519  4947 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:02.736603  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.739552  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:02.740123  5023 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.737216  5016 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:11:02.736603  4916 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:02.728153  5020 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:02.744587  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:02.741811  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.746131  5024 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:02.749687  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:02.749989  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:02.751924  4875 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:02.752481  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:02.754084  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.754851  4944 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:02.756160  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:02.730623  8813 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.742259  8651 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.770957  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:02.772182  5023 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:02.769876  5570 leader_election.cc:400] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:11:02.773029  5570 leader_election.cc:403] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:02.774019  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:02.774365  8850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f74ad2f73ca4aeda444924811dca81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:02.773209  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:02.775483  8896 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.777325  8525 raft_consensus.cc:993] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:02.777828  8832 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:02.778424  8832 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:02.778815  8890 raft_consensus.cc:1081] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:02.779253  8832 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.783363  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:02.783883  4945 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.784106  5606 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:02.790371  8651 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.752671  8645 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:02.790588  4945 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:02.764865  8894 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:02.793148  8894 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:02.793524  8894 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:02.799556  4875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:11:02.800055  4875 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:02.800364  4875 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.803826  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:02.804929  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:02.806057  8719 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.806507  8719 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.806823  8498 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:02.757786  8759 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:02.811326  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:02.762166  8813 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.807328  8498 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:02.803160  8651 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.820622  4875 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.777768  8525 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:11:02.825048  8547 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.825503  8547 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.827471  8547 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.813203  8626 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:02.829452  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 104794us
I20260709 12:11:02.808099  8895 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9.
I20260709 12:11:02.835084  8439 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:02.835695  8848 raft_consensus.cc:993] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:02.836270  8439 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.841459  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.842051  4871 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:02.836138  8848 raft_consensus.cc:1081] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:02.817494  8813 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.850895  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:02.857995  4947 raft_consensus.cc:3055] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.858615  4947 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:02.818066  8704 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:02.860199  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.860417  4875 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:02.860903  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:02.861413  5606 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.862146  8894 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:02.869122  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:02.868499  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:11:02.919822  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 51406.2us
I20260709 12:11:02.873004  8785 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:02.922919  8785 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.924944  8785 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.925417  8552 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.925773  8552 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.926082  8552 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.876585  5606 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:02.867152  8894 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.880084  4875 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:02.886013  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.836678  8439 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:02.892385  8704 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:02.930992  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:02.894397  8891 raft_consensus.cc:993] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:02.932691  8891 raft_consensus.cc:1081] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:02.895653  8498 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.932858  8645 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:02.933180  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:02.933408  8645 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.899529  5598 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:02.935292  4841 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:02.871449  4947 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.931922  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:02.937938  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:02.938596  5018 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:02.921265  4945 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:02.922086  8651 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.922427  8719 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.947697  4771 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.948184  8865 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:02.930941  4876 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:02.949064  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.945533  8771 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:02.949730  4950 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:02.949832  8771 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:02.950834  8771 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.954142  8552 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.956106  8552 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:02.945497  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:02.957479  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:02.958258  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:02.958947  4875 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 10: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:02.959029  8766 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.960254  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:02.960827  4873 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.946429  8439 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.947333  8645 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.931866  8704 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:02.976555  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.981333  4948 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:02.977164  4871 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:11:02.982093  4871 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:02.982447  4871 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.977725  4947 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.982690  5020 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4428def03fb45c99d3538acc2628494"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55722
I20260709 12:11:02.983210  5020 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:02.983484  5020 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.987998  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:02.988655  4948 raft_consensus.cc:2368] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11.
I20260709 12:11:02.990707  4868 raft_consensus.cc:2368] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10.
I20260709 12:11:02.959419  8766 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:02.996225  5020 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:02.998181  5020 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:02.999018  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:02.999567  4875 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.006283  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:03.006805  5020 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.979139  5017 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:03.008919  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:03.009254  4771 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 8, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:03.013294  4774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 288) took 4949 ms. Trace:
I20260709 12:11:03.014220  4947 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:03.013603  4774 rpcz_store.cc:276] 0709 12:10:58.064356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.064585 (+   229us) service_pool.cc:224] Handling call
0709 12:11:03.013212 (+4948627us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:01.582814 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:01.621282 (+ 38468us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:01.621316 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:11:01.621333 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:01.622131 (+   798us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:01.622201 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:01.622231 (+    30us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:01.622784 (+   553us) tablet.cc:701] Row locks acquired
0709 12:11:01.622801 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:01.622924 (+   123us) write_op.cc:270] Start()
0709 12:11:01.623021 (+    97us) write_op.cc:276] Timestamp: P: 1783599061622880 usec, L: 0
0709 12:11:01.623041 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:11:01.691579 (+ 68538us) log.cc:844] Serialized 3087 byte log entry
0709 12:11:02.379743 (+688164us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:02.580350 (+200607us) op_driver.cc:464] REPLICATION: finished
0709 12:11:02.622597 (+ 42247us) write_op.cc:301] APPLY: starting
0709 12:11:02.622684 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:02.622913 (+   229us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:02.622936 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:02.624949 (+  2013us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:02.625167 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:11:02.625210 (+    43us) write_op.cc:312] APPLY: finished
0709 12:11:02.625436 (+   226us) log.cc:844] Serialized 59 byte log entry
0709 12:11:02.648595 (+ 23159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:02.653917 (+  5322us) write_op.cc:454] Released schema lock
0709 12:11:02.655641 (+  1724us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:02.737178 (+ 81537us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:02.741669 (+  4491us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16458,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":42013,"apply.run_cpu_time_us":2569,"apply.run_wall_time_us":59141,"num_ops":7,"prepare.queue_time_us":181608,"prepare.run_cpu_time_us":120119,"prepare.run_wall_time_us":582505,"raft.queue_time_us":60174,"raft.run_cpu_time_us":7554,"raft.run_wall_time_us":42218,"replication_time_us":957183,"spinlock_wait_cycles":30370176,"thread_start_us":668938,"threads_started":4,"wal-append.queue_time_us":577758}]]}
I20260709 12:11:03.018869  4875 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:03.022100  4917 leader_election.cc:400] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10.
I20260709 12:11:03.022393  4917 leader_election.cc:403] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:03.022926  8547 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.023903  8850 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:57006 (request call id 747) took 1641 ms. Trace:
I20260709 12:11:03.024297  8850 rpcz_store.cc:276] 0709 12:11:01.382048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.382182 (+   134us) service_pool.cc:224] Handling call
0709 12:11:01.486264 (+104082us) ts_tablet_manager.cc:934] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
0709 12:11:02.730012 (+1243748us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:11:02.828064 (+ 98052us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:02.828177 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:11:03.023224 (+195047us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:11:03.023472 (+   248us) tablet_replica.cc:206] Creating consensus instance
0709 12:11:03.023757 (+   285us) ts_tablet_manager.cc:989] Replica registered.
0709 12:11:03.023811 (+    54us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":44855,"tablet-copy.queue_time_us":58714,"thread_start_us":158685,"threads_started":2}
I20260709 12:11:03.027834  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:03.028344  8716 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:03.028888  8645 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.029376  8645 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:03.030174  8645 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.025710  8850 tablet_copy_client.cc:806] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
W20260709 12:11:03.005196  8874 consensus_queue.cc:1175] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab9da67236874634be59ebfd05b18255" responder_term: 10 status { last_received { term: 10 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:03.031603  8850 tablet_copy_client.cc:670] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:03.028914  8716 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:03.037853  4873 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:02.976934  8595 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:03.039076  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:03.062049  5020 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:03.056404  4988 leader_election.cc:400] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11.
I20260709 12:11:03.062924  4988 leader_election.cc:403] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:03.005858  8766 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.038564  8894 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:03.039263  8439 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.055866  8595 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.081316  8792 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:03.081806  8792 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.083712  8792 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.090479  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:03.091116  4869 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:03.095623  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:03.096575  8620 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:03.096940  8620 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:03.097267  8620 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.102319  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:03.103012  5017 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:03.106828  8651 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.065160  8759 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.109216  8759 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:03.073642  8488 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.123569  4869 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:03.070761  8847 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11.
I20260709 12:11:03.126703  8813 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.080982  8595 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:03.137377  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 60083.7us
I20260709 12:11:03.146661  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:03.147178  4946 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:03.149189  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:03.144245  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:03.149674  4947 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:03.150089  5017 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.147480  4946 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:03.199352  4947 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:03.151968  8891 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:03.209796  8456 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:03.078889  8894 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.195308  8488 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:03.116585  8716 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:03.215591  5017 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:03.220731  4840 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:03.222115  8850 tablet_copy_client.cc:538] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:03.228646  8785 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:03.229192  8785 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:03.229954  8785 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.232885  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:03.233466  4947 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:03.214946  8874 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:03.235710  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:03.241744  8488 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.246832  4871 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:03.252108  4875 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.265326  4947 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:03.266527  4871 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:03.245208  8772 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.286443  8874 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:03.286720  4945 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:03.301084  8894 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.262557  8547 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10.
I20260709 12:11:03.264986  8872 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.310606  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:03.314540  4950 raft_consensus.cc:3055] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.314831  4950 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:03.286820  8874 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:03.319417  4950 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:03.345044  4950 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.342271  8850 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:03.338209  8773 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:11:03.338025  8651 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:11:03.352895  8766 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.306784  8772 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.355805  8766 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.356750  8772 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:03.364539  8909 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:11:03.311537  8872 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:03.372339  8759 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.372934  4946 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.316133  8620 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.377813  8620 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.381470  8872 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.386615  8874 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:03.387806  8874 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:03.397989  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 181934us
I20260709 12:11:03.399545  8655 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:03.400027  8655 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:03.402839  8655 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:03.406224  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:03.406560  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:03.406762  5023 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:03.407214  5025 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:03.408764  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:03.409432  4945 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:03.415915  4944 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:03.417465  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:03.420938  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 186123us
I20260709 12:11:03.426338  5017 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:03.430451  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:03.430994  5598 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.427000  4950 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:03.433481  5606 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:03.436750  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:03.441170  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:03.443567  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:03.445650  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:03.478528  4875 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:03.479347  5598 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
W20260709 12:11:03.481431  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 44748.1us
I20260709 12:11:03.482067  4869 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:03.482542  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:03.483544  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.484925  8833 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.485306  8833 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.485630  8833 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.486289  8759 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:03.486687  8759 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.487041  8759 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:03.498231  5598 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:03.499365  5017 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:03.502619  4869 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 12:11:03.502969  4869 pending_rounds.cc:85] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 10
I20260709 12:11:03.503165  4869 pending_rounds.cc:107] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 12:11:03.503376  4869 raft_consensus.cc:2889] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:03.514793  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:03.515534  4951 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:03.517427  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:03.518136  5603 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:03.521767  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:03.523099  5024 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:03.526816  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:03.529414  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:03.532706  8772 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.529935  4951 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.534638  4841 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:03.540316  4943 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:03.549523  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:03.550241  5598 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:03.553723  4990 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:03.554725  4946 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.533942  8813 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.533470  8772 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:03.570086  4951 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:03.534525  8785 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:03.500068  8833 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.540758  8773 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:03.568626  8769 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:03.549086  8498 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:11:03.573378  8813 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.577536  8716 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:11:03.615468  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 90851.2us
I20260709 12:11:03.597772  8813 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:03.595996  8704 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:03.593313  8595 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:03.634204  8917 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:03.644506  5025 raft_consensus.cc:2368] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11.
I20260709 12:11:03.646847  8813 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:03.652052  4946 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:03.661909  8595 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:03.662832  8833 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.665023  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:03.665555  5017 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.613114  8772 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.667887  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:03.668497  4875 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:03.676457  4868 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:03.666551  8915 log.cc:927] Time spent T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:11:03.682150  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.687639  5017 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:03.689782  4839 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:03.690864  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:03.691421  4868 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.699036  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:03.702106  5024 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:03.702805  4868 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:03.704934  8932 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.705482  8932 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:03.715243  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:03.715700  5017 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.720458  4876 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:03.720898  4876 pending_rounds.cc:85] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 9
I20260709 12:11:03.721140  4876 pending_rounds.cc:107] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:03.721376  4876 raft_consensus.cc:2889] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:03.724139  8650 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:03.724845  8921 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
I20260709 12:11:03.706288  8932 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.717139  8759 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:03.744055  8759 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.748075  8872 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.749140  4871 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:03.749828  5017 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:03.750149  8872 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:03.766225  8918 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:03.770550  4840 leader_election.cc:400] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11.
I20260709 12:11:03.770829  4840 leader_election.cc:403] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:03.771800  8771 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11.
I20260709 12:11:03.772763  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:03.773572  8655 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.774011  8655 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:03.774778  8655 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:03.778559  8865 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:03.781015  8769 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:03.782091  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:03.782740  5017 raft_consensus.cc:2368] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:11:03.785954  4840 leader_election.cc:400] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:11:03.787912  4840 leader_election.cc:403] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:11:03.801293  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 83619.6us
I20260709 12:11:03.796880  8874 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.810220  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:03.827253  4771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 315) took 5640 ms. Trace:
I20260709 12:11:03.831951  8874 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:11:03.827610  4771 rpcz_store.cc:276] 0709 12:10:58.207239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.321011 (+113772us) service_pool.cc:224] Handling call
0709 12:10:58.438097 (+117086us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:03.827192 (+5389095us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:03.336358 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:03.362596 (+ 26238us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:03.362631 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:11:03.362652 (+    21us) tablet.cc:662] Decoding operations
0709 12:11:03.363050 (+   398us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:03.363108 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:03.363136 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:11:03.363443 (+   307us) tablet.cc:701] Row locks acquired
0709 12:11:03.363461 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:11:03.363595 (+   134us) write_op.cc:270] Start()
0709 12:11:03.363703 (+   108us) write_op.cc:276] Timestamp: P: 1783599063363554 usec, L: 0
0709 12:11:03.363727 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:11:03.364372 (+   645us) log.cc:844] Serialized 923 byte log entry
0709 12:11:03.583906 (+219534us) op_driver.cc:464] REPLICATION: finished
0709 12:11:03.692277 (+108371us) write_op.cc:301] APPLY: starting
0709 12:11:03.697535 (+  5258us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:03.706790 (+  9255us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:03.715935 (+  9145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:03.740429 (+ 24494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:03.740624 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:11:03.740666 (+    42us) write_op.cc:312] APPLY: finished
0709 12:11:03.740900 (+   234us) log.cc:844] Serialized 29 byte log entry
0709 12:11:03.741054 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:03.741135 (+    81us) write_op.cc:454] Released schema lock
0709 12:11:03.741169 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:03.741502 (+   333us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:03.741533 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":320162,"reported_tablets":8,"spinlock_wait_cycles":82913536,"child_traces":[["op",{"apply.queue_time_us":94220,"apply.run_cpu_time_us":2044,"apply.run_wall_time_us":50883,"num_ops":2,"prepare.queue_time_us":269695,"prepare.run_cpu_time_us":2683,"prepare.run_wall_time_us":51114,"replication_time_us":211836,"thread_start_us":186133,"threads_started":2}]]}
I20260709 12:11:03.863530  8645 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:03.864130  8645 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:03.865926  8937 log.cc:927] Time spent T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:11:03.867403  8645 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:03.888177  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:03.899901  8919 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
W20260709 12:11:03.903949  8913 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.337s	user 0.000s	sys 0.002s
W20260709 12:11:03.905835  8922 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.322s	user 0.001s	sys 0.001s
I20260709 12:11:03.909946  4950 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:03.910405  4943 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:03.918534  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:03.919193  4951 raft_consensus.cc:2368] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:11:03.926386  4945 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:03.928438  4876 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:03.944554  5598 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:03.949443  8439 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:03.951812  5017 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:03.953137  8832 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:03.969712  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:03.970480  4946 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.975739  4942 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:04.105877  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 96438.7us
I20260709 12:11:04.111059  5023 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:04.114547  8878 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.115415  8878 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:03.982002  8833 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:11:04.121424  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:04.122912  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:04.130373  8933 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:04.130817  5598 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:04.127177  8929 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:04.133692  8939 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:11:04.134048  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:04.137358  5016 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:04.138258  4839 leader_election.cc:400] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8.
I20260709 12:11:04.138747  8932 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:04.138813  8838 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:04.140237  8785 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:04.141367  8826 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:04.143091  8785 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:04.143417  8785 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:04.144732  4946 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:04.144202  8785 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:04.145690  8785 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:04.150744  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:04.151602  8772 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:04.152087  8772 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:04.153625  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:04.154289  8772 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:04.165005  8891 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:04.185235  4945 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:04.200278  8848 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:04.263108  4946 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:04.269052  8772 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:04.263494  8850 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:11:04.271641  4988 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:04.276594  4869 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:04.277506  8838 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:04.292297  4948 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:04.297387  8785 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:04.299439  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:04.300266  4869 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:04.316128  4869 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:04.317559  8848 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:04.322721  5024 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:04.325245  8488 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:04.305321  8951 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:11:04.341012  4945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:04.306995  8645 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.357084  4945 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
W20260709 12:11:04.425205  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.469033  8949 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:11:04.468900  4945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:04.488752  4945 raft_consensus.cc:606] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
W20260709 12:11:04.362612  8944 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:11:04.362736  8931 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:04.304333  8772 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:04.521696  8953 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 12:11:04.491393  8552 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:04.553216  8552 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:04.555349  8552 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:04.555967  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 271512us
I20260709 12:11:04.357081  8706 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
W20260709 12:11:04.502310  8958 log.cc:927] Time spent T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:11:04.598372  8878 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:04.693605  8959 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.005s
W20260709 12:11:04.693713  8964 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:11:04.707723  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:04.708792  5025 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:04.710772  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:04.708011  4945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:04.714457  4945 raft_consensus.cc:606] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:11:04.714831  4945 raft_consensus.cc:614] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:04.730566  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 448545us
I20260709 12:11:04.732573  8899 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:04.737278  8865 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.743523  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:04.716562  8757 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.752650  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:04.756156  4945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:04.756793  4945 raft_consensus.cc:606] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
W20260709 12:11:04.763583  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 45930.3us
I20260709 12:11:04.767974  4915 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:04.745174  8865 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:04.752534  8757 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:04.783979  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:04.771700  8756 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:04.782020  8488 raft_consensus.cc:993] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:04.781610  8772 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:04.789965  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 58108.6us
I20260709 12:11:04.791007  8488 raft_consensus.cc:1081] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:04.814016  8757 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:04.815367  8865 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:04.818615  5024 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:11:04.832540  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49293.8us
I20260709 12:11:04.837543  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:04.838304  5024 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:04.845100  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:04.846159  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:04.847072  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:04.847857  4873 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:04.870682  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:04.878949  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 107889us
I20260709 12:11:04.880415  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:04.899380  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:04.901160  5017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55722
I20260709 12:11:04.901852  5017 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:04.902168  5017 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.900324  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:04.899290  4770 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:04.904980  4770 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 6 to 8, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:04.906239  4770 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 11 to 12, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 12 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:04.907415  4770 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 9, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:04.908740  4947 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 14 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:04.911540  4770 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:04.913100  4770 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 6 to 7, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:04.914430  4770 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 6 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 8 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:04.923056  4770 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 3 to 5, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 5 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:04.927160  4770 catalog_manager.cc:5697] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 6 to 8, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:04.949815  8833 raft_consensus.cc:993] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:04.950268  8833 raft_consensus.cc:1081] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:04.961388  4945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:04.961980  4945 raft_consensus.cc:606] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:04.962333  4945 raft_consensus.cc:614] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:04.962478  4770 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added, pending config changed, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:04.964828  4770 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:04.966156  4770 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:04.981139  5016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55722
I20260709 12:11:04.981694  5016 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:04.982007  5016 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.973078  4770 catalog_manager.cc:5697] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 3 to 4, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 4 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:04.976869  8772 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:04.988240  8772 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:04.990167  8772 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:05.001175  5021 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:04.994354  5017 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:05.009476  5016 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:05.011745  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:05.013576  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:05.013525  8772 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:05.014395  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:05.011693  5017 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:05.019079  4870 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:05.021641  8771 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:05.128014  4917 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:05.142990  5016 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:05.143843  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:05.144419  5598 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.145788  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:05.149431  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:05.150089  4868 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:05.108520  8850 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:11:05.154855  8488 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:05.102921  8831 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:05.158042  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:05.163836  5598 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:05.179483  5570 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:05.190580  4868 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:05.194566  8833 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:05.197654  4990 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:05.203461  8633 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.184320  8626 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:05.204285  5016 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.205446  8633 raft_consensus.cc:697] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:05.205868  8756 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:05.206362  8633 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:05.206795  8756 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.211894  8850 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:05.212853  8850 tablet_bootstrap.cc:492] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:05.213587  8850 ts_tablet_manager.cc:1403] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 1.931s	user 0.067s	sys 0.013s
I20260709 12:11:05.214126  8891 raft_consensus.cc:993] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:05.217077  8891 raft_consensus.cc:1081] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:05.181733  8831 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:05.210147  8756 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:05.242798  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 44291.3us
I20260709 12:11:05.250655  4917 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:05.252554  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:05.257910  4876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:11:05.258417  4876 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:05.258805  4876 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:05.258448  4875 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.272025  8769 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.272545  8769 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:05.275243  4945 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:05.279436  8891 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.305464  5016 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.321388  4876 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:05.322278  4875 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:05.238511  8756 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:05.300251  8982 log.cc:927] Time spent T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:11:05.331880  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:05.332427  4947 raft_consensus.cc:3055] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:05.334010  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:05.332695  4947 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:05.335939  8878 consensus_queue.cc:1059] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:05.336648  8878 consensus_queue.cc:1243] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer baa50eb5ed704004b7f391934a59d010 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:05.339747  8850 raft_consensus.cc:359] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:05.276366  8769 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:05.350041  4876 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:05.340583  8850 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:05.356235  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:05.356770  5021 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:05.358673  4916 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:05.360675  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:05.361719  8833 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:05.330368  8976 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:05.375473  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:05.376991  8850 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:05.388464  5021 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
W20260709 12:11:05.375038  8979 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:11:05.392319  4840 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:05.386770  8850 ts_tablet_manager.cc:1434] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.173s	user 0.008s	sys 0.000s
I20260709 12:11:05.378125  8833 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:05.399912  8831 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:05.401916  8838 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:05.423523  5603 raft_consensus.cc:1217] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:11:05.423662  8838 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:05.436452  8838 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:05.427603  8831 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:11:05.499327  8756 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.510577  4947 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:05.511734  4947 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:05.485590  8986 log.cc:927] Time spent T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 12:11:05.537252  8772 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:05.538415  8772 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:05.538897  8772 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:05.539881  8772 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:05.541299  8772 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:05.580375  4947 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
W20260709 12:11:05.588869  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 148128us
W20260709 12:11:05.582778  8878 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:11:05.591907  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:05.582626  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-2f74ad2f73ca4aeda444924811dca81b received from {username='slave'} at 127.0.0.1:43248
I20260709 12:11:05.594084  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-2f74ad2f73ca4aeda444924811dca81b on tablet 2f74ad2f73ca4aeda444924811dca81b with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:05.600210  4950 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:05.601677  4945 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:05.607012  8927 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:05.607494  8927 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:05.609272  5603 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:05.609428  8927 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:05.610813  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:05.611369  4867 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:05.612419  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:05.613206  8996 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:05.613595  8996 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:05.613929  8996 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:05.620920  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:05.632025  8447 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.632498  8447 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:05.634735  8447 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:05.636298  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:05.636446  8967 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.636304  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:05.636979  8967 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:05.637650  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:05.638164  5021 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:05.639912  4841 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:05.644415  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:05.645040  4867 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:05.651206  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:05.651741  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:05.652022  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:05.652547  4947 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:05.653084  5021 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:05.652936  4990 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:05.653923  8927 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:05.657241  8927 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.660391  8927 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:05.657387  8838 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:05.663260  8838 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.663579  8838 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:05.656906  8967 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:05.694635  8927 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:05.697937  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:11:05.705780  9000 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:11:05.712882  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:05.713424  4946 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:05.657196  8996 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:05.715539  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:05.716362  4950 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:05.716389  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:05.717079  5598 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:05.718983  4950 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:05.718449  8927 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:05.722389  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:05.725878  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:05.736656  8996 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:05.740347  8838 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:05.741564  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:05.743260  8838 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:05.743891  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:05.745906  5605 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:05.746411  5021 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:05.744926  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:05.741577  4867 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:05.747625  5603 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:05.748679  4841 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:05.748886  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:05.749388  4946 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:05.749739  8838 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:05.754073  8924 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:05.753948  8927 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.762849  4875 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:05.768561  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:05.769325  4946 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:05.769503  8967 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:05.770017  8967 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:05.770820  8967 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:05.782156  8927 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:05.802175  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:05.805298  4946 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:05.806950  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:05.807623  4946 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:05.829948  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 178) took 4420 ms. Trace:
I20260709 12:11:05.833204  4774 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.854242  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:05.855366  8927 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:05.835541  4770 rpcz_store.cc:276] 0709 12:11:01.409594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.409737 (+   143us) service_pool.cc:224] Handling call
0709 12:11:01.476538 (+ 66801us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b5400240090. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c60b2 00007f2a6073f759 00007f2a606d7a76 00007f2a606a8d58 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc
0709 12:11:05.829743 (+4353205us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:05.280123 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:05.364866 (+ 84743us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:05.364901 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:11:05.364918 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:05.419815 (+ 54897us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:05.422982 (+  3167us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:05.425006 (+  2024us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:11:05.461970 (+ 36964us) tablet.cc:701] Row locks acquired
0709 12:11:05.461993 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:11:05.462121 (+   128us) write_op.cc:270] Start()
0709 12:11:05.462232 (+   111us) write_op.cc:276] Timestamp: P: 1783599065462079 usec, L: 0
0709 12:11:05.462254 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:05.462862 (+   608us) log.cc:844] Serialized 5465 byte log entry
0709 12:11:05.727627 (+264765us) op_driver.cc:464] REPLICATION: finished
0709 12:11:05.754500 (+ 26873us) write_op.cc:301] APPLY: starting
0709 12:11:05.754581 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:05.754830 (+   249us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:05.754929 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:05.794124 (+ 39195us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:05.794396 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:11:05.794441 (+    45us) write_op.cc:312] APPLY: finished
0709 12:11:05.794734 (+   293us) log.cc:844] Serialized 95 byte log entry
0709 12:11:05.794892 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:05.795027 (+   135us) write_op.cc:454] Released schema lock
0709 12:11:05.795074 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:05.795420 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:05.795445 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":21,"spinlock_wait_cycles":144348416,"child_traces":[["op",{"apply.queue_time_us":26642,"apply.run_cpu_time_us":3254,"apply.run_wall_time_us":40911,"num_ops":13,"prepare.queue_time_us":107392,"prepare.run_cpu_time_us":6178,"prepare.run_wall_time_us":329134,"raft.queue_time_us":20703,"raft.run_cpu_time_us":6257,"raft.run_wall_time_us":46971,"replication_time_us":265233,"spinlock_wait_cycles":15616,"thread_start_us":278910,"threads_started":4,"wal-append.queue_time_us":116626}]]}
I20260709 12:11:05.848515  4774 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 10, term changed from 10 to 12, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 12 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:05.876861  4774 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 5 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:05.878219  8994 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.878727  8994 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:05.882550  8994 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:05.883769  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:05.884210  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:05.885043  4875 raft_consensus.cc:2410] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:11:05.886308  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:05.887814  8994 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:05.887883  4774 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 6 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65), VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66), VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67), VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 9 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:05.890024  4774 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:05.892038  4774 catalog_manager.cc:5697] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:05.893231  4774 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:05.898828  4950 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:05.899699  4774 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 7, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:05.901024  4774 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:05.902690  8996 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:05.904047  4774 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:05.913359  4774 catalog_manager.cc:5697] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:05.927604  5603 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 12 LEARNER]: Advancing to term 13
I20260709 12:11:05.936654  5603 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 13 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:05.937852  8447 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:06.080210  9000 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.117s	user 0.004s	sys 0.008s
I20260709 12:11:06.092201  5021 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:06.123198  4942 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:06.131448  8933 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:11:06.138696  8447 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:06.199551  4774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 282) took 3109 ms. Trace:
I20260709 12:11:06.200095  4771 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 10 to 11, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
W20260709 12:11:06.203850  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 51313.9us
I20260709 12:11:06.200906  4774 rpcz_store.cc:276] 0709 12:11:03.090060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.092910 (+  2850us) service_pool.cc:224] Handling call
0709 12:11:06.199484 (+3106574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:05.956460 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:05.957280 (+   820us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:05.957317 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:11:05.957330 (+    13us) tablet.cc:662] Decoding operations
0709 12:11:05.958209 (+   879us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:05.958262 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:05.958287 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:11:05.959149 (+   862us) tablet.cc:701] Row locks acquired
0709 12:11:05.959163 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:11:05.959384 (+   221us) write_op.cc:270] Start()
0709 12:11:05.959507 (+   123us) write_op.cc:276] Timestamp: P: 1783599065959249 usec, L: 0
0709 12:11:05.959526 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:11:05.961927 (+  2401us) log.cc:844] Serialized 4493 byte log entry
0709 12:11:06.097676 (+135749us) op_driver.cc:464] REPLICATION: finished
0709 12:11:06.098101 (+   425us) write_op.cc:301] APPLY: starting
0709 12:11:06.098177 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:06.098380 (+   203us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:06.098470 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:06.099462 (+   992us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:06.099656 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:11:06.099695 (+    39us) write_op.cc:312] APPLY: finished
0709 12:11:06.099963 (+   268us) log.cc:844] Serialized 83 byte log entry
0709 12:11:06.100095 (+   132us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:06.100211 (+   116us) write_op.cc:454] Released schema lock
0709 12:11:06.100254 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:06.100586 (+   332us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:06.100612 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6735,"reported_tablets":38,"spinlock_wait_cycles":22272,"child_traces":[["op",{"apply.queue_time_us":242,"apply.run_cpu_time_us":2444,"apply.run_wall_time_us":2444,"num_ops":11,"prepare.queue_time_us":29014,"prepare.run_cpu_time_us":3757,"prepare.run_wall_time_us":6968,"replication_time_us":138044}]]}
W20260709 12:11:06.209481  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51289.5us
I20260709 12:11:06.211246  8771 raft_consensus.cc:1064] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
W20260709 12:11:06.211709  8771 raft_consensus.cc:1068] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Unable to promote non-voter ab9da67236874634be59ebfd05b18255: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:11:06.204463  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 52619.5us
I20260709 12:11:06.203914  4771 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.216035  4771 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 11 to 12, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.217964  4771 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.219861  4771 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 9 to 11, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.220950  4875 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:06.224174  4771 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 10, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.226605  4771 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 10 to 13, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.229562  4771 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 6 to 7, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.231120  4771 catalog_manager.cc:5697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 7, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 7 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.232513  4771 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.234784  4771 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 10 to 12, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.236012  4771 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.238104  4946 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:06.237576  4771 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 7 to 8, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.239583  8655 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:06.246866  8924 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:06.301749  4773 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.308553  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d89e729329948059879ed6f44a07690 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:52362
I20260709 12:11:06.306411  4771 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 316) took 1971 ms. Trace:
I20260709 12:11:06.313515  4771 rpcz_store.cc:276] 0709 12:11:04.334667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.339961 (+  5294us) service_pool.cc:224] Handling call
0709 12:11:06.306335 (+1966374us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:06.247025 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:06.247499 (+   474us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:06.247531 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:11:06.247549 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:06.258867 (+ 11318us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:06.258924 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:06.258952 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:11:06.259995 (+  1043us) tablet.cc:701] Row locks acquired
0709 12:11:06.260010 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:11:06.260150 (+   140us) write_op.cc:270] Start()
0709 12:11:06.260249 (+    99us) write_op.cc:276] Timestamp: P: 1783599066260108 usec, L: 0
0709 12:11:06.260266 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:11:06.261078 (+   812us) log.cc:844] Serialized 5110 byte log entry
0709 12:11:06.263595 (+  2517us) op_driver.cc:464] REPLICATION: finished
0709 12:11:06.263998 (+   403us) write_op.cc:301] APPLY: starting
0709 12:11:06.264067 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:06.264327 (+   260us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:06.264409 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:06.265720 (+  1311us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:06.265949 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:11:06.265990 (+    41us) write_op.cc:312] APPLY: finished
0709 12:11:06.266247 (+   257us) log.cc:844] Serialized 95 byte log entry
0709 12:11:06.266388 (+   141us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:06.266510 (+   122us) write_op.cc:454] Released schema lock
0709 12:11:06.266558 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:06.266870 (+   312us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:06.266896 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13814,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":224,"apply.run_cpu_time_us":2854,"apply.run_wall_time_us":2854,"num_ops":13,"prepare.queue_time_us":331,"prepare.run_cpu_time_us":3973,"prepare.run_wall_time_us":16293,"replication_time_us":3206}]]}
I20260709 12:11:06.348321  4867 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:06.352797  9023 tablet_replica.cc:333] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:11:06.362313  9023 raft_consensus.cc:2243] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:06.363440  9023 raft_consensus.cc:2272] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:06.362821  8924 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:06.372429  9023 ts_tablet_manager.cc:1916] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:06.381347  8838 raft_consensus.cc:1064] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:06.383826  8838 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:06.391368  5603 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 13 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:06.392746  8874 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:06.401114  5017 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:06.401477  4946 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:06.402347  8933 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:06.403450  8874 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:06.418943  4774 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 13, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:06.418829  9017 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 10 to 12, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.422483  5017 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 10 to 12, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.424708  4946 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 10 to 12, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.433457  4774 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.435609  4774 catalog_manager.cc:5697] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:06.451553  4773 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 289) took 1180 ms. Trace:
I20260709 12:11:06.453295  5024 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:06.462858  5603 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 10 to 12, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.460574  4774 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.472034  4774 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.452371  4773 rpcz_store.cc:276] 0709 12:11:05.271515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.271844 (+   329us) service_pool.cc:224] Handling call
0709 12:11:06.354191 (+1082347us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:06.354219 (+    28us) write_op.cc:454] Released schema lock
0709 12:11:06.451499 (+ 97280us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:06.334243 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:06.334730 (+   487us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:06.334761 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:11:06.334788 (+    27us) tablet.cc:662] Decoding operations
0709 12:11:06.335100 (+   312us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:06.335150 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:06.335178 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:06.335349 (+   171us) tablet.cc:701] Row locks acquired
0709 12:11:06.335366 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:06.335485 (+   119us) write_op.cc:270] Start()
0709 12:11:06.335588 (+   103us) write_op.cc:276] Timestamp: P: 1783599066335451 usec, L: 0
0709 12:11:06.335610 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:11:06.336162 (+   552us) log.cc:844] Serialized 538 byte log entry
0709 12:11:06.337870 (+  1708us) op_driver.cc:464] REPLICATION: finished
0709 12:11:06.338262 (+   392us) write_op.cc:301] APPLY: starting
0709 12:11:06.338337 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:06.338426 (+    89us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:06.338503 (+    77us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:06.338685 (+   182us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:06.338820 (+   135us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:11:06.338862 (+    42us) write_op.cc:312] APPLY: finished
0709 12:11:06.339025 (+   163us) log.cc:844] Serialized 23 byte log entry
0709 12:11:06.339182 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:06.339268 (+    86us) write_op.cc:454] Released schema lock
0709 12:11:06.339318 (+    50us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":5821,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":222,"apply.run_cpu_time_us":1324,"apply.run_wall_time_us":1323,"num_ops":1,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":2158,"prepare.run_wall_time_us":2158,"replication_time_us":2151}]]}
I20260709 12:11:06.492688  5603 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:06.493468  4867 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:06.494024  9019 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:06.494858  8927 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:06.490813  4774 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.496796  4774 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.517558  9023 ts_tablet_manager.cc:1929] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:11:06.517997  9023 log.cc:1199] T 7d89e729329948059879ed6f44a07690 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/7d89e729329948059879ed6f44a07690
I20260709 12:11:06.525586  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39302
I20260709 12:11:06.526155  4875 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Received request to transfer leadership
I20260709 12:11:06.532243  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39302
I20260709 12:11:06.532723  4875 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Received request to transfer leadership
W20260709 12:11:06.533598  4761 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 2f74ad2f73ca4aeda444924811dca81b already in progress [suppressed 1 similar messages]
I20260709 12:11:06.539256  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 7d89e729329948059879ed6f44a07690 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:06.547456  9019 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.550328  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39302
I20260709 12:11:06.550827  4875 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Received request to transfer leadership
I20260709 12:11:06.550705  4867 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:11:06.558121  4822 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:11:06.558450  4822 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 2f74ad2f73ca4aeda444924811dca81b already in progress
W20260709 12:11:06.558717  4822 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 2f74ad2f73ca4aeda444924811dca81b already in progress
I20260709 12:11:06.561534  4773 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 10 to 12, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.563684  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3da8832a07224abb9a1f8815f3dcd745 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:06.563351  4773 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 13 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:06.551528  5603 raft_consensus.cc:2955] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.596441  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:06.656867  4769 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 8 to 9, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 9 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.680444  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da8832a07224abb9a1f8815f3dcd745 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:52362
I20260709 12:11:06.681432  9023 tablet_replica.cc:333] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:11:06.682538  9023 raft_consensus.cc:2243] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:06.683382  9023 raft_consensus.cc:2272] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:06.692625  9023 ts_tablet_manager.cc:1916] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:06.788126  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:06.788699  4867 raft_consensus.cc:606] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:11:06.796774  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:06.797827  4875 raft_consensus.cc:606] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:06.803062  9023 ts_tablet_manager.cc:1929] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 12:11:06.803476  9023 log.cc:1199] T 3da8832a07224abb9a1f8815f3dcd745 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/3da8832a07224abb9a1f8815f3dcd745
I20260709 12:11:06.810817  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 3da8832a07224abb9a1f8815f3dcd745 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:06.818353  5024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:06.819178  5024 raft_consensus.cc:606] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:06.827706  4873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:06.828197  4873 raft_consensus.cc:606] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:06.829429  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:11:06.831091  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:06.831776  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:06.835800  4760 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ab9da67236874634be59ebfd05b18255 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:06.841089  9017 raft_consensus.cc:993] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:06.841552  8987 raft_consensus.cc:1081] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:06.843101  5024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:11:06.843569  5024 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:06.843889  5024 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:06.850564  5024 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:06.854374  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:06.854961  4873 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:06.855261  4873 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:06.855978  4873 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:06.859409  4873 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:06.866961  4873 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:06.874029  5024 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:06.874591  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:06.875139  4945 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:06.875488  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:06.876014  5603 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:06.882259  5603 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:06.882769  4945 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:06.883550  4990 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:06.885026  8967 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:06.885519  8967 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:06.886358  8967 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:06.902908  4769 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 13 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:06.921319  8967 raft_consensus.cc:993] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:06.921738  8967 raft_consensus.cc:1081] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:06.923668  4946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52392
I20260709 12:11:06.924212  4946 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:06.924577  4946 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:06.932978  8987 raft_consensus.cc:993] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:06.933425  9017 raft_consensus.cc:1081] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:06.934976  4945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:11:06.935454  4945 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:06.935771  4945 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.941710  4945 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:06.944193  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:06.944753  4946 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:06.947476  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:06.947956  5024 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.943275  4945 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:06.949272  4946 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:06.951110  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:06.951617  5017 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:06.951906  5017 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:06.944800  4867 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:06.953307  4867 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:06.953948  4867 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:06.955035  4867 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.952553  5017 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:06.958843  5017 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:06.960407  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:06.961006  4875 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:06.968240  5024 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:06.977867  8987 raft_consensus.cc:993] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:06.980530  8933 raft_consensus.cc:993] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:06.979132  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:06.981024  8933 raft_consensus.cc:1081] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:06.981349  8987 raft_consensus.cc:1081] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:06.982511  4946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:11:06.983050  4946 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:06.980361  5017 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:06.983385  8756 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:06.984119  5024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:11:06.984517  8756 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:06.983417  4946 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.976780  4867 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:06.985548  8756 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:06.979809  4875 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:06.984637  5024 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:06.994612  5024 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.994874  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:06.996739  4946 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.004988  8547 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:07.005311  4946 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:07.005438  8547 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:07.006400  8547 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:07.011543  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:07.012036  5603 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.015502  5024 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.017943  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:07.018445  4867 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:07.018740  4867 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:07.019408  4867 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.020397  4867 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.027770  5603 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:07.028443  5598 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.031080  8838 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:07.031168  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:07.032166  8547 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.032112  8987 raft_consensus.cc:3055] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.032747  8987 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:07.033617  8987 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.034849  8987 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.036173  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:07.036656  5603 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.038153  5024 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:07.038822  8547 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:07.039670  8547 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.044360  5603 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:07.034873  4867 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:07.045531  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:07.047354  8655 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:07.049678  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:07.050276  8655 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:07.051164  8655 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.054955  4875 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:07.074095  4769 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:07.083142  4774 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 10 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:07.102926  4769 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 14 to 15, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 15 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.113859  4769 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:07.280920  8547 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.281451  8547 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.284102  8547 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:07.285014  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:07.285635  5603 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:07.285895  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:07.286684  5024 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:07.286653  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:07.288110  4875 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:07.289415  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:07.290530  8547 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:07.297737  4945 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:07.305321  8655 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:07.353781  4875 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:07.355273  8655 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:07.383432  5598 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:07.385315  8967 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:07.478236  5017 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:07.480304  8994 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:07.482923  4875 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:07.485932  8994 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:07.527109  4867 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:07.527666  4872 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:07.532151  8547 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:07.535477  8655 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:07.569804  5598 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:07.571414  9031 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:07.582194  5017 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:07.583520  8994 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:07.647114  4875 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:07.661087  5603 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:07.666077  9048 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:07.656230  8757 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:11:07.735275  8838 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.735705  8838 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.740029  8838 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:07.741144  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:07.741577  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:07.741750  5017 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:07.742158  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:07.743059  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:07.743623  4945 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:07.744462  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:07.745714  8838 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:07.746081  8838 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.746409  8838 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:07.758436  8838 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.762095  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:07.762661  4945 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:07.762852  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:07.763211  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:07.763777  5598 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:07.763425  5017 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:07.772779  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:07.777170  8838 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:07.778028  5017 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:07.780189  4840 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:07.781344  8933 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:07.781795  8933 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:07.782588  8933 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.784178  4945 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:07.811933  4770 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 15, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 15 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:07.818066  5017 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:07.824185  5598 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:07.828228  8967 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:07.841240  8655 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:07.852258  5598 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:07.882160  4946 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:07.884181  9035 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:07.887763  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f74ad2f73ca4aeda444924811dca81b with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:07.888459  4946 raft_consensus.cc:2955] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Committing config change with OpId 14.14: config changed from index 12 to 14, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:07.897696  4774 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 12 to 14, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:07.945606  4946 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:08.010903  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:08.017211  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f74ad2f73ca4aeda444924811dca81b with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:39302
I20260709 12:11:08.066274  5017 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:08.081451  4867 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:08.089048  8547 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:08.094735  4916 consensus_peers.cc:597] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b626d6ae78534a64a64c129ed023c901. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:08.134707  8756 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:11:08.142009  8994 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.144876  9061 tablet_replica.cc:333] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:11:08.147679  9061 raft_consensus.cc:2243] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:08.148528  9061 raft_consensus.cc:2272] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:08.157543  4875 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:11:08.159646  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 61238.5us
I20260709 12:11:08.200460  9061 ts_tablet_manager.cc:1916] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:08.287575  5017 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:08.294447  8933 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:08.299711  5021 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.309289  4772 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:11:08.328642  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 66899.2us
I20260709 12:11:08.329687  5016 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:08.371897  4946 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:08.373050  5603 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:08.381669  9061 ts_tablet_manager.cc:1929] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.13
I20260709 12:11:08.382635  9061 log.cc:1199] T 2f74ad2f73ca4aeda444924811dca81b P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/2f74ad2f73ca4aeda444924811dca81b
I20260709 12:11:08.384920  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 2f74ad2f73ca4aeda444924811dca81b (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:08.399753  9017 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:08.403313  9068 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:08.404534  4990 consensus_peers.cc:597] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66c02d3930da4dfba1f61356e4562709. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:08.407272  4875 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:08.408771  9062 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:08.423986  5016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:08.424695  5016 raft_consensus.cc:606] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:08.433454  5016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c480da15ff054400bdd09744d494717c"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:08.433946  5016 raft_consensus.cc:606] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:08.435089  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:11:08.436062  4945 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:08.439481  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:08.440501  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:08.468948  8967 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:08.522903  8967 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.539420  4876 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.531147  4945 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.557943  9078 ts_tablet_manager.cc:933] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:08.565092  4769 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 7, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.638527  5021 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:08.649185  9078 tablet_copy_client.cc:323] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:11:08.650287  8655 raft_consensus.cc:993] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:08.653332  8655 raft_consensus.cc:1081] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:08.654644  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet b626d6ae78534a64a64c129ed023c901 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:11:08.655373  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet b626d6ae78534a64a64c129ed023c901 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-b626d6ae78534a64a64c129ed023c901
W20260709 12:11:08.660356  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 53728us
I20260709 12:11:08.665310  4942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c480da15ff054400bdd09744d494717c"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52392
I20260709 12:11:08.665872  4942 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:08.666167  4942 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.674394  4942 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:08.687136  4961 tablet_copy_source_session.cc:215] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:08.688395  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:08.701182  4875 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.695235  4942 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:08.696064  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:08.702399  5016 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:08.702674  5016 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:08.705308  5016 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:08.707490  5016 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.715070  4867 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:08.715240  4875 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:08.717532  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:08.717552  9064 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:08.718472  8994 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.718915  8994 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:08.719646  8994 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:08.723333  5016 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:08.727594  9078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b626d6ae78534a64a64c129ed023c901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:08.742368  4942 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:08.738525  4990 consensus_peers.cc:597] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fedd910b0097474d987abca8337e4e48. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:08.753036  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 45357.9us
I20260709 12:11:08.756645  9064 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:08.765909  9081 raft_consensus.cc:993] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:08.766345  9081 raft_consensus.cc:1081] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:08.768663  4875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:11:08.769181  4875 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:08.769513  4875 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:08.770022  9078 tablet_copy_client.cc:806] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:08.771306  9078 tablet_copy_client.cc:670] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:08.770838  4774 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 11, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:08.779302  4875 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:08.781962  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:08.782311  4875 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:08.782472  5017 raft_consensus.cc:3055] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:08.784111  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:08.787323  5598 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:08.786370  5017 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:08.790113  5017 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:08.791131  5017 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:08.802819  5017 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:11:08.803548  9078 tablet_copy_client.cc:538] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:08.803203  5598 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:11:08.803885  4840 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:08.807564  8838 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:08.808041  8838 raft_consensus.cc:697] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:08.808892  8838 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:08.813958  4867 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.814473  9083 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.820307  4942 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.838119  4774 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:08.850934  4769 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 5 to 6, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 6 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:08.859205  9078 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:08.879329  4867 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:11:08.881053  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 48359.5us
I20260709 12:11:08.929136  9091 ts_tablet_manager.cc:933] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:08.933650  9091 tablet_copy_client.cc:323] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:11:08.935432  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 66c02d3930da4dfba1f61356e4562709 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:11:08.935971  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 66c02d3930da4dfba1f61356e4562709 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-66c02d3930da4dfba1f61356e4562709
W20260709 12:11:08.948199  4841 consensus_peers.cc:597] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 950c0e5da47a49abb359c63b8483f487. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:08.953447  5017 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:08.957263  8838 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:08.962842  4942 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:08.981927  8838 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:09.005951  8933 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:09.018563  5017 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:09.020079  9078 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:09.020985  9078 tablet_bootstrap.cc:492] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:09.021668  9078 ts_tablet_manager.cc:1403] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.163s	user 0.030s	sys 0.029s
I20260709 12:11:09.026176  5034 tablet_copy_source_session.cc:215] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:09.028952  9078 raft_consensus.cc:359] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:09.042141  9078 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:09.042794  9078 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:09.042644  4774 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:09.053758  9078 ts_tablet_manager.cc:1434] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:11:09.061962  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c02d3930da4dfba1f61356e4562709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:09.066906  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-b626d6ae78534a64a64c129ed023c901 received from {username='slave'} at 127.0.0.1:43248
I20260709 12:11:09.067437  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-b626d6ae78534a64a64c129ed023c901 on tablet b626d6ae78534a64a64c129ed023c901 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:09.095764  9078 ts_tablet_manager.cc:933] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:09.101724  4942 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:09.115295  9091 tablet_copy_client.cc:806] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:09.129163  9091 tablet_copy_client.cc:670] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:09.140383  9091 tablet_copy_client.cc:538] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:09.146091  4876 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:09.149629  9091 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:09.150707  8994 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:09.235904  5017 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:09.238317  8756 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:09.244277  9091 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:09.245263  9091 tablet_bootstrap.cc:492] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:09.246304  9091 ts_tablet_manager.cc:1403] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.005s
I20260709 12:11:09.266462  9091 raft_consensus.cc:359] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:09.267257  9091 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:09.267887  9091 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:09.277009  9091 ts_tablet_manager.cc:1434] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:11:09.285398  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-66c02d3930da4dfba1f61356e4562709 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:11:09.288210  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-66c02d3930da4dfba1f61356e4562709 on tablet 66c02d3930da4dfba1f61356e4562709 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:09.290740  9078 tablet_copy_client.cc:323] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:11:09.293064  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet fedd910b0097474d987abca8337e4e48 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:11:09.293587  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet fedd910b0097474d987abca8337e4e48 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-fedd910b0097474d987abca8337e4e48
I20260709 12:11:09.301841  5034 tablet_copy_source_session.cc:215] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:09.313133  9078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fedd910b0097474d987abca8337e4e48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:09.360890  9078 tablet_copy_client.cc:806] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:09.361467  9078 tablet_copy_client.cc:670] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:09.368608  9078 tablet_copy_client.cc:538] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:09.390419  9078 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:09.393004  5017 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:09.394992  9017 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:09.400609  5606 raft_consensus.cc:1217] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 12:11:09.421336  5606 raft_consensus.cc:1217] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 12:11:09.428702  5606 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:09.431738  9017 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:11:09.539228  9091 ts_tablet_manager.cc:933] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:11:09.549619  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:09.552858  9078 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:09.571941  9078 tablet_bootstrap.cc:492] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:09.572909  9078 ts_tablet_manager.cc:1403] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.183s	user 0.035s	sys 0.005s
I20260709 12:11:09.589478  9091 tablet_copy_client.cc:323] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:11:09.591207  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 950c0e5da47a49abb359c63b8483f487 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:11:09.591750  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 950c0e5da47a49abb359c63b8483f487 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-950c0e5da47a49abb359c63b8483f487
I20260709 12:11:09.593376  9078 raft_consensus.cc:359] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:09.595731  9078 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:09.598573  9078 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:09.630117  4876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:09.641296  4876 raft_consensus.cc:606] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:11:09.642637  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:09.644102  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:09.644778  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:09.628587  4885 tablet_copy_source_session.cc:215] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:09.658501  5598 raft_consensus.cc:1217] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:11:09.663419  9091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950c0e5da47a49abb359c63b8483f487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:09.664909  9078 ts_tablet_manager.cc:1434] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.091s	user 0.004s	sys 0.002s
I20260709 12:11:09.673954  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-fedd910b0097474d987abca8337e4e48 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:11:09.674311  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-fedd910b0097474d987abca8337e4e48 on tablet fedd910b0097474d987abca8337e4e48 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:09.825920  9091 tablet_copy_client.cc:806] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:09.832828  9091 tablet_copy_client.cc:670] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:09.845465  9091 tablet_copy_client.cc:538] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:09.865973  9091 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:09.925056  9109 raft_consensus.cc:993] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:09.925537  9109 raft_consensus.cc:1081] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:09.932348  5021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:11:09.932919  5021 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:09.933276  5021 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.946875  5021 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:09.950471  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:09.950981  4867 raft_consensus.cc:3055] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:09.951288  4867 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:09.952037  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:09.952632  5598 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.952001  4867 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:09.951157  5021 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:09.954174  4867 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.958865  8547 raft_consensus.cc:1064] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:09.961118  8547 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:09.963585  5598 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:09.964763  4990 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:09.966814  9064 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.967253  9064 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:09.968061  9064 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:09.971254  4867 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:09.998252  4774 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:10.004137  9065 raft_consensus.cc:1064] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:10.012322  9065 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:10.021006  5598 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:10.022614  5021 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:10.024277  8994 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.029985  8994 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.037601  4876 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:10.054117  8994 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.069630  4942 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:10.072904  4867 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:10.090577  5606 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:10.088868  9064 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:11:10.115234  9065 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:10.117089  9107 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:10.120430  9091 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:10.132251  8547 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.133700  5606 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.161299  9091 tablet_bootstrap.cc:492] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:10.162110  9091 ts_tablet_manager.cc:1403] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.296s	user 0.014s	sys 0.026s
I20260709 12:11:10.186074  5021 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.189445  4875 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.252568  4769 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:10.275444  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 100414us
W20260709 12:11:10.276549  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 77446.3us
I20260709 12:11:10.310992  9083 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.313560  9064 raft_consensus.cc:1064] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:10.351748  9091 raft_consensus.cc:359] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:10.352677  9091 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:10.357131  9091 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:11:10.359045  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 102919us
I20260709 12:11:10.367760  4872 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.373206  9091 ts_tablet_manager.cc:1434] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.211s	user 0.004s	sys 0.008s
I20260709 12:11:10.377944  4950 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.395267  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-950c0e5da47a49abb359c63b8483f487 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:11:10.395709  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-950c0e5da47a49abb359c63b8483f487 on tablet 950c0e5da47a49abb359c63b8483f487 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:10.378047  9064 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:10.411360  5606 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.471916  4769 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 7 to 8, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:11:10.473227  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 61154.5us
I20260709 12:11:10.494999  5606 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:10.502642  4950 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:10.511834  9132 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.516281  4867 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:10.525418  9083 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:10.570544  5603 raft_consensus.cc:1217] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.8->[10.9-10.9]   Dedup: 10.9->[]
I20260709 12:11:10.568451  4950 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:10.605964  4867 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:10.621124  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 84035.4us
I20260709 12:11:10.652498  5603 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:10.655347  5598 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:10.658205  5021 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:10.669834  4872 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:10.674366  9144 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:10.680456  5606 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:10.683003  9144 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.689574  9144 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.693068  9064 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.693472  9123 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:10.694337  8994 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:10.700513  4950 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:10.702714  9134 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.703234  5603 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.723160  9064 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.723459  8994 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.731613  4867 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.735419  5606 raft_consensus.cc:2955] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.759785  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66c02d3930da4dfba1f61356e4562709 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:10.762806  4769 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 9 to 10, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.778824  4772 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 8 to 9, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.781829  4943 raft_consensus.cc:2955] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.794329  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b626d6ae78534a64a64c129ed023c901 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:10.783706  9144 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.800824  4948 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.822772  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet b626d6ae78534a64a64c129ed023c901 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:55706
I20260709 12:11:10.863099  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 66c02d3930da4dfba1f61356e4562709 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:39302
I20260709 12:11:10.866685  9154 tablet_replica.cc:333] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:11:10.867784  9154 raft_consensus.cc:2243] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:10.874135  5603 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.886444  9154 raft_consensus.cc:2272] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:10.888047  4769 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.888844  4872 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:10.896234  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:10.901434  9155 tablet_replica.cc:333] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:11:10.902527  9155 raft_consensus.cc:2243] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:10.903259  9155 raft_consensus.cc:2272] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:10.920111  9155 ts_tablet_manager.cc:1916] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:10.964397  9154 ts_tablet_manager.cc:1916] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:11.021698  9154 ts_tablet_manager.cc:1929] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 12:11:11.022924  9154 log.cc:1199] T b626d6ae78534a64a64c129ed023c901 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/b626d6ae78534a64a64c129ed023c901
I20260709 12:11:11.024744  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet b626d6ae78534a64a64c129ed023c901 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:11.026684  5016 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:11.039857  5603 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:11.041206  9132 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:11.044610  9155 ts_tablet_manager.cc:1929] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.8
I20260709 12:11:11.046006  9155 log.cc:1199] T 66c02d3930da4dfba1f61356e4562709 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/66c02d3930da4dfba1f61356e4562709
I20260709 12:11:11.047675  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 66c02d3930da4dfba1f61356e4562709 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:11.048328  4872 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:11.049352  5016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:11.050091  5016 raft_consensus.cc:606] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:11.048542  9132 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:11.055668  9147 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:11.056934  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:11.057485  5603 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:11.058522  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:11.068966  4872 raft_consensus.cc:2955] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:11.089243  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fedd910b0097474d987abca8337e4e48 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:11.088981  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:11.097637  4770 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 9 to 10, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:11.109618  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet fedd910b0097474d987abca8337e4e48 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:52362
I20260709 12:11:11.139783  9158 tablet_replica.cc:333] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:11:11.149744  9017 raft_consensus.cc:1064] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:11.149868  9158 raft_consensus.cc:2243] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:11.149971  9143 raft_consensus.cc:993] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:11.150625  9143 raft_consensus.cc:1081] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:11.150810  9158 raft_consensus.cc:2272] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:11.152670  4950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52392
I20260709 12:11:11.153218  4950 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:11.153546  4950 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:11.154250  9158 ts_tablet_manager.cc:1916] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:11.152357  9017 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:11.166507  4950 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:11.170848  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:11.171378  5016 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:11.171649  5016 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:11.172282  5016 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:11.173264  5016 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:11.177111  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:11.177645  5603 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:11.182392  5598 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:11.183919  9109 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:11.186682  5603 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:11.188522  9158 ts_tablet_manager.cc:1929] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:11:11.193329  9158 log.cc:1199] T fedd910b0097474d987abca8337e4e48 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/fedd910b0097474d987abca8337e4e48
I20260709 12:11:11.193833  4916 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:11.195770  5021 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:11.196050  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet fedd910b0097474d987abca8337e4e48 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:11.197199  8994 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:11.197642  8994 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:11.197997  4948 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:11.198347  8994 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:11.189271  5016 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:11.202303  9109 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:11.208904  4950 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:11.213052  9017 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:11.244192  4770 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 14 to 15, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 15 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:12.051892  4950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.022s	sys 0.006s
W20260709 12:11:12.052237  4950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.023s	sys 0.007s
W20260709 12:11:12.094023  5016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.013s	sys 0.023s
W20260709 12:11:12.094525  5016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.013s	sys 0.023s
I20260709 12:11:12.197724  5021 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 12:11:12.196632  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 63822.6us
I20260709 12:11:12.232867  9178 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:12.233436  9178 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:12.235883  9178 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:12.243206  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 59173.2us
I20260709 12:11:12.244204  9166 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:11:12.244181  9168 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:12.278906  4948 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:12.294843  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:12.297523  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 179469us
I20260709 12:11:12.313519  5603 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:11:12.314558  9064 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:12.315107  9064 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:12.324054  9064 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:12.325475  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:12.331642  9166 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:11:12.336174  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:12.348695  5016 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:11:12.352686  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 88734.2us
I20260709 12:11:12.363897  4772 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.372763  5606 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:12.405786  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:12.406970  9128 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:12.410594  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:12.412384  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:12.413605  9128 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:12.508351  4875 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:12.514720  5603 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:12.515998  4946 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:12.520663  9179 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:12.522426  9179 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:12.538347  9174 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:12.545228  4946 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:12.550297  5603 raft_consensus.cc:2955] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:12.563884  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 950c0e5da47a49abb359c63b8483f487 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:12.595788  4770 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 10 to 11, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.641803  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 950c0e5da47a49abb359c63b8483f487 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55706
I20260709 12:11:12.697305  9195 tablet_replica.cc:333] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:11:12.701565  9195 raft_consensus.cc:2243] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:12.702322  9195 raft_consensus.cc:2272] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:12.716912  9195 ts_tablet_manager.cc:1916] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:12.752308  9195 ts_tablet_manager.cc:1929] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.10
I20260709 12:11:12.753001  9195 log.cc:1199] T 950c0e5da47a49abb359c63b8483f487 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/950c0e5da47a49abb359c63b8483f487
I20260709 12:11:12.761435  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:12.762262  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 950c0e5da47a49abb359c63b8483f487 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:12.822803  4948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:12.823362  4948 raft_consensus.cc:606] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:12.828096  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:12.829651  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:12.835119  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:12.912850  9165 raft_consensus.cc:993] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:12.913393  9180 raft_consensus.cc:1081] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:12.915014  4875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:11:12.915526  4875 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:12.915841  4875 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.923970  4875 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:12.926267  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:12.926795  4948 raft_consensus.cc:3055] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.927068  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:12.927623  5606 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.927071  4948 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:12.933032  4948 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:12.934031  4948 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.938716  5606 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:12.939514  4875 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:12.939901  4841 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:12.941344  9179 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:12.941785  9179 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:12.942540  9179 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:12.960004  4948 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:12.972476  4770 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 9, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:13.181002  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca5a0 after lost signal to thread 3728
W20260709 12:11:13.182063  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003cab80 after lost signal to thread 4808
W20260709 12:11:13.183192  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb6a0 after lost signal to thread 4900
W20260709 12:11:13.184232  5046 debug-util.cc:398] Leaking SignalData structure 0x7b0800330aa0 after lost signal to thread 4975
W20260709 12:11:13.185297  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5400 after lost signal to thread 5049
W20260709 12:11:13.186365  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003918e0 after lost signal to thread 5630
I20260709 12:11:13.378046  4946 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:13.379964  9179 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:13.533643  5606 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:13.535382  9175 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:13.713438  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 60526.8us
W20260709 12:11:13.886776  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54789.5us
W20260709 12:11:13.893919  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 107394us
W20260709 12:11:13.900976  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 65191.7us
W20260709 12:11:13.909844  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 74670.2us
W20260709 12:11:13.904253  9199 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:11:13.931591  4946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.018s
W20260709 12:11:13.931919  4946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.008s	sys 0.018s
I20260709 12:11:13.936264  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:13.961330  5023 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
W20260709 12:11:14.006392  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 97577.9us
W20260709 12:11:14.024698  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 127777us
W20260709 12:11:14.058166  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 108099us
W20260709 12:11:14.096993  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 70128.3us
W20260709 12:11:14.130538  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 107150us
W20260709 12:11:14.157418  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 79762.1us
W20260709 12:11:14.164951  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 44783.7us
W20260709 12:11:14.173785  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47801.7us
W20260709 12:11:14.183784  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 105410us
W20260709 12:11:14.201191  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 94842.8us
W20260709 12:11:14.202615  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 70148.2us
W20260709 12:11:14.228209  4990 consensus_peers.cc:597] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9752c5a68f0f415b848ef1da168f8d82. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:14.334069  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 102342us
W20260709 12:11:14.344723  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 112782us
I20260709 12:11:14.344964  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:14.348400  4867 raft_consensus.cc:606] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:14.349015  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 116015us
W20260709 12:11:14.344664  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 115952us
I20260709 12:11:14.348996  4763 maintenance_manager.cc:419] P ed86163b2a3e48d0879181588237bafe: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033340
I20260709 12:11:14.370097  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:14.371857  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:14.372591  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:14.381520  4874 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:11:14.350090  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 128716us
W20260709 12:11:14.390889  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 43674us
I20260709 12:11:14.394032  4950 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:11:14.406941  9227 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:14.428220  9239 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:14.491729  9239 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.492524  4872 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.493532  4942 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.511412  4867 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:14.512756  4770 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 6, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
W20260709 12:11:14.522827  4841 consensus_peers.cc:597] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4be803cbf3854da89561de85968acd64. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:14.524158  4943 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:14.524258  5023 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:14.525697  9205 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:14.527308  9233 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:14.547326  9233 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.551803  5024 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.588420  4942 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.613288  4943 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:14.635406  4769 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.659646  9257 ts_tablet_manager.cc:933] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:14.674453  5024 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:14.673594  4916 consensus_peers.cc:597] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 951f0af961a844849af172b241003482. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:14.674670  4872 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:14.676729  9245 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:14.678498  9245 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:14.685770  9257 tablet_copy_client.cc:323] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.67:40575
I20260709 12:11:14.687685  5034 tablet_copy_service.cc:140] P baa50eb5ed704004b7f391934a59d010: Received BeginTabletCopySession request for tablet 9752c5a68f0f415b848ef1da168f8d82 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:54512)
I20260709 12:11:14.688159  5034 tablet_copy_service.cc:161] P baa50eb5ed704004b7f391934a59d010: Beginning new tablet copy session on tablet 9752c5a68f0f415b848ef1da168f8d82 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:54512: session id = ab9da67236874634be59ebfd05b18255-9752c5a68f0f415b848ef1da168f8d82
I20260709 12:11:14.699257  5034 tablet_copy_source_session.cc:215] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:14.718181  9202 raft_consensus.cc:993] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:14.731200  9257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752c5a68f0f415b848ef1da168f8d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:14.724010  9233 raft_consensus.cc:1081] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:14.743783  4943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:11:14.744226  4943 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:14.744529  4943 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.740898  9247 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.757649  5023 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.757311  4943 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:14.764227  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:14.764858  5597 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.763002  4943 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:14.783229  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:14.783730  4867 raft_consensus.cc:3055] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:14.783921  4867 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:14.784452  5597 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:14.784456  4867 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:14.792327  4867 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.799477  4916 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:14.811247  9232 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.811650  9232 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:14.812413  9232 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:14.812623  4769 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.821650  4867 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:14.838739  9257 tablet_copy_client.cc:806] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:14.855883  9257 tablet_copy_client.cc:670] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:14.862495  9257 tablet_copy_client.cc:538] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:14.866834  4769 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 7, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 7 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:14.872848  4875 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:14.879662  4867 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.912772  5023 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:14.913537  4943 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:11:14.915057  4841 consensus_peers.cc:597] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ea0cbe752f64a3cb8e0ca3a9a520c60. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:14.915938  9202 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:11:14.920794  9217 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:14.934176  9257 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:14.950681  9206 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:14.976609  4943 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:15.001664  5023 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:15.006316  4769 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index -1 to 8, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:15.013760  9268 ts_tablet_manager.cc:933] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:11:15.075263  9268 tablet_copy_client.cc:323] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:11:15.081549  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 4be803cbf3854da89561de85968acd64 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:11:15.083081  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 4be803cbf3854da89561de85968acd64 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-4be803cbf3854da89561de85968acd64
I20260709 12:11:15.091475  4885 tablet_copy_source_session.cc:215] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:15.097081  9268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4be803cbf3854da89561de85968acd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:15.135257  9271 ts_tablet_manager.cc:933] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:15.143633  9257 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:15.144846  9257 tablet_bootstrap.cc:492] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:15.145555  9257 ts_tablet_manager.cc:1403] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.212s	user 0.029s	sys 0.010s
I20260709 12:11:15.149806  9257 raft_consensus.cc:359] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:15.151724  9268 tablet_copy_client.cc:806] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:15.154510  9271 tablet_copy_client.cc:323] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.66:43473
I20260709 12:11:15.158463  9257 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:15.159719  4961 tablet_copy_service.cc:140] P 8de40fe2bb814adcbe13958669063dc9: Received BeginTabletCopySession request for tablet 951f0af961a844849af172b241003482 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:43248)
I20260709 12:11:15.158718  9268 tablet_copy_client.cc:670] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:15.170681  4961 tablet_copy_service.cc:161] P 8de40fe2bb814adcbe13958669063dc9: Beginning new tablet copy session on tablet 951f0af961a844849af172b241003482 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:43248: session id = ab9da67236874634be59ebfd05b18255-951f0af961a844849af172b241003482
I20260709 12:11:15.176893  9268 tablet_copy_client.cc:538] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:15.182955  9257 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:15.186488  4961 tablet_copy_source_session.cc:215] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:15.190949  9271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 951f0af961a844849af172b241003482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:15.203030  9268 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:15.187878  9257 ts_tablet_manager.cc:1434] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.041s	user 0.001s	sys 0.005s
I20260709 12:11:15.206542  5034 tablet_copy_service.cc:342] P baa50eb5ed704004b7f391934a59d010: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-9752c5a68f0f415b848ef1da168f8d82 received from {username='slave'} at 127.0.0.1:54512
I20260709 12:11:15.206919  5034 tablet_copy_service.cc:434] P baa50eb5ed704004b7f391934a59d010: ending tablet copy session ab9da67236874634be59ebfd05b18255-9752c5a68f0f415b848ef1da168f8d82 on tablet 9752c5a68f0f415b848ef1da168f8d82 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:15.214152  9271 tablet_copy_client.cc:806] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:15.214865  9271 tablet_copy_client.cc:670] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:15.218534  9271 tablet_copy_client.cc:538] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:15.233901  9271 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:15.277750  9271 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:15.280471  9271 tablet_bootstrap.cc:492] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:15.285944  9271 ts_tablet_manager.cc:1403] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.052s	user 0.034s	sys 0.005s
I20260709 12:11:15.289861  9271 raft_consensus.cc:359] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:15.290755  9271 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:15.291414  9271 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:15.294539  9271 ts_tablet_manager.cc:1434] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:11:15.299854  9257 ts_tablet_manager.cc:933] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:11:15.303273  4961 tablet_copy_service.cc:342] P 8de40fe2bb814adcbe13958669063dc9: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-951f0af961a844849af172b241003482 received from {username='slave'} at 127.0.0.1:43248
I20260709 12:11:15.303717  4961 tablet_copy_service.cc:434] P 8de40fe2bb814adcbe13958669063dc9: ending tablet copy session ab9da67236874634be59ebfd05b18255-951f0af961a844849af172b241003482 on tablet 951f0af961a844849af172b241003482 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:15.305449  9268 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:15.306272  9268 tablet_bootstrap.cc:492] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:15.306878  9268 ts_tablet_manager.cc:1403] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.104s	user 0.031s	sys 0.001s
I20260709 12:11:15.355434  4762 maintenance_manager.cc:643] P ed86163b2a3e48d0879181588237bafe: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.972s	user 0.151s	sys 0.014s Metrics: {"bytes_written":29777,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":7443,"dirs.run_cpu_time_us":293,"dirs.run_wall_time_us":7068,"drs_written":1,"lbm_read_time_us":285,"lbm_reads_lt_1ms":4,"lbm_write_time_us":17295,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":19714,"threads_started":1,"update_count":5}
I20260709 12:11:15.417496  4763 maintenance_manager.cc:419] P ed86163b2a3e48d0879181588237bafe: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12672 bytes on disk
I20260709 12:11:15.434569  4762 maintenance_manager.cc:643] P ed86163b2a3e48d0879181588237bafe: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.016s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":344,"lbm_reads_lt_1ms":4}
I20260709 12:11:15.436744  9268 raft_consensus.cc:359] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:15.441171  4872 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:15.445317  5598 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:15.449112  9257 tablet_copy_client.cc:323] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:11:15.451752  9268 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:15.456560  9231 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:15.464085  9207 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:15.472966  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:15.515637  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:11:15.516182  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-6ea0cbe752f64a3cb8e0ca3a9a520c60
I20260709 12:11:15.507295  9268 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:15.551389  9268 ts_tablet_manager.cc:1434] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.244s	user 0.006s	sys 0.008s
I20260709 12:11:15.630405  4885 tablet_copy_source_session.cc:215] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:15.658489  4943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:47298
I20260709 12:11:15.658903  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-4be803cbf3854da89561de85968acd64 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:11:15.659053  4943 raft_consensus.cc:606] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:15.659348  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-4be803cbf3854da89561de85968acd64 on tablet 4be803cbf3854da89561de85968acd64 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:15.660226  9257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:15.666554  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:15.713507  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:15.714249  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:15.717058  9283 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:11:15.779505  5603 raft_consensus.cc:1217] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:11:15.799306  5598 raft_consensus.cc:1217] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:11:15.829878  5598 raft_consensus.cc:1217] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 12:11:15.837087  9207 raft_consensus.cc:993] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:15.837577  9207 raft_consensus.cc:1081] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:15.850924  4873 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:11:15.851490  4873 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:15.851854  4873 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:15.862815  4873 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:15.882180  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:15.882704  4942 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:15.882987  4942 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:15.883662  4942 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:15.884656  4942 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:15.890319  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:15.890882  5021 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:15.895726  4942 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:15.896631  4873 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:15.896974  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:15.897997  5021 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:15.897848  9206 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:15.901070  9206 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:15.901970  9206 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:15.870404  9257 tablet_copy_client.cc:806] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:15.906577  9257 tablet_copy_client.cc:670] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:15.910703  9257 tablet_copy_client.cc:538] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:15.920087  9257 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
I20260709 12:11:15.920022  4769 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 15 to 16, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 16 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:16.023650  9257 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:16.025847  9257 tablet_bootstrap.cc:492] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:16.026612  9257 ts_tablet_manager.cc:1403] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.107s	user 0.028s	sys 0.034s
I20260709 12:11:16.030197  9257 raft_consensus.cc:359] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:16.030974  9257 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:16.031587  9257 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:16.054617  9257 ts_tablet_manager.cc:1434] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 12:11:16.059284  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-6ea0cbe752f64a3cb8e0ca3a9a520c60 received from {username='slave'} at 127.0.0.1:57560
I20260709 12:11:16.059739  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-6ea0cbe752f64a3cb8e0ca3a9a520c60 on tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:16.219769  9206 raft_consensus.cc:1064] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:16.222666  9206 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:16.256384  5603 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:16.257716  9277 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:16.265635  5023 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:16.267653  9289 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:16.271158  4942 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:16.272822  9206 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:16.310091  9264 raft_consensus.cc:1064] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:16.312533  9264 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:16.327685  9277 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.336194  5021 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.341256  4942 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.353018  4769 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.356714  5603 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:16.358263  9231 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:16.369431  9280 raft_consensus.cc:1064] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:16.370004  5023 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:16.366946  5021 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:16.371939  9280 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:16.372527  9206 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:16.375000  9231 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:16.379489  4872 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:16.383018  9231 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:16.391609  5598 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.401611  5597 raft_consensus.cc:1217] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
W20260709 12:11:16.412833  9308 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:16.429716  4872 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:16.431214  9296 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:16.453118  5598 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 LEARNER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:16.455327  9280 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:16.462833  4873 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:16.467971  4946 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:16.468653  4950 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:16.471400  9296 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:16.472399  9279 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:16.474925  9207 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.477411  5597 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:16.478799  9277 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:16.484474  4872 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.487979  5023 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:16.489579  9279 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.494235  5597 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.503448  9289 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:16.516973  4774 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 9 to 10, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:16.517833  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4be803cbf3854da89561de85968acd64 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:16.523280  5023 raft_consensus.cc:2955] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.532030  5025 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.535723  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 4be803cbf3854da89561de85968acd64 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:52362
I20260709 12:11:16.588291  4774 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:11:16.600962  9311 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:11:16.618566  9321 tablet_replica.cc:333] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:11:16.620635  9321 raft_consensus.cc:2243] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:16.621487  9321 raft_consensus.cc:2272] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:16.625224  5598 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.630129  9323 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.625191  9321 ts_tablet_manager.cc:1916] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:16.678637  9321 ts_tablet_manager.cc:1929] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.9
I20260709 12:11:16.679171  9321 log.cc:1199] T 4be803cbf3854da89561de85968acd64 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/4be803cbf3854da89561de85968acd64
I20260709 12:11:16.681035  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 4be803cbf3854da89561de85968acd64 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:16.688719  4947 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.689483  5597 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:11:16.709266  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 54935.6us
W20260709 12:11:16.714368  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 64847us
I20260709 12:11:16.755137  4774 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.764137  4947 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:16.775771  5025 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:16.782676  9318 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:16.797370  5597 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:16.810190  9318 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.818696  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:16.824154  5023 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:16.831259  5597 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:16.832507  9322 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:16.839264  9322 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.816486  4872 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } attrs { replace: true } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.841991  5598 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.856963  4759 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9752c5a68f0f415b848ef1da168f8d82 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:16.859755  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 951f0af961a844849af172b241003482 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:16.863924  5025 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.872262  9231 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:16.891530  4770 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 reported cstate change: config changed from index 7 to 8, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New cstate: current_term: 7 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.909468  4874 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:16.914577  9323 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:16.919240  4941 tablet_service.cc:1558] Processing DeleteTablet for tablet 9752c5a68f0f415b848ef1da168f8d82 with delete_type TABLET_DATA_TOMBSTONED (TS 8de40fe2bb814adcbe13958669063dc9 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:52362
I20260709 12:11:16.920102  9321 tablet_replica.cc:333] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:11:16.921038  9321 raft_consensus.cc:2243] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:16.921873  9321 raft_consensus.cc:2272] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:16.925318  9321 ts_tablet_manager.cc:1916] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:16.920780  5598 raft_consensus.cc:2955] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:16.972270  9321 ts_tablet_manager.cc:1929] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 12:11:17.001459  9321 log.cc:1199] T 9752c5a68f0f415b848ef1da168f8d82 P 8de40fe2bb814adcbe13958669063dc9: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/wals/9752c5a68f0f415b848ef1da168f8d82
I20260709 12:11:16.965042  4874 raft_consensus.cc:2955] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.002908  4758 catalog_manager.cc:5028] TS 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): tablet 9752c5a68f0f415b848ef1da168f8d82 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:16.955566  4772 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 9 to 10, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:16.941071  9277 raft_consensus.cc:1064] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:17.027623  9277 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:17.039229  4863 tablet_service.cc:1558] Processing DeleteTablet for tablet 951f0af961a844849af172b241003482 with delete_type TABLET_DATA_TOMBSTONED (TS 4f3bf546572147c3abe4522189e86ce6 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:39302
I20260709 12:11:17.045842  9328 tablet_replica.cc:333] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:11:17.046815  9328 raft_consensus.cc:2243] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:17.053260  9328 raft_consensus.cc:2272] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:17.056651  9328 ts_tablet_manager.cc:1916] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:17.083734  9328 ts_tablet_manager.cc:1929] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:11:17.092974  9328 log.cc:1199] T 951f0af961a844849af172b241003482 P 4f3bf546572147c3abe4522189e86ce6: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/wals/951f0af961a844849af172b241003482
I20260709 12:11:17.098585  4761 catalog_manager.cc:5028] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): tablet 951f0af961a844849af172b241003482 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:17.107604  5025 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:17.109349  9279 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:17.117733  5598 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:17.120456  9279 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:17.141453  4946 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:17.144945  9206 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:17.172433  9289 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.179546  4946 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.181984  5603 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.200650  5025 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.262452  4774 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 8 to 9, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.327801  4875 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:17.345252  5598 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:17.349706  4947 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:17.349576  9289 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:17.356705  9279 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:17.363123  9277 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.368297  5603 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.389796  4947 raft_consensus.cc:2955] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:17.415262  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:17.415931  4875 raft_consensus.cc:606] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:11:17.437165  4761 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:17.440241  4769 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: config changed from index 9 to 10, VOTER baa50eb5ed704004b7f391934a59d010 (127.3.163.67) evicted. New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:17.450233  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:17.465991  9279 raft_consensus.cc:993] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:17.466501  9279 raft_consensus.cc:1081] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:17.468482  5025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:11:17.469003  5025 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:17.469331  5025 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:17.474684  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:17.475605  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:17.479353  5025 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:17.481228  5006 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 with delete_type TABLET_DATA_TOMBSTONED (TS baa50eb5ed704004b7f391934a59d010 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:55706
I20260709 12:11:17.490661  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:17.491175  4875 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:17.491448  4875 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:17.492126  4875 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:17.493294  4875 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:17.497545  5025 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:17.498445  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:17.499010  4947 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:17.506877  4947 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:17.507800  4875 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:17.508018  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:17.508656  9333 tablet_replica.cc:333] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:11:17.508800  9323 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:17.509931  9323 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:17.510730  9323 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:17.528932  9333 raft_consensus.cc:2243] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:17.529484  9333 raft_consensus.cc:2272] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:17.545562  9333 ts_tablet_manager.cc:1916] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:17.547948  4772 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 16 to 17, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 17 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:17.565018  9333 ts_tablet_manager.cc:1929] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 12:11:17.565544  9333 log.cc:1199] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P baa50eb5ed704004b7f391934a59d010: Deleting WAL directory at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/wals/6ea0cbe752f64a3cb8e0ca3a9a520c60
I20260709 12:11:17.567400  4759 catalog_manager.cc:5028] TS baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): tablet 6ea0cbe752f64a3cb8e0ca3a9a520c60 (table test-workload [id=b1caf261a40c41b684ccf934ed4befc6]) successfully deleted
I20260709 12:11:18.625839  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:18.857089  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 181768us
I20260709 12:11:19.680289  9344 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:19.681564  9344 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.685084  9343 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.685947  9343 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.688262  9343 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:19.684690  9344 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:19.727221  4841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.002s	sys 0.002s
W20260709 12:11:19.733035  4841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.002s	sys 0.002s
I20260709 12:11:19.556645  9347 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.734004  9344 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.734889  9343 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.734632  9347 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.735570  9343 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.736960  9345 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:19.737972  9345 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.734702  9344 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.751232  9346 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.752219  9346 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.756493  9345 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.757920  9348 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:19.758841  9348 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.764120  9343 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.777964  9349 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:19.779531  9349 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.779839  9343 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:19.781708  4914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.823s	user 0.012s	sys 0.014s
W20260709 12:11:19.782282  4914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.833s	user 0.012s	sys 0.015s
I20260709 12:11:19.780942  9343 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.786170  9343 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.786710  9343 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.788160  9350 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.786471  9349 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:19.789520  9349 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.790047  9349 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.791718  9349 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.793074  9349 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.793380  9351 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:19.793573  9349 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.794361  9351 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.795342  9349 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:19.796618  9349 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.797850  9350 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.797727  9343 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.800401  9350 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.781090  9345 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:19.801326  9345 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.802031  9343 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:19.803836  9345 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.804665  9349 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:19.807428  9349 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:19.811128  9351 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.812831  9322 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.813565  9351 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.813779  9322 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.814245  9351 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.817637  9322 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:19.818223  9322 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.818697  9231 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.818959  9322 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.819453  9231 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.821592  9322 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.822086  9322 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.822350  9231 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.822747  9322 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.823988  9351 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.827273  9349 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.828033  9349 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.829547  9353 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.877646  9351 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.890023  9353 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.890642  9351 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.894601  9354 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:19.894884  9231 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:19.895509  9354 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.895690  9231 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.898012  9231 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.898480  9349 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:19.924388  9322 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:19.924669  9353 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:19.924441  9351 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.934770  9322 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:19.935461  9322 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.937639  9322 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.938141  9322 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.939043  9356 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:19.945250  9349 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.945972  9349 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.949144  9349 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.951718  9350 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:19.952576  9350 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.952522  9343 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:19.955271  9350 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.955097  9343 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.957368  9343 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:19.943886  9322 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.944106  9356 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.960670  9322 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:19.961393  9322 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:19.961792  9346 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.960779  9356 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.962078  9322 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:19.963654  9349 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.964314  9349 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:19.965462  9322 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:19.966377  9349 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:19.948553  9354 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:19.970121  5570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.996s	user 0.008s	sys 0.016s
I20260709 12:11:19.977728  9346 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:19.978330  9346 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:19.990477  5570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.016s	user 0.009s	sys 0.017s
W20260709 12:11:19.990878  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 2.01659e+06us
I20260709 12:11:19.996315  9346 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.173911  9343 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.175253  9343 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.184314  9353 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.185074  9353 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.187103  9353 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.177652  9343 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:20.170641  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08003065a0 after lost signal to thread 3728
W20260709 12:11:20.274626  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.329s	user 0.019s	sys 0.036s
W20260709 12:11:20.275171  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.330s	user 0.019s	sys 0.036s
W20260709 12:11:20.281267  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 289591us
I20260709 12:11:20.295847  9357 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.296685  9357 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.299216  9357 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:20.300140  4915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.316s	user 0.013s	sys 0.038s
I20260709 12:11:20.301954  9354 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.302675  9354 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.303512  9360 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.304176  9360 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.304841  9354 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.305433  9354 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.306121  9354 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.306717  9356 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.307824  9358 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.307714  9356 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.309397  9322 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.310020  9356 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.310562  9356 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.311127  9356 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:20.323365  4915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.340s	user 0.013s	sys 0.040s
I20260709 12:11:20.308545  9358 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.328213  9358 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.310060  9322 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.336854  9322 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.374976  9356 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.379863  9351 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.380754  9351 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.328747  9358 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.390316  9358 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.393437  9231 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.394172  9231 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.412707  9354 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.413406  9354 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.414986  9362 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.415782  9362 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.418733  9362 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:20.419170  4972 debug-util.cc:398] Leaking SignalData structure 0x7b0800284d40 after lost signal to thread 4808
I20260709 12:11:20.423964  9343 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.425712  9353 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.426579  9359 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.426424  9353 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.427240  9359 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.429059  9351 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.429682  9322 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.429694  9280 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.430529  9346 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.431193  9346 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.430348  9322 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.424643  9343 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.430496  9280 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.443634  9231 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.444053  9322 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.444973  9280 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.445817  9359 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.446204  9347 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.446345  9354 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:20.448509  9354 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.434386  9353 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.443011  9346 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.453940  9361 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.454646  9361 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.456176  9360 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.456678  9360 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.457257  9360 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.459532  9358 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.464665  9348 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.472425  9342 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:20.472867  4916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.542s	user 0.022s	sys 0.013s
W20260709 12:11:20.473336  4916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.543s	user 0.022s	sys 0.013s
I20260709 12:11:20.474967  9322 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.475540  9334 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.475657  9322 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.476290  9334 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.477102  9323 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.474334  9280 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.477782  9323 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.479843  9356 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.473243  9342 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.481492  9356 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.483507  9342 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.484036  9342 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.484618  9342 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.465577  9361 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.466338  9360 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.496382  9361 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.497176  9361 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.499289  9361 leader_election.cc:290] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.494524  9344 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.501377  9322 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.502079  9277 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.504849  9363 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.551542  9363 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.553884  9363 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.483538  9356 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.512439  9280 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.557027  9280 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.479036  9354 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.557847  9354 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.560253  9354 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.516095  9360 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.561575  9360 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.562623  9277 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.564004  9360 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.516248  9231 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.566200  9231 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.568173  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.516897  9357 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.517447  9323 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.521888  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.488934  9358 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.496119  9342 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:20.522888  4972 debug-util.cc:398] Leaking SignalData structure 0x7b080037d7a0 after lost signal to thread 4900
W20260709 12:11:20.576010  4972 debug-util.cc:398] Leaking SignalData structure 0x7b0800335800 after lost signal to thread 4975
W20260709 12:11:20.577131  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4900 after lost signal to thread 5049
W20260709 12:11:20.578264  4972 debug-util.cc:398] Leaking SignalData structure 0x7b080030cae0 after lost signal to thread 5630
W20260709 12:11:20.578512  4972 debug-util.cc:398] Leaking SignalData structure 0x7b08003d11a0 after lost signal to thread 5631
I20260709 12:11:20.522979  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.522367  9343 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.525228  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.526187  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.527591  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.529825  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.530686  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.530627  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.542331  9367 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.568305  9231 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.516342  9327 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.568775  5023 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:20.579782  5025 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:11:20.584169  9323 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.584885  9323 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.585922  9362 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.586581  9362 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.587203  9323 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.588948  9357 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.579902  5022 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:20.591195  9357 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.580268  5019 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:20.579344  5017 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:20.594367  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.596763  9367 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.597910  9342 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.598408  9327 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.598452  9342 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.599073  9367 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.594120  9358 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.600255  9334 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.600584  9342 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.601325  9358 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.602507  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.602923  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.603111  5021 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:20.603905  9327 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.604460  9351 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.604595  9207 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.604823  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.605105  9351 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.605283  9207 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.605919  9365 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.606431  9365 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.607147  9351 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.607342  9207 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.608470  9365 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.608688  9207 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.609179  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.609404  9318 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.609848  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.609761  9354 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.610013  9318 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.610571  9354 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.611536  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.612010  9318 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.594259  9362 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.598923  9277 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.613283  5025 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:20.613788  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.614378  5021 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:20.614988  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.615309  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.616120  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.616679  5025 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:20.616829  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.612584  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.617954  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.618274  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.618686  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.619755  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.620556  9370 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.621110  9360 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.621548  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.621685  9360 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.622215  5606 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:20.623713  9360 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.624169  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.624569  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.612571  9354 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.625280  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.625828  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.609201  9207 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:20.626619  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.627094  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.620373  4942 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:20.627403  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.625259  5603 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:20.623710  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.624858  5599 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:20.627475  5597 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:20.621112  9370 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.628173  5602 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:20.626475  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.630491  9370 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.626536  5598 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:11:20.631280  9372 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.636469  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.637698  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.640934  4872 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:20.636507  9323 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.645398  9323 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.648000  9323 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.641682  9366 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.648653  9366 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.650636  9366 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.636399  9370 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.651461  9370 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.654100  9360 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.654798  9360 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.656939  9360 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.657095  9368 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.654210  9370 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.657640  9360 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.657743  9368 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.658545  9360 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.659890  9368 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.660785  9360 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.633281  9207 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.657196  9371 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.657912  9372 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.662644  9371 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.663080  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.663246  9362 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.678503  9362 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.680968  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.681561  5605 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:20.682435  9371 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.680999  9372 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.683614  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.687245  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.688858  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.663656  9369 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.663940  9361 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.669580  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.675324  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.675508  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.673442  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.676321  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.674698  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.677106  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.677815  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.691347  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:20.700361  4868 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:20.700755  9362 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.700356  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.702457  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.705438  4869 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:20.692039  4871 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:20.706756  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.706956  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.707271  4946 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:20.719254  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.719578  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.721132  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.721706  4947 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 17.
I20260709 12:11:20.699035  9361 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.722956  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.724203  9361 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:20.708853  9369 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.726979  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.727538  4869 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:11:20.708133  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.735520  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.735601  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.736083  4947 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:20.737601  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.738127  5021 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:20.739845  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.741250  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.741715  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.743140  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.743710  5601 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:20.741114  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.744729  4876 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:20.745098  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.745651  5021 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:20.744874  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.746834  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.747720  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.748446  4950 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:20.750455  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.751274  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.750782  9369 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:20.741045  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.753722  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.754920  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.755558  4948 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:20.760787  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.763886  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.764448  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.765600  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.765874  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.766634  4945 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:20.766077  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.766983  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:20.767788  9366 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.768165  9366 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.768553  9366 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.771096  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.771239  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.771669  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.773152  5022 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:20.774165  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.811842  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.781989  5022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:20.820113  5022 raft_consensus.cc:606] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:11:20.801406  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:20.789662  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.820915  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.820998  9207 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.790547  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.825055  9207 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.825495  9207 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.783746  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.821471  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:20.843958  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:20.803119  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.800334  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.819039  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.790056  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.851995  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:20.852749  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.854153  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.855816  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.856863  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.856986  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.857422  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.858062  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.858554  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.859074  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.859598  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.861305  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.861853  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.862265  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.863306  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.864221  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.790208  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.865569  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.866008  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.805202  4990 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:20.792331  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.791069  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.869946  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.789748  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.870465  9323 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.870899  9323 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.871273  9323 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.871495  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.871914  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:20.825800  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.830638  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.831612  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.872782  9344 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.831898  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.870501  4870 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:20.832295  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.832605  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.833107  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.826433  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:20.833246  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.791738  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.836148  9207 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.875133  9354 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.875097  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.875655  9354 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.876068  9354 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.838613  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.839071  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.876307  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.841311  4841 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:20.877255  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.877489  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.877930  4841 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:20.878789  9364 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.879185  9364 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.879500  9364 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.879408  9277 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.886372  9277 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.886723  9277 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:20.887066  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 81946.4us
I20260709 12:11:20.888674  4990 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:20.888885  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 62564.2us
I20260709 12:11:20.889375  9342 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.889752  9342 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.890101  9342 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.893177  4915 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:20.897740  9342 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.898326  4867 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:20.898586  9365 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.841646  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.782450  9366 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.886847  9323 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.900583  9366 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.899019  9365 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.901088  4990 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:20.901216  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.818658  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:20.777911  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.872689  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.873808  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.837172  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.903514  9366 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.837387  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.903879  9366 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.904268  9366 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.784085  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.893822  9207 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.895001  9277 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.873241  9344 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.896965  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.907521  9344 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.908665  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.910480  4990 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:20.911643  9277 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.896425  9364 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.911898  9323 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.898739  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.889012  5604 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:20.912340  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.901394  9365 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.866199  5606 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:20.841446  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.913491  9364 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.897270  9354 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.915656  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.915975  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.857092  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.916906  9354 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.917133  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.916265  9342 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.917502  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.918771  9366 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.919584  9365 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.919896  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:20.920991  9334 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:20.921355  9334 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:20.921726  9334 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:20.922060  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:20.921356  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:20.925983  9365 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.929878  9334 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.934827  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.934273  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.920581  9366 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.941836  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:20.943337  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:20.943869  5601 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.944242  4839 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:20.945596  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:11:20.946188  4841 consensus_peers.cc:597] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 -> Peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Couldn't send request to peer ab9da67236874634be59ebfd05b18255. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e7b07518a00402aaa235a0d34263b1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:20.946605  4839 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:20.947150  9359 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.947311  4841 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:20.948128  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:20.943778  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:20.948678  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:20.948971  9346 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:20.946833  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.950737  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.942232  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:20.952884  9277 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:20.955099  9277 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.955468  9277 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.955790  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:20.930352  9344 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:20.959527  9323 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.959899  9323 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:20.947304  9343 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:20.961019  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:20.960227  9357 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:20.965575  9357 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.965796  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:20.967016  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:20.951705  9347 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.952785  9346 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.951604  9359 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.965946  9357 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.973318  9231 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:20.960206  9323 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.984215  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:20.960191  9334 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.963990  9343 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.981977  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:20.982057  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:20.983826  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:20.983306  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:20.981259  9359 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.985579  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:20.976955  9346 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.987344  9346 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.985525  9231 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.988581  9231 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:20.989002  9231 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.980684  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:20.983767  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:20.994803  9207 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.995152  9207 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:20.995487  9207 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.001679  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.003222  9351 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:21.003575  9351 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.003902  9351 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:21.005563  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.006408  9318 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.006816  9318 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:21.007277  9318 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.013700  9344 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:20.955909  9348 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:21.014549  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 65917.4us
I20260709 12:11:21.015944  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:21.006601  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 44704.3us
I20260709 12:11:21.019769  5601 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:21.020682  5597 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.007084  9343 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:21.020512  4916 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.021766  4841 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:21.023648  5020 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.025353  5025 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:21.026418  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.029202  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:21.031152  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 77030.6us
I20260709 12:11:21.031922  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.034205  9376 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.034603  9376 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:21.034937  9376 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.035265  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.038233  4916 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.038800  9380 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.039608  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.044050  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.045135  9383 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.045536  9383 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:21.047091  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.045873  9383 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.028024  9318 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.051939  9318 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.052922  9318 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.055157  9351 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:21.057066  9351 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.028596  9365 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.028137  9353 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.068684  9277 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.071125  9383 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.073079  9383 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.073693  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.073873  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.078832  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.079638  9322 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:21.080139  9322 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:21.080507  9322 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:21.082304  9323 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.083292  5022 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.079598  9335 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.084285  9323 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.085821  9207 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:21.088791  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 52450.9us
I20260709 12:11:21.090260  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:21.089571  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 66213.8us
I20260709 12:11:21.070778  9277 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.094056  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:21.095144  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 51158.6us
I20260709 12:11:21.041898  9376 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.096290  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.096264  4916 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.097741  9342 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:21.092782  9366 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:11:21.096978  9365 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.064497  9353 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:21.097774  9207 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.107686  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.108826  9231 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.109620  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.110719  9231 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.110869  9280 raft_consensus.cc:993] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: : Instructing follower ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:11:21.111280  9280 raft_consensus.cc:1081] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Signalling peer ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:11:21.112902  5597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:37900
I20260709 12:11:21.113440  5597 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:21.113757  5597 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.114328  9357 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.093133  9323 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:11:21.117427  9357 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.120573  5597 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.121579  9322 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.098183  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.123471  5597 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.124639  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.125329  9323 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.099853  9366 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:21.098239  9351 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.125403  5025 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:21.098189  4916 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.098434  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.126912  4991 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.127444  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.127331  4916 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.126634  9366 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:21.134903  9357 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.126477  5025 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:21.133677  9359 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.128443  9343 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:21.126312  9322 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.139487  9323 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.140425  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.140775  9343 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:21.103894  9346 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.135035  9366 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.135577  9231 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.136101  9382 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.143831  9380 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:21.144744  9382 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.145145  9382 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.145666  9231 raft_consensus.cc:3055] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.145895  9382 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.104862  9353 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.147267  9382 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.149771  9231 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.150609  9231 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.151710  9231 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.136425  9351 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.141947  5025 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.153916  9366 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.154469  5025 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.156481  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.158979  5022 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:21.160511  5025 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:21.132673  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.143359  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.153358  9359 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.161846  5568 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:21.169484  9384 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.168211  9322 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.175402  9371 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:21.181344  9371 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.182174  9371 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.185129  9360 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.186077  9369 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:21.186417  9369 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.187206  9369 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.188304  9369 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:21.189064  9376 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.189932  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.192921  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.193934  4772 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 10, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:21.196969  9346 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.197645  9376 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.194028  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.197897  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.198699  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.201424  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.201993  4916 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.202674  9351 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.203390  9351 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.204034  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.204362  4946 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:21.211598  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.211905  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.212239  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.212957  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.213610  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.213902  9346 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:21.214269  9346 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:21.211607  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.214691  9376 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.215071  9376 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:21.215400  9376 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.202458  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.220093  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.220495  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.218130  9346 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:21.222648  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.224476  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.225081  9348 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.225518  9348 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:21.225888  9348 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.227451  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.229041  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.229239  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.229858  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.230767  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.232198  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.229990  4948 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:21.233162  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.234558  9386 ts_tablet_manager.cc:933] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Initiating tablet copy from peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799)
I20260709 12:11:21.235741  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.236590  4840 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.239854  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.240842  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.241719  4840 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.243525  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.244973  9343 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.240319  4951 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:21.239637  9344 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.235981  9385 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.245667  9344 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:21.246006  9385 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:21.246088  9344 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.246466  9385 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.247222  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.248100  9277 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.249611  4840 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.250145  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.250293  9353 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.250703  9353 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:21.250998  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.251104  9353 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.252985  4951 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.255540  4951 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.256987  4951 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.257432  4769 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 8 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.259999  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.260607  4944 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.261250  4946 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.269778  5567 leader_election.cc:304] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.270876  9371 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.271729  4942 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.272156  5567 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.260087  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.272761  4947 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:21.257043  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:21.273370  9371 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:21.274628  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.275605  9371 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.276157  9376 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.265851  9346 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.250649  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.276417  9353 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.267139  4944 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:21.277382  5567 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.311429  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.311486  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.291978  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.278059  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:21.313246  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 62664.4us
I20260709 12:11:21.313874  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.312901  9371 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.315019  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.316135  9322 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:21.315510  9386 tablet_copy_client.cc:323] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: tablet copy: Beginning tablet copy session from remote peer at address 127.3.163.65:38799
I20260709 12:11:21.316756  9364 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.314764  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.319348  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.320101  4988 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.321415  4988 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.322257  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.322551  9280 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.324138  9277 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.324755  9371 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.325764  9369 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.322628  9358 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.326648  9342 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.326211  9369 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.327068  9371 consensus_queue.cc:1059] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.328094  9360 raft_consensus.cc:3055] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.327773  9369 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.328456  9360 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.322919  9343 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.329514  9358 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.330659  4988 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.333455  9362 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:21.334457  9372 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.334794  9372 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.335000  9342 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.329325  9360 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.330994  9346 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.336265  9360 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.339561  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.275844  9385 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.341032  9376 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.296881  9344 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.341776  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.342736  9358 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.343248  9344 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.343278  9372 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.297536  9348 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.329105  9369 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.345677  9348 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:21.347342  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.348263  4988 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.351249  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.351457  4916 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.353011  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.353567  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.353940  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.353195  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.354568  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.355055  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.348754  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.356066  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.354025  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.356642  9342 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.357431  9358 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.353264  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.358544  4946 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 18: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:21.349326  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.360414  4916 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.360571  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.359515  9382 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.361756  4916 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.360749  9376 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.362334  9376 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:21.362494  9346 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.362708  9376 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.362883  9346 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:21.363379  9346 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.365199  9382 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.365345  9385 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.365073  9351 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.368306  9358 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:21.359709  9348 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.369850  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.369915  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.370946  4988 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.371616  9385 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.372248  9372 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.372524  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.372638  9362 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.373304  9358 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:21.373624  9362 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.374010  9362 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.371994  9385 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:21.375100  9385 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.374864  9362 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.375442  9353 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.376185  9362 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.376498  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.377166  9348 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.377538  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.377871  9348 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.378316  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:21.378665  9342 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.379945  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.379958  9366 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:21.380882  9366 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:21.381621  9346 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.383594  9346 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.382241  9366 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:21.385922  9342 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.385654  9376 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.386705  4988 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.391476  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.399192  9342 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.399507  9366 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:21.400298  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.391953  9348 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.400508  4988 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.401249  9342 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:21.402093  9353 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.402807  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.403554  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.403852  4839 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.404151  9353 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.401213  9348 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.398546  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.405222  9344 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.360416  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.391628  9385 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.408279  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.407814  9359 raft_consensus.cc:2955] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:21.409148  4945 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.410472  9385 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.411732  9362 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.413241  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.413341  9362 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:21.413757  9362 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.414701  9362 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.415848  9362 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.392336  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.418239  9353 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:21.419216  9353 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.419723  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.411896  4839 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.421355  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.421613  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.421983  9277 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.424034  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.424260  4872 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.425515  9366 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.425875  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.427307  4873 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.426283  4944 raft_consensus.cc:2955] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:21.425390  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.428916  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.425465  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.433652  4988 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.434417  9342 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.436004  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.436662  9358 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.437901  9366 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.439567  9376 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:21.440055  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:21.446005  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.447279  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.447154  9358 consensus_queue.cc:1059] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:21.448206  9358 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.448539  9358 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:21.449368  9358 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.450490  9358 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.451084  4774 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:21.459375  9366 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.459435  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.460573  9342 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.461010  4988 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.461726  9358 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.462556  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.463020  4944 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.466403  5022 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.467448  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.470922  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:21.471076  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.477202  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.478586  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.481698  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:21.483163  4872 raft_consensus.cc:1240] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:21.488840  4872 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.490252  4872 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.493852  9351 consensus_queue.cc:1059] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:21.494905  9351 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.495218  9351 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.496075  9351 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.491575  4872 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.503532  9351 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.506186  4885 tablet_copy_service.cc:140] P 4f3bf546572147c3abe4522189e86ce6: Received BeginTabletCopySession request for tablet 0e7b07518a00402aaa235a0d34263b1f from peer ab9da67236874634be59ebfd05b18255 ({username='slave'} at 127.0.0.1:57560)
I20260709 12:11:21.506670  4872 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:21.506767  4885 tablet_copy_service.cc:161] P 4f3bf546572147c3abe4522189e86ce6: Beginning new tablet copy session on tablet 0e7b07518a00402aaa235a0d34263b1f from peer ab9da67236874634be59ebfd05b18255 at {username='slave'} at 127.0.0.1:57560: session id = ab9da67236874634be59ebfd05b18255-0e7b07518a00402aaa235a0d34263b1f
I20260709 12:11:21.507844  4991 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.508980  9358 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.510056  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.511029  9358 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.512868  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.515057  4885 tablet_copy_source_session.cc:215] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:21.517426  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.518252  5022 raft_consensus.cc:2410] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:11:21.527706  9358 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.528781  9366 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.529201  9366 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:21.531275  9366 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.532914  9366 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.537987  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.542568  5570 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.543311  9362 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.543752  5570 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.544489  9362 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.544853  5570 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.546350  5570 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.547040  9372 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.547547  9362 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.550721  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.552356  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.552634  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.552309  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.555326  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:21.556330  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:21.556783  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:21.556739  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.557032  4868 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.557461  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.558002  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.558261  4873 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:21.559039  5570 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.561561  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:21.562451  4876 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.562481  4875 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:21.563156  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.563848  9359 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.563994  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:21.564390  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:21.561232  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:21.565070  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.565090  4867 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 18: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:21.564512  4876 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.566885  5018 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.566906  4874 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.567516  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:21.566164  5570 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.567349  5016 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:21.569154  5570 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.567850  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.574918  4869 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:21.575126  4871 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.575722  4872 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.574666  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.577590  4870 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:11:21.577641  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.565727  9362 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.581820  9361 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.582134  9382 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.582775  9382 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.573446  9372 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.583650  9382 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.584049  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.584738  9372 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:21.586277  4868 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.586176  5570 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.587287  9383 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:21.583990  9382 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.575987  9369 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.589156  9382 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.587421  9376 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:21.593611  9369 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.594696  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.595230  9382 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.600986  9369 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.602070  5570 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.603070  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.604074  5570 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:21.605244  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.606011  9372 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.605346  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.604171  9362 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.606877  9376 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.607278  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.605737  9361 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.610946  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.609195  9369 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.610873  9376 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.611846  5022 raft_consensus.cc:2955] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER ab9da67236874634be59ebfd05b18255 (127.3.163.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } } }
I20260709 12:11:21.613937  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.615039  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.616410  9372 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.617367  9372 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.617681  9372 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.618407  9372 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.619647  9372 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.615207  9359 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.608974  9371 consensus_queue.cc:1059] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:21.620973  5597 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:21.615190  9383 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.621387  9371 raft_consensus.cc:3055] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:21.624950  9277 consensus_queue.cc:1059] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:21.625010  9376 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:21.623324  9353 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.626484  9383 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:21.626688  9376 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:21.626909  9383 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:21.624962  9371 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.624548  9361 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:11:21.628130  9361 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.627903  9383 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.628010  9371 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.628502  9361 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.624075  9359 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:21.629472  9371 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:21.629736  9383 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.632037  9361 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.633302  9361 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.628821  9376 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:21.637073  9376 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.638352  9376 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.641737  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.645671  9369 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:21.648332  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.645498  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.646700  9369 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:21.654438  9385 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.655155  9386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7b07518a00402aaa235a0d34263b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:21.659958  4840 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.660693  9385 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.652107  9362 raft_consensus.cc:3055] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.661850  9362 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.662102  9369 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:21.662482  9369 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:21.663470  9369 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.663791  9362 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.661602  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.666713  9358 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:21.650110  9383 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.677489  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.689811  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:21.690814  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.691601  9351 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.692986  9351 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:21.693576  9351 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.677721  9362 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.694681  5020 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:21.696017  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.696836  9366 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:21.678826  9382 consensus_queue.cc:1059] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.684844  5017 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:21.705497  9357 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.705873  9357 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.706676  9357 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.708786  9357 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.714250  9366 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:21.715896  9358 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.716228  9358 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:21.716971  9358 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.718294  9358 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.719712  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:21.720954  9231 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.721585  9231 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:21.722556  9351 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.722900  9351 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.723590  9351 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.724745  4868 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.725710  9231 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:21.726749  9231 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.727065  9231 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.727828  9231 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.728909  9231 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:21.733404  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.733804  9353 consensus_queue.cc:1059] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:21.734625  9351 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.735325  9359 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.736021  9277 raft_consensus.cc:3055] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:21.736399  9277 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:21.737293  9277 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.738495  9277 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:21.741425  9386 tablet_copy_client.cc:806] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:21.742022  9386 tablet_copy_client.cc:670] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:21.753559  9357 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:21.754480  9357 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:21.755131  9386 tablet_copy_client.cc:538] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:21.759666  9369 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.763506  9382 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.764106  9382 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.771749  9400 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.772140  9400 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.773764  9382 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:21.775170  9382 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.776510  4944 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:21.778121  9361 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.778544  9400 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.779253  9386 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Bootstrap starting.
W20260709 12:11:21.781416  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47935.8us
I20260709 12:11:21.787506  9401 consensus_queue.cc:1059] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:21.788985  9351 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:21.792260  9405 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.792717  9405 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.793804  9405 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.800273  9400 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.806190  5017 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:21.808902  9231 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:21.809305  9231 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:21.810222  9231 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:21.811468  9361 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:21.811542  9231 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.838505  9405 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:21.900929  9409 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:11:21.941313  9386 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:21.942243  9386 tablet_bootstrap.cc:492] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Bootstrap complete.
I20260709 12:11:21.942970  9386 ts_tablet_manager.cc:1403] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Time spent bootstrapping tablet: real 0.164s	user 0.035s	sys 0.010s
I20260709 12:11:21.955710  9386 raft_consensus.cc:359] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:21.956557  9386 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Initialized, Role: LEARNER
I20260709 12:11:21.957216  9386 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:21.959836  9386 ts_tablet_manager.cc:1434] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:11:21.964957  4885 tablet_copy_service.cc:342] P 4f3bf546572147c3abe4522189e86ce6: Request end of tablet copy session ab9da67236874634be59ebfd05b18255-0e7b07518a00402aaa235a0d34263b1f received from {username='slave'} at 127.0.0.1:57560
I20260709 12:11:21.965418  4885 tablet_copy_service.cc:434] P 4f3bf546572147c3abe4522189e86ce6: ending tablet copy session ab9da67236874634be59ebfd05b18255-0e7b07518a00402aaa235a0d34263b1f on tablet 0e7b07518a00402aaa235a0d34263b1f with peer ab9da67236874634be59ebfd05b18255
I20260709 12:11:22.092285  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:22.209632  5597 raft_consensus.cc:1217] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:11:22.252333  4868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:22.252913  4868 raft_consensus.cc:606] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:11:22.254132  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:22.255661  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:22.256376  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:22.383730  9369 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:22.384280  9369 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.386446  9369 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.388443  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:22.389389  5022 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:22.390250  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:22.390847  4942 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:22.392210  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:22.393198  9362 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.393638  9362 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.395548  9362 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.396023  9362 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:22.396339  9362 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:22.396672  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:22.397320  5022 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:22.398274  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:22.396677  9362 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.398824  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:22.399055  9372 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:22.402819  9372 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.404481  9372 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:22.410765  9362 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.413157  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:22.415150  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:22.415792  5022 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:22.418474  9372 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.422185  9372 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.421281  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:22.422360  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:22.422899  5022 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:22.424926  9362 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.429008  5022 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:22.430018  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:22.430970  9362 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:22.431437  9362 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:22.434274  9362 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.433704  4942 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:22.442848  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:22.443866  9372 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:22.444341  9372 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:22.445273  9372 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.470850  4772 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.528998  4772 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 11 to 12, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.584594  9362 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.586014  9362 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.588152  9362 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:22.590102  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:22.590734  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:22.591099  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:22.591668  4942 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:22.593019  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:22.605165  9362 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.605552  9362 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.605875  9362 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.647891  9372 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:22.648411  9372 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.662724  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:22.663399  5022 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:22.664510  9372 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.668013  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:22.668704  9344 raft_consensus.cc:993] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:22.669191  9344 raft_consensus.cc:1081] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Signalling peer baa50eb5ed704004b7f391934a59d010 to start an election
I20260709 12:11:22.668612  4868 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:11:22.672096  5022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:55716
I20260709 12:11:22.672591  5022 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:22.672935  5022 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.694522  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:22.696385  9372 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:22.697113  9372 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:22.698565  9372 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.731909  9369 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:22.732435  9369 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.734568  9369 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.736734  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:22.737483  5017 raft_consensus.cc:2393] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:22.739162  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:22.739701  4868 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:22.740706  5570 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:22.741701  9369 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.742089  9369 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:22.742478  9369 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.755162  9369 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.725399  5022 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.757604  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:22.761180  9420 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.761663  9420 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.763636  9420 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.765654  9418 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.766130  9418 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:22.767978  9418 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:22.769230  5022 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:22.765396  9362 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:22.772547  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 160995us
W20260709 12:11:22.775691  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 177696us
I20260709 12:11:22.775282  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:22.777647  5597 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.778141  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:22.777561  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:22.778991  4945 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:22.774684  4868 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:22.774238  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:22.781749  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:22.778710  4944 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:22.780048  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:22.781584  5017 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:22.783175  4871 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:22.781993  5570 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:22.783475  4871 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:22.790160  9416 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.790673  9416 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:22.798357  5597 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:22.799582  4990 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:22.799923  9419 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.784548  4871 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.802397  4871 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.811517  4871 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:22.793449  9420 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:22.821918  9424 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:22.802640  9419 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.826126  9417 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:22.826603  9417 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:22.826972  9372 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.827837  9416 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.829928  9362 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:22.809163  9369 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.839337  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:22.840327  4871 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:22.842478  9372 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:22.840132  9418 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.831532  9369 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.846670  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:22.852916  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:22.853530  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:22.854053  4870 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.854467  4868 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:11:22.861569  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:22.860589  4868 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:22.843310  9417 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:22.853009  9424 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:22.870211  4871 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:11:22.847327  9420 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:22.854450  9419 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:22.879354  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:22.880494  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:22.881791  5017 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:22.882751  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:22.883915  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:22.877095  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 92848.2us
I20260709 12:11:22.866973  9428 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.887331  9430 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.896831  9430 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.887876  5017 raft_consensus.cc:2393] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:22.900209  9435 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.900624  9435 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.900862  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:22.901482  4946 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.849159  9418 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:22.900995  9435 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.852936  9422 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:22.876892  9417 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.903041  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:22.857091  9369 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.901784  9425 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.898938  9400 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:22.899210  9419 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:22.911592  9400 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.904759  5568 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:22.912249  4946 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:22.907083  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:22.906523  4945 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:22.913828  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:22.928270  9277 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.928694  9277 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.931496  4870 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:22.932783  5017 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:22.935201  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:22.935976  5022 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:22.939852  9277 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:22.941833  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:22.910929  9418 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:22.912911  9372 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:11:22.942476  4948 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:23.032989  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:23.033556  5017 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 17.
W20260709 12:11:23.015055  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 67392.4us
I20260709 12:11:23.021948  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:22.908980  9369 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:23.058808  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:23.059559  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:23.060122  4871 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:23.059403  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:23.061103  4868 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:22.905344  9423 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:22.937595  9362 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.912495  9424 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.912140  9417 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.916698  9400 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:22.932265  9430 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:22.988562  9429 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:23.072714  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.072899  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:23.077178  4872 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:23.073400  9426 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:23.076668  5606 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:22.906682  9422 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.912014  9419 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.067984  9421 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.071468  9417 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.078248  9426 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:22.909454  9425 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.029824  9433 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:23.067411  9362 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.104839  9442 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.078017  9436 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:23.112921  9277 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.906021  9428 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:23.119731  5605 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:23.125785  9277 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.127650  9277 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.064873  9420 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.099915  9432 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.135478  9419 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.135738  9428 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:23.134656  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 74278.5us
W20260709 12:11:23.138698  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 200675us
I20260709 12:11:23.128885  9436 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.141649  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.141707  5570 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:23.142827  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:23.146690  4868 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:23.119143  9362 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.152525  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:23.143430  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:23.131196  9434 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.154874  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.154407  4871 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:23.155428  4948 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:23.131654  9446 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:23.162819  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:23.163367  9372 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.068315  9423 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.163971  9372 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.163398  9446 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:23.166148  9446 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.161092  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:23.161450  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.169627  4949 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 18.
I20260709 12:11:23.145494  9369 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.114399  9421 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.162002  9438 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.161662  9366 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.147792  9432 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.160249  9277 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.163439  4867 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 18.
I20260709 12:11:23.146852  9436 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:23.204486  9277 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.202219  4988 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:23.202697  5017 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:23.153584  9418 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.329274  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 284162us
I20260709 12:11:23.145573  9451 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:23.145704  9428 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.338910  9418 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.156798  9429 raft_consensus.cc:697] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:23.340770  9422 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.129078  9442 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.169098  9452 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.341296  9441 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.337769  9438 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.338057  9366 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.339650  9433 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:23.299767  9369 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.411577  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.339733  9440 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.346324  9277 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.418490  9277 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:23.418951  9277 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.384997  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.385757  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.420523  4946 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:23.385891  4951 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:23.157491  9430 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.388559  4916 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:23.388679  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.425402  5605 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:23.170497  9427 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.400545  9451 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.405855  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.343631  9432 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:23.419934  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:23.435438  9277 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.433802  4948 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
W20260709 12:11:23.436568  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 275519us
I20260709 12:11:23.388167  9428 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.346763  9372 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.399338  9452 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.406579  9441 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:23.432451  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 43971.6us
I20260709 12:11:23.446859  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:23.171186  9434 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.424969  9430 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.420029  4942 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:23.444142  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.432798  9418 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.438093  9416 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.463011  5605 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
W20260709 12:11:23.466214  4915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.005s	sys 0.008s
I20260709 12:11:23.466835  9455 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.437479  9457 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.430243  9433 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:23.477955  4915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.005s	sys 0.008s
I20260709 12:11:23.459517  9441 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:23.532199  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 648296us
I20260709 12:11:23.446046  9454 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.432629  9427 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.447625  9446 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.458259  9421 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:23.536849  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:23.538679  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 79172us
I20260709 12:11:23.445852  9452 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.464104  9430 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.465504  9372 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.560009  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.576881  4948 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:23.576743  9372 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.542083  5567 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:23.577418  9458 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:23.577910  9458 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.578336  5567 leader_election.cc:304] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:23.434230  9440 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.578825  9372 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.579833  9372 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.579931  9458 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.580212  9372 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.580470  9440 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.581485  9369 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.582003  9369 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:23.583177  9443 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.583568  9443 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.583920  9443 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.534559  9428 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:23.561134  9425 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.589378  9425 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.580610  9372 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.590261  9449 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.590747  9449 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.522830  9431 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.464385  9426 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.572160  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:23.562840  5017 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:23.530041  9451 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:23.537674  9435 consensus_meta.cc:287] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.000s
I20260709 12:11:23.462363  9444 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:23.591997  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:23.475620  9376 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.475955  9416 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:23.535458  9419 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.595990  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 393820us
I20260709 12:11:23.535980  9423 leader_election.cc:290] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.536640  9442 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.534689  9433 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.536535  9454 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:23.513376  9457 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.513291  9455 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.501056  9429 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:23.601650  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 223341us
I20260709 12:11:23.842041  9444 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:23.783912  9436 consensus_meta.cc:287] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.579s	user 0.002s	sys 0.004s
I20260709 12:11:23.843449  9436 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.589781  9425 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.592031  9434 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.845026  4868 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:11:23.845557  9436 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.803386  9372 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.857554  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.857883  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.858500  4948 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:23.858994  9474 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:23.664681  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.665068  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.842653  9444 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.851450  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:23.583609  9366 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:23.866568  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.937657  4951 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:23.936228  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.939579  4948 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:23.880196  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:23.679263  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 267025us
W20260709 12:11:23.867478  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 289200us
I20260709 12:11:23.873517  9376 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.942358  9457 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:23.945624  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.945854  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.946085  9376 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.946442  4951 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:23.949586  9459 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.949776  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.951027  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:23.951560  5016 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:23.951776  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:23.952476  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:23.952917  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:23.953053  5025 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:23.955705  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:23.956265  5018 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:23.956436  9432 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:23.956208  9456 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.957089  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.956943  9432 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.952503  5020 raft_consensus.cc:2393] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 9: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:23.953071  9469 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.867878  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 332184us
W20260709 12:11:23.749212  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 146328us
I20260709 12:11:23.864490  5605 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:23.868432  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.797271  9471 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.873724  9344 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.012604  9344 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.013962  9444 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.014515  9344 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.015012  9455 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.015471  4948 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:23.570313  9446 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.016574  9425 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.016835  5599 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:11:24.018306  9446 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.019830  9452 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.935340  9416 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.784978  9427 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:23.901837  9436 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.858255  4944 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
W20260709 12:11:23.819507  9362 consensus_meta.cc:287] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.001s
I20260709 12:11:24.031127  9362 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.000100  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:23.999470  9469 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.956598  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:23.957607  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.033584  5604 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:24.033751  5024 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:24.034722  9469 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.036293  9362 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.036970  9436 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:23.762403  9460 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:11:24.038853  9436 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.616232  9431 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:23.959941  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.041026  5017 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:24.041937  9444 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:23.616789  9426 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:24.042578  9426 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.006299  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.856213  9435 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.043820  9436 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.044111  4943 raft_consensus.cc:2368] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10.
I20260709 12:11:24.044305  9436 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.046231  9436 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.959610  9432 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.048198  9447 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:23.957610  9456 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.007575  4946 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:23.934536  9450 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.008140  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 156762us
I20260709 12:11:24.049201  9450 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.050004  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.008692  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:23.788573  9441 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:23.797533  9443 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.010022  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.960870  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.011381  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.051828  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.051860  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:23.763599  9449 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.053428  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:23.867175  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:23.864099  9454 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.860677  9372 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:23.589869  9417 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.022928  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.025214  4990 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.030031  4868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "baa50eb5ed704004b7f391934a59d010"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:24.030124  9463 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.033051  5025 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.094789  4868 raft_consensus.cc:606] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Received request to transfer leadership to TS baa50eb5ed704004b7f391934a59d010
I20260709 12:11:24.095238  4868 raft_consensus.cc:614] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:24.094799  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 69658.5us
I20260709 12:11:24.055895  5020 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:24.033782  5016 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:23.791889  9461 raft_consensus.cc:1064] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: attempting to promote NON_VOTER ab9da67236874634be59ebfd05b18255 to VOTER
I20260709 12:11:23.786757  9430 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.048614  9447 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.102286  9424 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:24.110873  9424 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:24.111228  9463 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.112634  9445 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:24.113328  9463 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.113149  9445 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.054059  9432 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.114061  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:24.114193  9432 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:24.114593  9432 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.115662  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:24.116410  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:24.022859  9471 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.118122  9471 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.009582  9459 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:24.048205  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 168068us
I20260709 12:11:24.011144  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.002892  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.120299  9459 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.120569  4950 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:11:24.120556  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 117748us
I20260709 12:11:24.050690  4867 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.053090  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:24.058022  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.122892  5025 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:23.841473  9400 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:24.053112  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.129278  4869 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:24.055379  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.121702  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.055114  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.051455  4988 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.053704  4871 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:24.055517  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.055215  9452 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.055904  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.052127  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:23.764199  9438 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.089541  4942 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:24.089855  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.061388  4874 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:24.086674  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.086963  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.091162  5021 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:24.055241  5606 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:24.088492  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.061685  4873 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:11:24.096608  4772 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 10 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:24.097456  5567 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:24.042944  9426 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:24.101390  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.132874  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.166692  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.166904  9362 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.167492  9362 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.168233  9463 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:24.168716  9463 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.169497  9362 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:24.170136  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 68812.7us
I20260709 12:11:24.170702  9463 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.171562  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.172983  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.146291  9471 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.177191  9471 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.177927  5570 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:23.936483  9419 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.104308  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.100281  4769 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 12 to 13, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 13 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:24.105208  5022 raft_consensus.cc:2368] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:11:24.185659  5020 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:24.105566  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.106473  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.106925  9437 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.107081  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.187755  4868 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.107738  9456 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.053396  9479 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:11:24.178795  9362 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.050311  9435 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.055644  4949 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:24.130384  4950 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.191604  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.191782  9470 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.115916  9461 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.192266  9470 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.198347  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.198731  4950 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
W20260709 12:11:24.131106  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 79718.6us
I20260709 12:11:24.199381  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.199600  9362 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.051523  9450 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.200047  9362 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.187188  9431 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.200517  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.202004  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.202416  9430 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.202739  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.203711  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.203836  9471 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.166723  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.199887  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.200057  4868 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 6: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.101956  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.179388  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.167251  5025 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:24.110440  9417 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.053140  9480 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.111217  9424 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:24.224185  4874 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.110373  9447 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.228169  9362 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.181190  5599 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.231890  9454 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.183571  4951 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:24.224612  9480 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.233459  9480 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.234186  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.235107  9471 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.235504  9471 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.235827  9471 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.233503  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.237416  4951 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
W20260709 12:11:24.180480  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 83115.1us
I20260709 12:11:24.120973  9425 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.180480  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.238003  9425 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.238215  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.185875  4872 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.186627  4946 raft_consensus.cc:2393] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:24.238675  9436 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.239086  9436 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.239399  9436 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.187139  5018 raft_consensus.cc:2368] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:24.191706  9445 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.183151  4944 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:24.184449  9462 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.064461  9416 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.109468  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.192550  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.241391  4873 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:24.241964  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.242147  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.242295  9416 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.178975  9427 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:24.192153  4867 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.197345  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.242892  4839 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.243443  4871 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:24.242772  4873 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.187971  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.244294  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.244382  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.054778  9443 leader_election.cc:290] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.204970  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.167769  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.245136  4873 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.221128  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.220841  5605 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:24.245639  4950 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.242945  9427 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:24.246245  9427 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.060941  5600 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:24.245893  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.190548  9437 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.238384  9425 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.247328  9474 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:24.238448  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 58043.4us
I20260709 12:11:24.248204  9474 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.245363  4948 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.246351  9462 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:24.249107  4949 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:24.249225  9462 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.250555  9474 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.205156  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.252969  9437 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.221290  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.244902  4942 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:24.254264  4988 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.220183  9476 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.224881  4945 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:24.255045  9430 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.244750  9449 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.255810  9449 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.255743  9476 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:24.256225  9449 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.256412  9476 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.255441  9430 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:24.257673  9430 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.052871  9441 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.244915  4871 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.261516  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.196659  9432 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.262084  4873 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:11:24.290203  4839 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.291427  9432 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.291559  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.284260  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.292107  5018 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:24.292795  4990 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:24.293509  9437 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.284428  4991 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:24.293545  9459 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.294633  9459 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.295001  9459 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.294034  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:11:24.297163  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 59101.9us
I20260709 12:11:24.288407  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.297891  4873 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.286206  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.253575  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.298506  5024 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:24.298640  4868 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.299520  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.293819  9456 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.292919  9429 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:24.296537  4867 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:24.286681  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.183881  5604 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:24.292001  9432 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.130868  4875 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:24.289412  4988 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:24.329293  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 80565.4us
I20260709 12:11:24.329597  4948 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:24.330202  4988 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.331341  5568 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:24.273805  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.303267  5599 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:24.306639  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.333451  4873 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:24.293907  9437 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.307011  9445 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.303951  9456 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:24.296934  9469 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.292052  9479 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.344020  9479 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.304311  4839 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.345515  9481 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.345872  9481 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.346076  9479 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.346398  9362 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.347023  9362 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.347364  9362 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:24.347427  5568 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.347759  9362 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.306468  9443 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:24.199492  9470 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.336186  9426 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:24.350574  9372 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:24.344419  9459 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:24.333388  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 141970us
I20260709 12:11:24.305696  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.353592  9481 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.353962  4874 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.354763  9454 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.355084  4915 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:24.326304  4840 leader_election.cc:400] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:11:24.326706  5567 leader_election.cc:400] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10.
W20260709 12:11:24.356182  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 55542.3us
I20260709 12:11:24.356585  5567 leader_election.cc:403] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.358064  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.359359  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.359890  4949 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.359642  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.332667  4871 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:24.334431  4950 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:24.330677  5570 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:24.154838  9400 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.340286  9366 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.376959  9366 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.377336  9366 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.340611  9456 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.336457  9445 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.341118  9441 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.326982  9431 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.328974  9450 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.325299  9429 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:24.341952  9437 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.336237  9435 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.329107  9432 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:24.334225  9416 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.356359  4840 leader_election.cc:403] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.360041  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.360730  4942 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.396982  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:24.361720  4948 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:24.364019  5568 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.399575  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.365144  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.370110  9430 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.371377  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.371676  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:24.371980  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:24.353541  9419 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.378391  4874 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
W20260709 12:11:24.379025  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 52443.1us
I20260709 12:11:24.381210  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.381808  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:24.406711  5021 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.382505  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 51895us
I20260709 12:11:24.385773  9441 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:24.384011  4949 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:24.356480  9452 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.417244  9452 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.419160  9452 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.390460  9431 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.422911  9431 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.424077  5021 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:24.390074  9435 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.424646  9441 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.424906  9435 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.425379  9471 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.408459  9440 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.426891  9429 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.388540  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:24.389951  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.388036  4943 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:24.428089  9429 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:24.428051  5025 raft_consensus.cc:2368] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:24.387395  9450 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.429051  9450 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.408898  9463 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:11:24.365128  9487 raft_consensus.cc:2764] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:24.432420  9426 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.397678  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:24.400530  5599 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:24.435592  4839 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.436380  9487 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.401708  5568 leader_election.cc:400] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:24.436905  9487 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:24.437516  9463 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.437911  9463 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.437812  9487 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.403211  5024 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.400162  5605 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
W20260709 12:11:24.402599  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 103280us
I20260709 12:11:24.398475  9416 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.442495  9416 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.385671  9433 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:24.444563  5024 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:24.444914  9433 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.445309  9433 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:24.384935  9445 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.446105  9459 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.406112  9420 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.446974  9420 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:24.447765  9420 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.384337  9446 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10.
I20260709 12:11:24.383054  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.407142  5567 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:24.449607  5567 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:24.449744  9443 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.450169  9443 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:24.450510  9443 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.450820  9438 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.450909  4917 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.451390  9438 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:24.451678  9448 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.452049  9448 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.452404  9448 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.452196  9438 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.383364  9479 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.414680  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.462085  4915 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.462270  5022 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:24.412113  4942 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:24.463716  5568 leader_election.cc:400] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:24.464006  5568 leader_election.cc:403] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.464439  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:24.465004  5022 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.415408  9427 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.427330  9471 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.398895  9432 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.438303  9463 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.457628  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:24.328433  4868 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
W20260709 12:11:24.460013  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 51700.7us
I20260709 12:11:24.460922  4945 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:24.450551  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:24.465567  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.459227  9479 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.478525  9479 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.478734  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:24.480501  9436 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.482764  9436 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.483031  9447 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.467005  4942 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:24.467810  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.391893  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.424567  9430 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.475694  9477 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.457648  9400 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.466215  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.548785  4948 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:11:24.521238  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.485074  4872 raft_consensus.cc:2368] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:24.485085  4876 raft_consensus.cc:2393] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.523166  5024 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:24.537119  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:24.541728  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:24.544503  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 68666us
W20260709 12:11:24.544270  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 93771.1us
W20260709 12:11:24.544832  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 66150.9us
I20260709 12:11:24.566114  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.570381  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.571030  5020 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:24.571030  5605 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:24.575608  9472 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.576059  9472 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.576361  9472 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.469180  9431 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.583222  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.583528  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.583791  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.584841  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.584944  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.586416  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.587059  4868 raft_consensus.cc:2368] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:24.584028  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.476305  9478 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.593144  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.614410  4950 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:24.586364  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.587663  4949 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
W20260709 12:11:24.588418  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 130864us
I20260709 12:11:24.610344  4948 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 19.
I20260709 12:11:24.589282  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:24.582824  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.614271  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:24.624567  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 74785.2us
I20260709 12:11:24.635273  9474 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.635699  4871 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:24.636957  4867 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:24.638599  9366 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.639652  5018 raft_consensus.cc:2368] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:24.639444  9445 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.487875  9481 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.642125  9366 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.630506  9430 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.573092  9459 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:24.643085  4873 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:11:24.643435  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 60682us
I20260709 12:11:24.587708  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.644590  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.648351  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.641033  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:24.649226  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 105014us
I20260709 12:11:24.648501  4868 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:24.629774  4876 raft_consensus.cc:2368] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:24.573140  9452 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.645295  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.653728  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.653946  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.655499  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:24.582783  9477 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:24.577620  9469 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.659747  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.661305  5605 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.657737  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.486220  9362 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.492115  9450 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.475996  9476 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.484753  9424 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.659770  4988 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.662072  4949 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.500656  9433 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.652272  5022 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:24.642724  9481 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.624598  9447 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:24.664546  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 48437.9us
I20260709 12:11:24.572968  9426 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:11:24.650473  9459 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.713788  5016 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:24.650725  9400 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.674513  4868 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 19.
I20260709 12:11:24.494731  9449 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.640854  9478 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.685626  4949 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:24.680611  9366 raft_consensus.cc:2764] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:24.643558  9436 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:24.700950  5599 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.664816  9475 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.713574  5017 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:11:24.642741  9430 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:24.667289  9446 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:24.719142  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 63128.1us
I20260709 12:11:24.726145  9431 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:24.658612  9417 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.751996  9456 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.770319  9456 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.717005  9459 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.774135  9467 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:24.731277  9372 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.776067  9372 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.777908  9450 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.778071  9372 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.667671  9425 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.779940  9425 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.730434  9474 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.753974  4869 raft_consensus.cc:2368] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:24.782289  9417 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:24.782886  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 112498us
I20260709 12:11:24.730717  9457 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.761319  5599 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:24.765868  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.791200  4943 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.754774  9449 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.786487  5604 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:24.787078  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.680553  9480 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.730120  9400 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:24.755450  9476 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.677163  9469 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: NON_VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: true } }
I20260709 12:11:24.735316  9495 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.823282  5605 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:24.823912  5606 raft_consensus.cc:2368] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
W20260709 12:11:24.825909  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 166192us
W20260709 12:11:24.828511  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 71010.4us
I20260709 12:11:24.833746  4990 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:24.813050  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 125554us
I20260709 12:11:24.757499  9445 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:24.762102  9475 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:24.836722  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.834372  4839 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.841004  9457 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:24.849395  4870 raft_consensus.cc:2368] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:11:24.851627  9459 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.851871  9437 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.863021  5568 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:24.865214  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.852945  9432 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.853636  5600 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:24.828519  9400 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.870549  5568 leader_election.cc:400] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:24.870850  5568 leader_election.cc:403] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.871622  4916 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:24.842005  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:24.872622  9425 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.807616  9417 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.873111  9425 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:24.873914  9425 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.861382  4943 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:24.866312  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.879978  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.880678  4945 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:24.762188  9446 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.737279  9452 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:24.883476  5023 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:24.883615  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:24.884367  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:24.881824  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 46696.3us
I20260709 12:11:24.867825  9440 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.867914  9481 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:24.889528  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47592.2us
I20260709 12:11:24.878859  9474 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.877622  9427 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:24.876298  9456 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:24.857053  9433 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:24.890242  4990 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.879839  9372 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:24.895172  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:24.897712  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.822402  9472 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.901134  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.760686  9477 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.902207  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.903208  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.910264  5605 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:24.904753  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.910859  5602 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 7: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:24.905115  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.907922  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.886628  4839 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:24.911753  4870 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:24.912168  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:24.910768  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:24.912519  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.913604  4876 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:24.909284  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.951547  5570 leader_election.cc:400] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:24.952657  4873 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.953781  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.890750  9434 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.954869  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.892551  9438 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:24.893769  9436 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.953325  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.963486  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:24.959072  5605 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:24.964169  4867 raft_consensus.cc:2368] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:24.907022  9481 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:24.966158  5603 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:24.857407  9495 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.964624  9420 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:11:24.879647  9430 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:24.956241  9427 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.901563  9435 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.083137  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.077167  9436 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:24.965355  9438 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:24.958181  9434 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.090540  9432 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:25.213434  5597 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 LEARNER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:25.216256  4876 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:11:24.965804  9450 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.095561  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.962903  9362 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.290792  4873 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:25.326378  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:24.965332  9457 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:25.210819  9497 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
W20260709 12:11:25.220314  9443 consensus_meta.cc:287] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.769s	user 0.002s	sys 0.007s
I20260709 12:11:25.344198  5605 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.325069  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:25.345530  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 387275us
W20260709 12:11:25.163306  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 273106us
I20260709 12:11:25.363438  4990 leader_election.cc:400] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:25.363711  4990 leader_election.cc:403] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.150135  9424 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.333783  9376 raft_consensus.cc:2764] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:11:25.218158  9429 consensus_meta.cc:287] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.790s	user 0.006s	sys 0.003s
W20260709 12:11:25.224339  9463 consensus_meta.cc:287] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.000s
W20260709 12:11:25.224670  9502 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
W20260709 12:11:25.216137  9479 consensus_meta.cc:287] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.000s
I20260709 12:11:25.091429  9499 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.216114  9496 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.336s	user 0.000s	sys 0.000s
W20260709 12:11:25.223552  9416 consensus_meta.cc:287] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.781s	user 0.005s	sys 0.000s
I20260709 12:11:25.350968  4944 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:25.351956  5567 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:25.361899  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:25.381146  5602 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.381820  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:25.345292  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.382879  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:25.213843  9446 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.335088  9434 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.364567  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:24.997673  9475 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.219390  9504 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:25.194860  9427 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:25.387202  9504 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.377521  9463 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.387746  9427 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.389214  9504 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.077136  9417 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:25.389639  9463 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.390313  4875 raft_consensus.cc:2368] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.215046  9478 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.369581  4991 leader_election.cc:400] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.381675  9429 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.391625  4991 leader_election.cc:400] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:25.394009  4991 leader_election.cc:400] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:25.394784  4991 leader_election.cc:400] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
W20260709 12:11:25.211627  9492 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.380s	user 0.000s	sys 0.000s
I20260709 12:11:25.396198  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:25.397421  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:25.398500  9400 consensus_meta.cc:287] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.000s
I20260709 12:11:25.398900  9400 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.401026  9432 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:25.402268  9438 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:25.385424  9416 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.403393  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:25.404083  5597 raft_consensus.cc:2368] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:11:25.404877  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:25.405154  4990 leader_election.cc:400] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:11:25.405457  4990 leader_election.cc:403] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.405640  4948 raft_consensus.cc:2368] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.405792  9435 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.385753  5600 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:25.406992  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:25.407155  9515 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:25.408061  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:25.408890  9416 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.408749  5600 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:25.374042  9516 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.377455  5599 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:11:25.383882  5567 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:25.072142  9452 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.366961  9469 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:25.368044  9480 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.384593  9362 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.390215  9417 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:25.381502  9459 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.215472  9481 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.370440  9450 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:25.373869  5605 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:25.418620  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:25.427496  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:25.429061  4841 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:25.446770  4943 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.447337  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:25.429085  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:25.448014  4945 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.367936  9443 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.450219  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:25.450914  4841 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:25.426275  9400 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.432037  4942 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:25.376523  4988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.011s	sys 0.015s
I20260709 12:11:25.371618  9456 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 19 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:25.436932  9440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.003s	sys 0.008s
I20260709 12:11:25.469995  9440 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:25.470849  9440 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.431488  9434 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.379946  9479 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.474221  9479 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.474805  4950 raft_consensus.cc:2393] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:25.434898  9372 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:25.454703  4988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.011s	sys 0.016s
I20260709 12:11:25.455329  4943 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:25.456032  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:25.476176  4942 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.476686  9434 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:25.456044  9441 consensus_meta.cc:287] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.999s	user 0.014s	sys 0.019s
I20260709 12:11:25.459183  9495 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.427666  9436 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.462168  4945 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:25.451683  9463 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.463191  9417 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.463860  9430 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:25.499629  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:25.464032  9468 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.464273  9469 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:25.448336  9420 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:25.465162  9450 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:25.466457  9448 consensus_meta.cc:287] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 1.014s	user 0.009s	sys 0.000s
I20260709 12:11:25.467864  9467 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:25.469092  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:25.513491  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 44470.4us
I20260709 12:11:25.474881  5604 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:25.478484  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.454298  5567 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:25.480854  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.481808  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.483027  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:25.515161  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 60911.8us
I20260709 12:11:25.515673  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.491902  9443 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:25.491572  9456 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:25.382414  9499 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.487211  9441 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.494184  4942 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:25.496138  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:25.496757  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:25.524366  4943 raft_consensus.cc:2368] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.498100  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.502661  9430 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.498973  4839 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:11:25.545665  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 50229.8us
I20260709 12:11:25.511375  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.515739  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.516311  5019 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.490878  5606 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:25.516527  5567 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:25.505916  9457 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:25.521360  9462 consensus_meta.cc:287] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 1.272s	user 0.016s	sys 0.007s
I20260709 12:11:25.540567  5016 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.543084  5602 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:25.522010  9495 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.547389  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.518087  9448 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.538039  9441 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:25.522567  9433 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:25.513154  9469 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.520956  9481 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:25.550258  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.608541  5024 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.608704  4841 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:25.595044  5019 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:25.617336  5022 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.610137  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:25.619385  4915 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:25.596139  9515 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:11:25.621676  9470 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.622151  9470 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:25.622510  9516 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:25.622915  9470 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.625128  9434 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.571645  9462 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.626684  5020 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.628892  5017 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:25.630957  5025 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:11:25.549532  9463 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.540146  9430 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.607951  9449 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.651011  5016 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:25.645157  5020 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:25.549343  9438 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.549412  9443 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:25.659657  5024 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:25.660662  9438 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.630211  9429 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.660605  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:25.662732  5022 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:25.633438  9477 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.658447  9463 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:25.670225  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:25.636797  9481 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:25.652284  9448 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.650226  9462 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.679873  9419 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:25.679777  9463 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.554759  9457 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.664197  9443 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:25.680878  9438 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.677330  9434 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.659821  9449 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.689628  9419 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:25.677831  9429 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.697539  9419 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.698037  9469 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.694643  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 3419) took 1106 ms. Trace:
I20260709 12:11:25.698544  4875 rpcz_store.cc:276] 0709 12:11:24.584248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.584709 (+   461us) service_pool.cc:224] Handling call
0709 12:11:25.690612 (+1105903us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540031b0d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:25.690698 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850514304}
I20260709 12:11:25.684888  9477 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:25.705941  9481 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.696197  9434 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:25.696861  9499 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.708889  9449 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.717547  9457 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.710239  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:25.714920  9443 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.731082  4841 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:25.736503  9434 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.736553  9449 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.749343  9477 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.769117  9437 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.779850  4841 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:25.781445  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:25.782349  9449 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.783226  9503 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.783743  9503 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.784092  9438 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.784557  9438 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.785696  9503 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:25.794736  9512 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.394s	user 0.000s	sys 0.002s
I20260709 12:11:25.791883  9450 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:25.797240  9438 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.786388  9449 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.803182  9449 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.803539  9449 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.803663  9472 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:25.809677  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:25.810361  5599 raft_consensus.cc:2368] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12.
I20260709 12:11:25.812376  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:25.820307  9443 consensus_queue.cc:1059] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:25.821434  9449 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.822489  4772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 358) took 1789 ms. Trace:
I20260709 12:11:25.825860  4769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 391) took 1765 ms. Trace:
I20260709 12:11:25.829900  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:25.830202  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.831184  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:25.831677  5019 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:25.831737  5025 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:25.831653  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:25.833900  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:25.834398  5606 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.842325  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:25.842989  5604 raft_consensus.cc:2368] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.844522  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:25.845108  5603 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 18.
I20260709 12:11:25.826229  4769 rpcz_store.cc:276] 0709 12:11:24.060448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.060624 (+   176us) service_pool.cc:224] Handling call
0709 12:11:24.098629 (+ 38005us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:25.825768 (+1727139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:24.736493 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:24.832621 (+ 96128us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:24.835540 (+  2919us) write_op.cc:435] Acquired schema lock
0709 12:11:24.841881 (+  6341us) tablet.cc:662] Decoding operations
0709 12:11:24.894672 (+ 52791us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:24.896612 (+  1940us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:24.908005 (+ 11393us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:24.959919 (+ 51914us) tablet.cc:701] Row locks acquired
0709 12:11:24.963821 (+  3902us) write_op.cc:260] PREPARE: finished
0709 12:11:25.073743 (+109922us) write_op.cc:270] Start()
0709 12:11:25.085722 (+ 11979us) write_op.cc:276] Timestamp: P: 1783599085006873 usec, L: 0
0709 12:11:25.085750 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:11:25.213749 (+127999us) log.cc:844] Serialized 533 byte log entry
0709 12:11:25.669385 (+455636us) op_driver.cc:464] REPLICATION: finished
0709 12:11:25.737123 (+ 67738us) write_op.cc:301] APPLY: starting
0709 12:11:25.737203 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:25.737883 (+   680us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:25.737980 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:25.738625 (+   645us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:25.738758 (+   133us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:11:25.738798 (+    40us) write_op.cc:312] APPLY: finished
0709 12:11:25.738963 (+   165us) log.cc:844] Serialized 25 byte log entry
0709 12:11:25.746518 (+  7555us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:25.746587 (+    69us) write_op.cc:454] Released schema lock
0709 12:11:25.746624 (+    37us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":77812,"reported_tablets":1,"spinlock_wait_cycles":73404544,"child_traces":[["op",{"apply.queue_time_us":67535,"apply.run_cpu_time_us":2391,"apply.run_wall_time_us":9788,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":507876,"prepare.run_cpu_time_us":8765,"prepare.run_wall_time_us":485354,"replication_time_us":583496,"thread_start_us":95722,"threads_started":1}]]}
I20260709 12:11:25.847543  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:25.848124  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:25.842454  9449 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.848881  5568 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:25.822824  4772 rpcz_store.cc:276] 0709 12:11:24.033531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.035003 (+  1472us) service_pool.cc:224] Handling call
0709 12:11:24.061898 (+ 26895us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5400240090. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c60b2 00007f2a6073f759 00007f2a606d7a76 00007f2a606a8d58 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc
0709 12:11:24.093716 (+ 31818us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:25.822411 (+1728695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:24.406291 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:24.451679 (+ 45388us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:24.451715 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:11:24.451733 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:24.452046 (+   313us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:24.452112 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:24.452142 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:24.452307 (+   165us) tablet.cc:701] Row locks acquired
0709 12:11:24.452324 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:24.452450 (+   126us) write_op.cc:270] Start()
0709 12:11:24.452558 (+   108us) write_op.cc:276] Timestamp: P: 1783599084452404 usec, L: 0
0709 12:11:24.452579 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:24.453191 (+   612us) log.cc:844] Serialized 533 byte log entry
0709 12:11:25.521278 (+1068087us) op_driver.cc:464] REPLICATION: finished
0709 12:11:25.713529 (+192251us) write_op.cc:301] APPLY: starting
0709 12:11:25.715007 (+  1478us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:25.717442 (+  2435us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:25.717535 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:25.718728 (+  1193us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:25.718952 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:11:25.718995 (+    43us) write_op.cc:312] APPLY: finished
0709 12:11:25.719159 (+   164us) log.cc:844] Serialized 25 byte log entry
0709 12:11:25.719322 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:25.719392 (+    70us) write_op.cc:454] Released schema lock
0709 12:11:25.719425 (+    33us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:25.736739 (+ 17314us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:25.736767 (+    28us) write_op.cc:454] Released schema lock
0709 12:11:25.766342 (+ 29575us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:25.767275 (+   933us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":128659584,"child_traces":[["op",{"apply.queue_time_us":182008,"apply.run_cpu_time_us":3704,"apply.run_wall_time_us":25192,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":198899,"prepare.run_cpu_time_us":21078,"prepare.run_wall_time_us":283610,"raft.queue_time_us":324366,"raft.run_cpu_time_us":38187,"raft.run_wall_time_us":279646,"replication_time_us":1049110,"thread_start_us":460067,"threads_started":4,"wal-append.queue_time_us":282415}]]}
I20260709 12:11:25.856019  4990 leader_election.cc:400] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.856339  4990 leader_election.cc:403] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.857228  9495 raft_consensus.cc:3055] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:25.868731  9495 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:25.869499  9495 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.870977  9495 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.876739  5570 leader_election.cc:400] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:25.877068  5570 leader_election.cc:403] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.877138  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:25.878065  9457 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.878790  9417 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:25.879149  9417 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:25.879484  9417 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:25.886092  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:25.886940  5606 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:25.897404  4988 leader_election.cc:400] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.897724  4988 leader_election.cc:403] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.940948  9450 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.941479  9450 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:25.943991  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 67374.9us
W20260709 12:11:25.952502  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 66481.6us
I20260709 12:11:25.940392  9426 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.956178  9472 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:25.957429  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:25.919633  9438 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:25.958942  4988 leader_election.cc:400] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.959236  4988 leader_election.cc:403] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.959553  9507 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:25.959941  9507 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.960274  9507 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:25.961131  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:25.961889  5600 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:25.962666  5598 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:25.962915  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:25.963359  5604 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:25.963800  4841 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:25.964568  9437 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.964780  9430 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.965473  9437 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:25.960758  5606 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.966297  9437 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.967862  4916 leader_election.cc:400] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12.
I20260709 12:11:25.968159  4916 leader_election.cc:403] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.968616  9509 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12.
I20260709 12:11:25.969146  4991 leader_election.cc:400] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:25.969744  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:25.971123  9481 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.971607  9468 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.972081  9468 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.972399  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:25.973584  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.974808  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.965034  9452 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.975960  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:25.971419  9470 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.976550  9470 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.974227  5024 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:25.975060  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:25.976850  9426 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:25.977802  9426 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.971616  9481 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:25.978901  9436 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.979434  9436 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:25.979705  9481 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:25.980774  5021 raft_consensus.cc:2393] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:25.982084  9470 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.982460  9436 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:25.984032  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:25.985208  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:25.992399  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:25.989578  9499 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:25.995362  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:25.953584  9474 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:25.996061  4944 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:26.000658  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.001644  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.002381  4873 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:25.979784  9426 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:26.007824  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:25.994334  9499 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:26.005834  9468 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:26.006276  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.010911  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.014740  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:25.991807  9472 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:26.016880  4944 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.015770  5606 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:26.009204  9509 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.010761  9417 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.019994  9417 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:26.022125  9509 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.013603  9452 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:26.031853  4948 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:26.033478  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:26.035761  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:26.034466  4867 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:26.034010  4948 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:26.039093  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:26.039639  4942 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:26.041923  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.042526  4872 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
I20260709 12:11:26.043064  9429 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.044795  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.045197  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:26.045849  4950 raft_consensus.cc:2368] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:26.046645  9450 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.046902  9509 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:26.049350  9429 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:26.049165  9452 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.049877  9429 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.053630  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.056936  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.057977  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.058549  5025 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:26.059228  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.059868  4874 raft_consensus.cc:2368] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12.
I20260709 12:11:26.061235  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.060956  4915 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:26.061947  5024 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:26.137072  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.077225  4874 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:26.068215  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.070888  4868 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.148334  4876 raft_consensus.cc:2393] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:26.070343  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.149264  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.150326  4876 raft_consensus.cc:2368] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:26.150535  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.151060  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.151309  4870 raft_consensus.cc:2368] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:11:26.107276  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.147384  4872 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:26.152356  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.151731  4876 raft_consensus.cc:2368] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:11:26.118768  4944 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:26.153808  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.063359  5021 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:26.155455  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.149012  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.156104  4869 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 18: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:26.157965  4868 raft_consensus.cc:2368] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:26.163589  4944 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:26.061668  9429 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.165766  4874 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:26.168190  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:26.166661  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.068454  9444 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.169245  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.171516  4870 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:26.167383  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.156036  9438 raft_consensus.cc:697] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:26.157123  9509 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.175076  4871 raft_consensus.cc:2368] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:26.176108  4944 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:26.180786  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.159121  9477 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:11:26.159266  9472 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:11:26.190584  4871 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:26.192322  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.171207  9444 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.198527  9376 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.199002  9376 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:26.185320  9436 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.202972  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:26.204895  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.209003  9438 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.210234  9499 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.222250  5600 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:26.201720  9470 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.224241  9476 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:26.227274  5020 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 2539) took 1638 ms (client timeout 1827 ms). Trace:
W20260709 12:11:26.227677  5020 rpcz_store.cc:269] 0709 12:11:24.588901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.589057 (+   156us) service_pool.cc:224] Handling call
0709 12:11:26.227116 (+1638059us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003de354. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:26.227204 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2323154304}
I20260709 12:11:26.228955  9430 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:26.201536  9481 raft_consensus.cc:2955] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:26.233819  9400 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.234426  4774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 245) took 1754 ms. Trace:
I20260709 12:11:26.234277  9400 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:26.234802  4774 rpcz_store.cc:276] 0709 12:11:24.479615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.479757 (+   142us) service_pool.cc:224] Handling call
0709 12:11:24.687558 (+207801us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:26.234369 (+1546811us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42342,"reported_tablets":1,"spinlock_wait_cycles":432340352}
W20260709 12:11:26.235809  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.236207  9487 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.782341  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:26.237653  9507 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.236639  9487 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:26.245479  5598 raft_consensus.cc:2368] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 18. Current term is 19.
I20260709 12:11:26.245646  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.182363  9509 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.196322  9444 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.262424  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:26.276636  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.277798  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.280063  9507 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.280392  9400 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.280530  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.281716  5022 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.282038  5022 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:26.282411  4917 leader_election.cc:400] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12.
I20260709 12:11:26.282948  9509 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:26.282737  5022 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:26.283830  5022 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.285372  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.289093  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.289237  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.289659  5017 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:26.290627  4915 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:26.292080  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.293165  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:26.293689  5023 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:26.294086  4991 leader_election.cc:400] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:26.295277  4991 leader_election.cc:400] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 6 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 6. Current term is 7.
I20260709 12:11:26.247478  9463 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.296727  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:26.307765  5022 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:11:26.309163  5022 pending_rounds.cc:85] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 6
I20260709 12:11:26.311560  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.314309  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:26.317029  4991 leader_election.cc:400] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:11:26.269660  9480 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.317240  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:26.271111  9513 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.318320  4991 leader_election.cc:403] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.319262  4942 raft_consensus.cc:2368] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:11:26.309927  5022 pending_rounds.cc:107] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:11:26.321631  5022 raft_consensus.cc:2889] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.324801  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:26.290954  9470 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:26.327399  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:26.298561  9507 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:26.320254  9400 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.336279  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:26.321542  9517 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9.
I20260709 12:11:26.315667  9362 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.336865  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:26.326361  9376 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.357390  4991 leader_election.cc:400] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:26.326326  9555 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:26.318442  9434 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:11:26.364063  5601 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:26.335423  9417 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.336362  9400 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:26.377121  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 62882.5us
I20260709 12:11:26.378106  4948 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:26.379766  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.381424  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.383266  4868 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:26.384850  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.385442  4868 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:26.337527  9470 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:26.327296  9513 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:26.391095  4871 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:26.396593  4988 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:26.399523  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:26.403021  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:26.403957  5567 leader_election.cc:400] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:11:26.410647  5567 leader_election.cc:403] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.363319  9432 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.363138  9509 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.418897  5570 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.420701  4869 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:26.415052  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:26.415817  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.416117  4950 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:26.417083  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:26.411675  5567 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.416684  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.421904  4867 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:26.422564  5567 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.428004  4868 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 19.
I20260709 12:11:26.389711  9400 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.429636  5570 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.432751  4988 leader_election.cc:400] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:26.433085  4988 leader_election.cc:403] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.401657  9555 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.458989  9455 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.413328  9443 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:11:26.408615  9434 consensus_queue.cc:1243] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:26.458403  9429 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.462435  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.417619  9462 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:26.390326  9476 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:11:26.430286  9479 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.469610  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.454053  9508 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:26.456508  9432 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:26.417287  9457 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:11:26.475548  5597 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:26.431572  9495 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:26.480214  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 46078.2us
I20260709 12:11:26.463379  9469 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.470801  9433 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.549782  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.476326  9466 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.550566  5024 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:26.569429  5024 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:26.464349  9555 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.476230  9463 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.477826  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.543742  9568 raft_consensus.cc:3055] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.472613  9420 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:11:26.551626  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:26.542899  9436 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.550544  9487 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:26.575568  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 97816.4us
I20260709 12:11:26.582824  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.570165  5024 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:26.586447  5024 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.544219  9509 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:11:26.586932  5023 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 19.
I20260709 12:11:26.581568  9444 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.587838  9468 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.591547  9467 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:26.592267  9574 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:26.593124  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:26.635111  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 92220.6us
I20260709 12:11:26.593308  5019 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:26.594168  5025 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:26.593840  5017 raft_consensus.cc:2955] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:26.575990  9568 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:26.597393  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:26.585065  9454 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:11:26.598527  9513 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:26.580602  9569 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:26.599071  9556 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:11:26.553968  9470 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.602880  9555 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.569088  9466 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.690160  9466 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:26.691262  9466 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.580581  9499 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.609125  4916 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:26.594090  5018 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:26.616215  5022 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:26.613981  9563 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:11:26.694095  9477 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:26.614101  9564 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:26.621573  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:26.629169  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 214184us
I20260709 12:11:26.695009  4839 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.695653  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:26.696251  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:26.696718  4991 leader_election.cc:400] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13.
I20260709 12:11:26.654354  9495 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:26.697940  9495 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:26.698124  9468 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.699079  9376 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.698807  9495 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.699476  9376 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:26.616954  9558 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:11:26.700345  9508 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.700676  9499 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:26.700961  9432 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:26.693709  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 84644.9us
W20260709 12:11:26.618296  9559 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:11:26.703140  9570 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.574872  9457 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 12:11:26.707010  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 85094.1us
I20260709 12:11:26.633693  5024 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:11:26.708456  5024 pending_rounds.cc:85] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 8
I20260709 12:11:26.708691  5024 pending_rounds.cc:107] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:26.708945  5024 raft_consensus.cc:2889] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.698750  9468 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:11:26.635098  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:11:26.710866  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 75840.2us
I20260709 12:11:26.711094  9477 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.711483  9477 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.711817  9477 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.619781  9509 consensus_queue.cc:1243] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:26.712452  9509 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:26.649287  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 53128us
I20260709 12:11:26.715188  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:26.678807  4942 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.687964  9449 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:26.699858  9376 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.715826  5606 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
W20260709 12:11:26.834939  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 67106.5us
I20260709 12:11:26.719696  9487 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:26.879480  4990 leader_election.cc:400] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 18. Current term is 19.
I20260709 12:11:26.879832  4990 leader_election.cc:403] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.834352  9570 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.891939  9576 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 18. Current term is 19.
W20260709 12:11:26.893913  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 176485us
I20260709 12:11:26.915126  4868 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:26.916496  4875 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:26.917275  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:26.644937  9567 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.237s
I20260709 12:11:26.919389  4841 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:26.924849  4875 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:26.877458  9487 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:26.686296  9569 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.935114  4869 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:26.845423  9572 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.205s
I20260709 12:11:26.935567  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:26.939822  4867 raft_consensus.cc:2368] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 18. Current term is 19.
I20260709 12:11:26.935534  4871 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:11:26.953747  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.897359  9570 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:26.971796  4867 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:26.972846  9570 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:26.973414  9593 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.973593  9569 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:26.975545  9552 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 12:11:26.977337  9468 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:26.977728  9468 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.851461  9568 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.978035  9468 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.978274  9444 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:26.979434  9580 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:26.981568  9466 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:26.982952  9466 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.983676  9552 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:26.984473  9400 consensus_meta.cc:287] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.524s	user 0.000s	sys 0.005s
I20260709 12:11:26.960099  9560 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:11:26.985666  4991 leader_election.cc:400] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 18. Current term is 19.
I20260709 12:11:26.987000  9487 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.987406  9430 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:26.988186  9426 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:11:26.999270  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 68144.6us
W20260709 12:11:27.015420  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 96108.4us
I20260709 12:11:26.970841  9474 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 12:11:27.024056  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.006960  9517 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:27.028064  9517 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:26.999828  9593 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:27.030272  9593 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:27.031926  9517 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:26.992538  9400 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:27.033535  9588 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:27.034513  9400 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:27.027016  9571 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:27.039534  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:27.071081  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 46553.3us
I20260709 12:11:27.079037  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:27.081539  5597 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:27.090741  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:27.094259  4770 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 13, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 13 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:27.096143  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:27.096421  9595 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:27.096843  9477 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.096931  9595 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.098994  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:27.113207  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:27.105191  4770 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:27.089296  9400 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:27.135231  9477 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:27.140120  9376 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:27.114188  9444 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:27.160074  9400 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.162241  9400 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:27.126183  9560 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 12:11:27.170102  9565 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:11:27.133899  9468 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.171942  9595 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:27.223589  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 519663us
I20260709 12:11:27.225864  4942 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:27.226354  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:27.242030  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:27.242568  4949 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:27.244798  4949 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:27.245600  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:27.250593  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:27.250952  4948 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:27.268606  4947 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:27.278342  4870 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:27.451499  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:27.331732  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.300359  4869 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:27.409969  4839 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:27.279078  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:27.456071  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.279078  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:27.444772  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:27.461794  5600 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:27.463790  5023 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:27.463922  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:27.464253  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:27.464540  5597 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.474179  4949 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:27.475037  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 65168.3us
I20260709 12:11:27.475554  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:27.465770  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:27.481632  4947 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:11:27.485868  4916 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:27.338120  9468 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:27.487303  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:27.480561  5597 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:27.265722  9372 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.218s
I20260709 12:11:27.272073  9455 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.214s
I20260709 12:11:27.509398  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:27.483413  9602 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:27.486759  9436 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 12:11:27.575055  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 89167.7us
I20260709 12:11:27.576637  9570 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.577289  9570 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:27.577726  9570 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.561177  9602 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:27.572059  9376 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:27.570407  9560 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:27.610059  9570 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:27.610821  9436 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:27.582600  9591 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:11:27.618126  9625 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:27.580200  4916 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:27.633394  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:27.644366  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 64785.3us
I20260709 12:11:27.647725  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:27.649019  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 136971us
I20260709 12:11:27.649909  4841 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:27.659731  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 173010us
I20260709 12:11:27.644066  9570 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:27.662916  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:27.668354  9629 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:27.668884  9629 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:27.643528  9436 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.637645  9560 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.661700  9590 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:27.662250  9628 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:27.650915  9625 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.678344  9560 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:27.675318  9571 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.673118  9570 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.671280  9629 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:27.674500  9624 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:27.676846  9590 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:27.678246  9615 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:11:27.849790  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.731343  9590 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:27.901510  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 250580us
I20260709 12:11:27.752503  9625 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:27.927806  9436 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:27.883697  9636 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:27.823729  9629 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:27.728525  9624 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.688521  9628 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.964970  9627 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:27.959163  9571 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:27.974382  9638 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:27.974954  9571 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:27.965605  9625 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:27.976882  9571 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:27.959973  9636 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.003654  9636 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.010466  9628 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.017685  9436 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:28.018210  9436 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.000069  9625 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:27.965538  9627 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.032876  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3433) took 1960 ms. Trace:
I20260709 12:11:28.033087  9627 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:28.033890  9635 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:11:28.035616  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 375124us
I20260709 12:11:27.960217  9629 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.043972  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:28.063971  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:28.067245  5016 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:28.020170  9436 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.023051  9625 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.077829  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.080304  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.080940  5598 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:28.082176  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.083648  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.084854  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.085405  4874 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:28.086704  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.034091  9476 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:28.089584  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:28.093732  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.091176  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.096486  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.036590  4876 rpcz_store.cc:276] 0709 12:11:26.072579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.159055 (+ 86476us) service_pool.cc:224] Handling call
0709 12:11:26.282260 (+123205us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b5800002a98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:11:26.282432 (+   172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.330345 (+ 47913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.330372 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.335934 (+  5562us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.602188 (+266254us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b180006d1e0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a0d1 00007f2a5a8a5a0f
0709 12:11:26.648231 (+ 46043us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:26.648268 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.032547 (+1384279us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b54001757d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:28.032596 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.032639 (+    43us) raft_consensus.cc:1685] finished
0709 12:11:28.032650 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.032784 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2772,"raft.queue_time_us":5295,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":18374,"spinlock_wait_cycles":129556480,"thread_start_us":45857,"threads_started":1,"wal-append.queue_time_us":353953,"wal-append.run_cpu_time_us":1205,"wal-append.run_wall_time_us":1001665}
I20260709 12:11:28.066512  9462 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:28.101234  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.103756  4867 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:28.067242  9570 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.103178  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:28.104686  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:28.105751  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:28.066213  9627 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:28.107637  9567 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:28.108680  9628 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:28.109719  9567 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:28.110208  9628 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:28.111728  9567 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:28.112025  9628 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:28.100134  9476 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.113503  9650 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.114084  9650 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.114573  4916 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:28.105471  9462 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.116068  9650 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.117161  9462 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.072356  9591 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:11:28.116588  9650 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.104563  9552 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:28.105013  9436 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:28.109907  9562 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 1.514s	user 0.006s	sys 0.008s
W20260709 12:11:28.149866  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 43520.7us
I20260709 12:11:28.134968  9625 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:28.140098  9624 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.141201  9629 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.142515  9476 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:28.206822  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 162929us
I20260709 12:11:28.164625  9475 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:28.212378  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 46491.2us
I20260709 12:11:28.134627  9590 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.197187  9625 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:28.206233  9469 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.134857  9552 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.218212  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1135) took 2011 ms. Trace:
I20260709 12:11:28.220167  5021 rpcz_store.cc:276] 0709 12:11:26.203793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.204582 (+   789us) service_pool.cc:224] Handling call
0709 12:11:26.204850 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.221143 (+ 16293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.221172 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.221589 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.335478 (+113889us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:26.335517 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.335577 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.109420 (+1773843us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:28.211465 (+102045us) raft_consensus.cc:1685] finished
0709 12:11:28.211485 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.215281 (+  3796us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24321,"raft.queue_time_us":16923,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":43352832,"thread_start_us":113492,"threads_started":1,"wal-append.queue_time_us":347598}
I20260709 12:11:28.233711  9568 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:28.245178  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 139510us
I20260709 12:11:28.219950  9625 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:28.256383  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47251.7us
W20260709 12:11:28.257375  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 142853us
I20260709 12:11:28.247301  9627 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:28.259519  4917 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:28.216962  9475 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.261173  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.263824  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.264505  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.264627  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:28.266235  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:28.315122  4951 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:28.260401  4942 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:28.296408  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.294858  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.307950  4950 raft_consensus.cc:2955] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:11:28.313303  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 53850.5us
I20260709 12:11:28.223997  9469 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:28.254670  9513 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:28.307834  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3453) took 1390 ms. Trace:
I20260709 12:11:28.319753  4917 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:28.323244  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 47465.2us
I20260709 12:11:28.325698  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:28.326849  4917 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:28.323125  4870 rpcz_store.cc:276] 0709 12:11:26.917200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.917687 (+   487us) service_pool.cc:224] Handling call
0709 12:11:26.917970 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.278715 (+360745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.307627 (+1028912us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54001752d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:28.307781 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828269312}
I20260709 12:11:28.339459  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:28.342303  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:28.343447  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:28.344201  9589 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 1.363s	user 0.011s	sys 0.003s
I20260709 12:11:28.344429  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:28.342478  9652 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:11:28.346367  9552 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:28.345080  9657 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:11:28.316033  9593 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.358537  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:28.359010  9610 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.360993  9469 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:28.362135  9663 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:28.362867  9599 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:28.363266  9517 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:28.363714  9515 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:28.365950  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:28.366286  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.366648  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.317876  9627 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.366920  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.367365  9430 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:28.368431  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.369735  4841 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:28.374425  5606 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:28.341775  9603 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.366220  9662 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.347558  9573 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:28.347136  9629 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.394917  4871 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:28.397624  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:28.414005  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 48134.4us
I20260709 12:11:28.414527  5597 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:28.325210  9513 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.355188  9660 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.370617  9372 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.399142  5599 raft_consensus.cc:2955] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:28.412914  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.398555  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:28.415248  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 45610.9us
I20260709 12:11:28.368707  9638 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.377681  9508 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:28.376760  9552 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:28.414685  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:28.417641  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:28.382570  9495 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:28.378722  9462 consensus_queue.cc:1059] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:28.389920  9610 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:28.411675  9517 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:28.468927  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 44520.7us
I20260709 12:11:28.433089  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.464494  4951 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:11:28.583142  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:28.419399  9450 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.614207  9600 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:28.615161  9661 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:11:28.405447  9599 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.615849  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3451) took 1699 ms. Trace:
I20260709 12:11:28.425448  9638 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:28.420910  9660 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:28.446089  9474 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:28.451303  9443 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:28.449906  9372 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.412269  9430 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.449024  9602 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:28.465181  9625 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.705897  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:28.421401  9629 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:28.405598  9663 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.418562  9662 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:28.878690  4943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.079s	sys 0.089s
W20260709 12:11:28.981642  4988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.061s	sys 0.128s
W20260709 12:11:29.241448  4943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.092s	sys 0.116s
W20260709 12:11:28.863534  4950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.027s	sys 0.031s
W20260709 12:11:29.147850  4947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.042s	sys 0.084s
W20260709 12:11:29.009986  4948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.015s	sys 0.056s
W20260709 12:11:29.242076  4988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.063s	sys 0.133s
W20260709 12:11:29.242825  4950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.031s	sys 0.045s
W20260709 12:11:29.243548  4947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.042s	sys 0.086s
W20260709 12:11:28.983600  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 568946us
W20260709 12:11:29.050308  5568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.005s	sys 0.017s
W20260709 12:11:29.245138  5568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.006s	sys 0.018s
W20260709 12:11:29.006294  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.034931  5604 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.011s	sys 0.021s
W20260709 12:11:29.034745  4946 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.014s	sys 0.017s
W20260709 12:11:29.243824  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 885300us
W20260709 12:11:29.247537  4946 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.014s	sys 0.019s
W20260709 12:11:29.061254  5599 consensus_meta.cc:287] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.000s
W20260709 12:11:29.248318  5604 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.011s	sys 0.023s
W20260709 12:11:29.243759  4948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.015s	sys 0.064s
I20260709 12:11:28.846793  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:29.085837  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 2325) took 1003 ms. Trace:
I20260709 12:11:28.471726  9573 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:28.471536  9481 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:29.272189  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:29.197016  4915 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.549s (SENT)
I20260709 12:11:29.040773  9436 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:29.237159  9593 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:29.281903  9436 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.282019  9593 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.283991  9436 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.284281  9593 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.271802  4874 rpcz_store.cc:276] 0709 12:11:28.082866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.085920 (+  3054us) service_pool.cc:224] Handling call
0709 12:11:28.086187 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.152282 (+ 66095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.152314 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.162968 (+ 10654us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.340773 (+177805us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.340857 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.340925 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.085623 (+744698us) raft_consensus.cc:1685] finished
0709 12:11:29.085643 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.085776 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32243,"raft.queue_time_us":63598,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":98,"thread_start_us":131101,"threads_started":1,"wal-append.queue_time_us":181692}
I20260709 12:11:29.274852  4942 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:28.472012  9590 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:29.130060  9575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.727s	user 0.024s	sys 0.088s
I20260709 12:11:29.285806  4949 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:28.879523  9515 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:29.040975  9480 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:28.472775  9495 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.135061  9610 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:29.251924  9638 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.612260  9508 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.188474  9513 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.170899  9627 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.472554  9552 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:28.934777  9607 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:28.732937  4873 rpcz_store.cc:276] 0709 12:11:26.916664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.916774 (+   110us) service_pool.cc:224] Handling call
0709 12:11:26.919422 (+  2648us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.919722 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.919749 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.929935 (+ 10186us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.120504 (+1190569us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b18000e91a0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a0d1 00007f2a5a8a5a0f
0709 12:11:28.346955 (+226451us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:28.346999 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.347058 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.615580 (+268522us) raft_consensus.cc:1685] finished
0709 12:11:28.615599 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.615792 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6316,"raft.queue_time_us":19128,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7856,"spinlock_wait_cycles":4337024,"thread_start_us":226290,"threads_started":1,"wal-append.queue_time_us":1472995}
I20260709 12:11:28.714679  9600 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:28.843613  9400 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:28.425634  9456 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.271572  9603 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:29.271234  9591 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:29.062105  9437 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:11:29.086639  9619 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:29.243098  9474 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:29.279024  9581 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:28.853503  9499 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.289542  9475 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:29.299136  9575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.314s	user 0.032s	sys 0.103s
W20260709 12:11:29.295168  9624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.035s	sys 0.072s
W20260709 12:11:29.294245  9653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.005s	sys 0.015s
I20260709 12:11:29.375945  9603 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:29.386524  9653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.005s	sys 0.015s
I20260709 12:11:29.387933  9603 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:28.786942  9462 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:29.040504  9450 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:29.389286  9450 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.160893  9599 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.252842  9660 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:29.317245  4990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.000s	sys 0.018s
W20260709 12:11:29.392827  4990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.000s	sys 0.019s
W20260709 12:11:29.393131  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 1.01306e+06us
I20260709 12:11:29.321918  9607 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.395180  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 3370) took 1093 ms. Trace:
I20260709 12:11:29.395541  4948 rpcz_store.cc:276] 0709 12:11:28.301371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.301488 (+   117us) service_pool.cc:224] Handling call
0709 12:11:28.301825 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.302206 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.302233 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.302654 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.250853 (+948199us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.250892 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.250956 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.394979 (+144023us) raft_consensus.cc:1685] finished
0709 12:11:29.394999 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.395112 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4032,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":947571,"threads_started":1,"wal-append.queue_time_us":1090826}
I20260709 12:11:29.396435  9607 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.397594  4948 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:11:29.326841  9629 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:29.398190  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 984) took 1048 ms. Trace:
I20260709 12:11:29.398548  4948 rpcz_store.cc:276] 0709 12:11:28.349503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.397084 (+1047581us) service_pool.cc:224] Handling call
0709 12:11:29.397386 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.397929 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.398125 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.329033  9456 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.399353  9456 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.316226  9610 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.400769  9487 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.329704  9625 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.329512  9517 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.296083  9515 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.331549  9662 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:29.277129  9443 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.315824  9600 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.319775  9400 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.286348  9573 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.294193  9481 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:29.334666  9568 consensus_meta.cc:287] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 1.100s	user 0.010s	sys 0.001s
I20260709 12:11:29.305204  9480 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.388633  9462 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:29.399705  4948 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:29.401592  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 3369) took 1100 ms. Trace:
I20260709 12:11:29.330814  9495 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:29.331267  9372 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:29.374032  9604 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.383350  9624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.035s	sys 0.072s
I20260709 12:11:29.401181  9610 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.425437  9456 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.089330  9577 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:29.435781  4948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 985) took 1084 ms. Trace:
I20260709 12:11:29.337615  9591 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.434702  4943 rpcz_store.cc:276] 0709 12:11:28.301095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.303353 (+  2258us) service_pool.cc:224] Handling call
0709 12:11:28.303613 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.303912 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.303938 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.304359 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.242420 (+938061us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:29.242457 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.242530 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.401414 (+158884us) raft_consensus.cc:1685] finished
0709 12:11:29.401432 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.401542 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2508,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":937738,"threads_started":1,"wal-append.queue_time_us":1087684}
I20260709 12:11:29.437716  4945 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:11:29.376616  9437 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:29.419003  9597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.015s	sys 0.038s
I20260709 12:11:29.384364  9581 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.477593  4945 pending_rounds.cc:85] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 8
I20260709 12:11:29.513128  4945 pending_rounds.cc:107] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 11.9
W20260709 12:11:29.509544  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 262250us
I20260709 12:11:29.513381  4945 raft_consensus.cc:2889] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.476959  4948 rpcz_store.cc:276] 0709 12:11:28.349718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.399216 (+1049498us) service_pool.cc:224] Handling call
0709 12:11:29.399514 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.433788 (+ 34274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.433989 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.515630  4988 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:11:29.517524  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 311221us
I20260709 12:11:29.518499  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 1314) took 1225 ms. Trace:
W20260709 12:11:29.519500  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 322506us
W20260709 12:11:29.519861  4870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.002s	sys 0.018s
W20260709 12:11:29.522938  4870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.002s	sys 0.018s
W20260709 12:11:29.520095  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 274147us
W20260709 12:11:29.467387  9587 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 2.492s	user 0.005s	sys 0.050s
I20260709 12:11:29.525135  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:29.521767  5604 rpcz_store.cc:276] 0709 12:11:28.293277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.298027 (+  4750us) service_pool.cc:224] Handling call
0709 12:11:28.298269 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.298466 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:29.275193 (+976727us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.518140 (+242947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.518194 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:29.518244 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.518308 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.518439 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1089084,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"thread_start_us":1192257,"threads_started":2}
I20260709 12:11:29.528801  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3460) took 1158 ms. Trace:
I20260709 12:11:29.529148  4947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 2836) took 1260 ms. Trace:
I20260709 12:11:29.541034  4870 rpcz_store.cc:276] 0709 12:11:28.370067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.713141 (+343074us) service_pool.cc:224] Handling call
0709 12:11:28.713391 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.713577 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:11:28.845113 (+131536us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.524466 (+679353us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.528507 (+  4041us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.528552 (+    45us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:11:29.528597 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.528655 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.528752 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3813,"prepare.queue_time_us":131485,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":4859,"spinlock_wait_cycles":7700224,"thread_start_us":677897,"threads_started":1}
I20260709 12:11:29.461649  9459 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:11:29.466876  9495 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:29.528017  9597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.050s	user 0.019s	sys 0.038s
I20260709 12:11:29.547988  4872 raft_consensus.cc:2410] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:29.475183  9476 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:29.551571  4988 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:29.528260  9444 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:29.553575  5569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.005s	sys 0.021s
I20260709 12:11:29.566468  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 2837) took 1291 ms. Trace:
I20260709 12:11:29.477149  9680 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:29.607793  5569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.197s	user 0.009s	sys 0.027s
I20260709 12:11:29.610011  4950 rpcz_store.cc:276] 0709 12:11:28.275421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.307426 (+ 32005us) service_pool.cc:224] Handling call
0709 12:11:28.307676 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.307852 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:28.361371 (+ 53519us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.566141 (+1204770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.566191 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.566242 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.566303 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.566414 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9286,"raft.queue_time_us":40143,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4197,"thread_start_us":1195097,"threads_started":2,"wal-append.queue_time_us":1024660}
I20260709 12:11:29.611645  9598 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:29.631302  9667 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:29.436895  9474 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.543632  9462 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:29.531885  9577 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:29.666544  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 141481us
I20260709 12:11:29.716292  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2583) took 1678 ms. Trace:
W20260709 12:11:29.675508  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 124003us
I20260709 12:11:29.719630  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3454) took 2802 ms. Trace:
W20260709 12:11:29.671504  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 125405us
I20260709 12:11:29.732252  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:29.733335  5023 raft_consensus.cc:2410] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:11:29.675159  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 58617.4us
I20260709 12:11:29.736034  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:29.731702  4868 rpcz_store.cc:276] 0709 12:11:26.917439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.922384 (+  4945us) service_pool.cc:224] Handling call
0709 12:11:26.922662 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.009041 (+ 86379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.009069 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.302112 (+2293043us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b2c000014c8. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a591e3a11 00007f2a591f3372 00007f2a5a925a01 00007f2a5a8ea43a 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2
0709 12:11:29.302496 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.611187 (+308691us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:29.611223 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.611305 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.719330 (+108025us) raft_consensus.cc:1685] finished
0709 12:11:29.719347 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.719559 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54031,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":16819968,"thread_start_us":377993,"threads_started":2,"wal-append.queue_time_us":364515}
I20260709 12:11:29.738071  5021 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:29.620106  9479 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:29.762351  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:29.475261  9604 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:29.719493  9673 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 12:11:29.765163  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.712631  9592 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 2.416s	user 0.000s	sys 0.032s
I20260709 12:11:29.775506  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:29.730894  5024 rpcz_store.cc:276] 0709 12:11:28.038155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.038302 (+   147us) service_pool.cc:224] Handling call
0709 12:11:28.038629 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.038943 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.038968 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.398124 (+1359156us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b2c0003d8a8. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a591e3a11 00007f2a591f3372 00007f2a5a925a01 00007f2a5a8ea43a 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2
0709 12:11:29.398476 (+   352us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.546632 (+148156us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:29.547718 (+  1086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.548332 (+   614us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.716025 (+167693us) raft_consensus.cc:1685] finished
0709 12:11:29.716046 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.716236 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11969,"raft.queue_time_us":63320,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3990,"spinlock_wait_cycles":58645376,"thread_start_us":142970,"threads_started":1,"wal-append.queue_time_us":206989}
I20260709 12:11:29.764500  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:29.777591  5023 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:29.690675  9599 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.705653  9573 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.742231  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:29.767743  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:29.717262  9668 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:11:29.771432  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:29.611996  9476 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.611654  9495 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.713052  9481 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.659473  9456 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:29.742616  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:29.827069  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:29.618562  9444 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.709544  9400 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.776101  5022 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:29.677287  9517 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.701229  9677 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.713048  9480 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.665421  9681 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.660405  9552 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:29.738265  9508 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.765894  9462 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.709352  9443 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:29.809538  9691 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:29.825918  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1318) took 1427 ms. Trace:
I20260709 12:11:29.722369  9600 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.769585  9479 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.881299  5599 rpcz_store.cc:276] 0709 12:11:28.398527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.398633 (+   106us) service_pool.cc:224] Handling call
0709 12:11:28.398860 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.399041 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:29.248192 (+849151us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.825623 (+577431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.825674 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.825711 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.825768 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.825868 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93943,"raft.queue_time_us":302776,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":8297,"thread_start_us":482968,"threads_started":2,"wal-append.queue_time_us":529580}
I20260709 12:11:29.885679  5604 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:29.874567  9517 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:29.886758  9679 log.cc:927] Time spent T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:11:29.887662  9577 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.887348  9517 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.888284  9517 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.889011  9703 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:29.618656  9680 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:29.877627  9591 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.881546  9581 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.889540  9703 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.901456  9706 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:29.901789  9680 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:29.895991  9691 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.895756  9677 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:29.905386  9707 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:29.905926  9707 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.906780  9710 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
W20260709 12:11:29.905086  9660 consensus_meta.cc:287] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.001s
I20260709 12:11:29.906162  9706 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.805164  4944 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:11:29.937471  4944 pending_rounds.cc:85] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 10
I20260709 12:11:29.938059  4944 pending_rounds.cc:107] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:29.938499  4944 raft_consensus.cc:2889] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.941641  4946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 2831) took 1675 ms. Trace:
I20260709 12:11:29.874608  5016 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.942112  4946 rpcz_store.cc:276] 0709 12:11:28.265601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.269155 (+  3554us) service_pool.cc:224] Handling call
0709 12:11:28.269450 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.269796 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.269821 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.270251 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.247921 (+977670us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.247962 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.248023 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.940913 (+692890us) raft_consensus.cc:1685] finished
0709 12:11:29.940971 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.941356 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"thread_start_us":977320,"threads_started":1,"wal-append.queue_time_us":1162232}
W20260709 12:11:29.949841  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.950371  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.953903  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:29.955037  5021 raft_consensus.cc:2410] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:29.812613  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:29.953835  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:29.873025  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 141727us
I20260709 12:11:29.871966  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:29.873435  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:29.963006  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:29.963873  5603 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:29.966138  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:29.966984  5600 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:29.882942  9437 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:29.970588  9400 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:29.873023  9456 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.971607  9400 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.973268  9487 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:29.974236  9487 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:29.975951  9456 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.812172  9610 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.767068  9515 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.805964  9568 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:29.968597  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:29.977205  9508 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:29.984582  9572 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.985483  9604 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.985208  9508 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:29.971546  9437 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:29.989917  9600 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:29.799659  9692 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:29.991508  9572 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.909485  9677 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.998302  9443 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.994912  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:29.989571  9660 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:29.976754  9456 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:29.985146  9476 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.004801  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.001189  9508 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:29.992586  9625 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.020570  9479 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:30.028033  9487 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.028734  9703 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.031242  5016 raft_consensus.cc:2410] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:30.031883  9568 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.013299  9437 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.034557  9568 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.035043  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 3466) took 1663 ms. Trace:
I20260709 12:11:30.035715  9437 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.036121  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.035964  9456 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.038878  9456 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.040334  5019 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:30.040621  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.041457  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.041952  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:30.042203  5020 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:30.042369  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.043093  5019 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:30.043263  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.044443  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.041956  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.045622  5024 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:30.043220  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.044713  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.046693  9443 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.052587  9443 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.050046  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.046594  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.053592  5022 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:30.050189  5020 raft_consensus.cc:2410] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:30.054272  5024 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:30.055665  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3462) took 1685 ms. Trace:
I20260709 12:11:30.056036  4874 rpcz_store.cc:276] 0709 12:11:28.370731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.289020 (+918289us) service_pool.cc:224] Handling call
0709 12:11:29.289295 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.475777 (+186482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.475807 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.475844 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:29.475879 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.055189 (+579310us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002c29d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.055248 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.055464 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428476800}
I20260709 12:11:30.057492  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:30.073396  5025 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.060976  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 92163.5us
I20260709 12:11:29.542879  4947 rpcz_store.cc:276] 0709 12:11:28.268606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.268708 (+   102us) service_pool.cc:224] Handling call
0709 12:11:28.269043 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.269374 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.269401 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.269862 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.244930 (+975068us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:29.527820 (+282890us) log.cc:844] Serialized 14 byte log entry
0709 12:11:29.528856 (+  1036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.528932 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.528972 (+    40us) raft_consensus.cc:1685] finished
0709 12:11:29.528984 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.529096 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":561,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":11043,"thread_start_us":1223667,"threads_started":2,"wal-append.queue_time_us":1118916}
I20260709 12:11:30.054123  9660 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.063289  9692 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.083083  9692 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.067806  9625 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.084219  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1327) took 1137 ms. Trace:
I20260709 12:11:30.085827  9625 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.086923  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1323) took 1238 ms. Trace:
I20260709 12:11:30.087303  5602 rpcz_store.cc:276] 0709 12:11:28.847978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.848097 (+   119us) service_pool.cc:224] Handling call
0709 12:11:28.848371 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.321434 (+473063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.321465 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.321504 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.321534 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.086490 (+764956us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54003197d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.086542 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.086763 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087503616}
I20260709 12:11:30.078408  9691 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.089283  9437 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:30.090680  5605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1326) took 1146 ms. Trace:
I20260709 12:11:30.091018  5605 rpcz_store.cc:276] 0709 12:11:28.944906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.945148 (+   242us) service_pool.cc:224] Handling call
0709 12:11:28.945424 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.437204 (+491780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.437233 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.437276 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:29.437311 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.090244 (+652933us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540044aa54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.090302 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.090540 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130581888}
I20260709 12:11:30.092294  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.094465  5606 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:30.095182  5606 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1324) took 1159 ms. Trace:
I20260709 12:11:30.095564  5606 rpcz_store.cc:276] 0709 12:11:28.936729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.937060 (+   331us) service_pool.cc:224] Handling call
0709 12:11:30.093357 (+1156297us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b5800157898. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:11:30.093745 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.094897 (+  1152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.095117 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12704512}
I20260709 12:11:30.070006  9443 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.072373  9677 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:30.028460  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 76899.5us
I20260709 12:11:30.035436  4872 rpcz_store.cc:276] 0709 12:11:28.373163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.701537 (+328374us) service_pool.cc:224] Handling call
0709 12:11:30.034630 (+1333093us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54002b6bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:30.034808 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683114752}
I20260709 12:11:30.148626  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.148105  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.151033  5605 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:30.150270  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.151741  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.152026  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.152380  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.153637  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:30.139353  9638 consensus_meta.cc:287] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.008s
I20260709 12:11:30.154881  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.155046  9638 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.156713  4951 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.150341  5606 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:30.161403  9638 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.163659  5025 raft_consensus.cc:2410] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:30.101488  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.166680  5018 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:30.167065  5600 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:30.084658  5601 rpcz_store.cc:276] 0709 12:11:28.946778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.947130 (+   352us) service_pool.cc:224] Handling call
0709 12:11:30.082953 (+1135823us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b5800157898. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:11:30.083281 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.083697 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.083719 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.083784 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:30.083857 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.083912 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.084023 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7780736}
W20260709 12:11:30.172168  9611 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 2.592s	user 0.019s	sys 0.015s
I20260709 12:11:30.101990  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.182057  9462 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.182828  9462 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.187443  9462 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:30.188880  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.189857  9443 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.192371  9443 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:30.188651  4841 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.102772  9430 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.182447  9516 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.188730  9598 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:30.198153  9598 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.197880  9516 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.200465  9516 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.205158  9655 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:30.206653  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2572) took 3124 ms. Trace:
I20260709 12:11:30.207056  5017 rpcz_store.cc:276] 0709 12:11:27.081795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.081900 (+   105us) service_pool.cc:224] Handling call
0709 12:11:27.082188 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.090808 (+  8620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.090834 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.091735 (+   901us) log.cc:844] Serialized 26 byte log entry
0709 12:11:27.278145 (+186410us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:27.278184 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.278619 (+   435us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.171223 (+2892604us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:30.206089 (+ 34866us) raft_consensus.cc:1685] finished
0709 12:11:30.206118 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.206444 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8290,"raft.queue_time_us":15309,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":27147264,"thread_start_us":185994,"threads_started":1,"wal-append.queue_time_us":459530}
I20260709 12:11:30.213176  4841 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.215714  9470 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:30.216162  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 3371) took 1914 ms. Trace:
I20260709 12:11:30.216516  4949 rpcz_store.cc:276] 0709 12:11:28.301632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.453702 (+152070us) service_pool.cc:224] Handling call
0709 12:11:28.453965 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.294962 (+840997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.215678 (+920716us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b5400376254. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.216005 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912702208}
I20260709 12:11:30.217032  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1312) took 1824 ms. Trace:
I20260709 12:11:30.217356  5598 rpcz_store.cc:276] 0709 12:11:28.392174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.392272 (+    98us) service_pool.cc:224] Handling call
0709 12:11:28.392520 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.316651 (+924131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.316681 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.316720 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:29.316757 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.216649 (+899892us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b5400836154. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.216702 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.216865 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124836736}
I20260709 12:11:30.216435  9707 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.221582  9655 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:30.222339  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 443429us
I20260709 12:11:30.221952  4841 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:30.218132  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3456) took 3225 ms. Trace:
I20260709 12:11:30.228956  9658 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.228132  4869 rpcz_store.cc:276] 0709 12:11:26.992352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.992458 (+   106us) service_pool.cc:224] Handling call
0709 12:11:27.006342 (+ 13884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.461298 (+454956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.217675 (+2756377us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54001b2e54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.217964 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675668352}
I20260709 12:11:30.209545  9444 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.225003  9655 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.231240  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.231946  9718 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.231987  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.233788  5600 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
W20260709 12:11:30.233806  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.235186  5598 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:30.235489  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.237234  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.236845  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.239517  9560 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.239617  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.240885  9560 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:30.242278  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.233563  9655 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:30.244159  9560 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.244326  5605 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.245810  9449 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:30.245760  9711 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 12:11:30.250662  9718 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.251595  9449 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:30.253310  9628 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:30.253571  9718 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:30.242880  9658 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.249855  4990 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:30.257256  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 56069.5us
I20260709 12:11:30.258119  9658 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.252700  9706 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.263094  5605 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:30.263849  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.266242  9432 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:30.266657  9432 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.267053  9432 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.273275  4841 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:30.273461  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 2818) took 3045 ms. Trace:
I20260709 12:11:30.274413  9560 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.260227  9449 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:30.277817  9630 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.278496  9572 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.277369  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:30.279959  9704 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.370s	user 0.000s	sys 0.001s
I20260709 12:11:30.312109  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.281467  9655 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.282260  9400 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.283066  9718 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:30.288570  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.275341  4945 rpcz_store.cc:276] 0709 12:11:27.227971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.266536 (+ 38565us) service_pool.cc:224] Handling call
0709 12:11:27.454308 (+187772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.513985 (+2059677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.273070 (+759085us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b540011add4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.273298 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4560688000}
I20260709 12:11:30.292234  9628 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.292171  9706 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:30.293032  4951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 3377) took 1990 ms. Trace:
I20260709 12:11:30.294479  9495 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.290048  9598 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.295300  9691 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:30.296588  9658 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:30.318897  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.321723  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.323050  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.315905  4951 rpcz_store.cc:276] 0709 12:11:28.303038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.614693 (+311655us) service_pool.cc:224] Handling call
0709 12:11:28.614950 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.157274 (+1542324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.292763 (+135489us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b540007b054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.292982 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3544625920}
I20260709 12:11:30.324115  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.325004  4951 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:30.324833  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.325345  9628 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.325850  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.327162  4951 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:30.327828  9628 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.328202  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.297299  9623 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.297801  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.298352  9638 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.297330  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.307334  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.289732  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 2815) took 3063 ms. Trace:
I20260709 12:11:30.308566  5017 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:30.316004  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.329389  4951 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:30.317220  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.296201  9432 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.332039  4947 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:11:30.318778  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.309676  9630 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:30.326120  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.333094  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.333351  5024 raft_consensus.cc:2410] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 12:11:30.329038  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 51806us
I20260709 12:11:30.333508  4948 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:30.317451  5019 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:11:30.334450  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.313596  9655 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.334621  9638 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.335316  4948 raft_consensus.cc:2410] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:30.329936  5020 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:30.327095  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.331575  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.328855  9691 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.329830  5604 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:30.330322  4944 rpcz_store.cc:276] 0709 12:11:27.226643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.226752 (+   109us) service_pool.cc:224] Handling call
0709 12:11:27.227000 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.939595 (+2712595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.289495 (+349900us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b5400118ad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.289680 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5928438656}
I20260709 12:11:30.321691  9658 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.289755  9603 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:11:30.323290  9701 log.cc:927] Time spent T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.418s	user 0.000s	sys 0.002s
I20260709 12:11:30.331930  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.331045  9623 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.331393  9481 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.337462  4950 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:30.341794  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:30.338016  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 49676.2us
I20260709 12:11:30.341971  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.338411  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.337879  4943 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:30.340024  4945 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 4.
W20260709 12:11:30.338912  9697 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.429s	user 0.001s	sys 0.001s
W20260709 12:11:30.339766  9705 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.432s	user 0.003s	sys 0.000s
I20260709 12:11:30.333117  9630 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.345454  9598 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.349431  9481 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:30.343535  9432 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.361315  4841 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.344066  9658 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.361997  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.347239  9603 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.336786  9638 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.364693  4915 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:30.342248  9691 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.368645  9560 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.364014  9481 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.369582  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.370792  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.369609  9623 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.376544  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 983) took 2027 ms. Trace:
I20260709 12:11:30.377770  9598 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.376935  4942 rpcz_store.cc:276] 0709 12:11:28.349253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.295748 (+946495us) service_pool.cc:224] Handling call
0709 12:11:29.303689 (+  7941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.467084 (+163395us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:29.661098 (+194014us) log.cc:844] Serialized 14 byte log entry
0709 12:11:30.148262 (+487164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.148368 (+   106us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:30.148481 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.376173 (+227692us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54001a2a54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:30.376223 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.376378 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":413894,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":122,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":193,"spinlock_wait_cycles":375331072,"thread_start_us":593691,"threads_started":2,"wal-append.queue_time_us":475680}
I20260709 12:11:30.378701  9602 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.379119  9602 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.379495  9602 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.379761  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.380303  5605 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.380712  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.364832  5601 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:30.337100  9615 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:30.387254  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.389941  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.390105  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.390513  5019 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:30.390959  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.391247  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.367033  9603 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:30.391964  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.392518  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.394229  5016 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:30.394425  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.394858  5600 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.378675  9432 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.397480  9603 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.398046  4915 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.400767  4841 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.399025  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.404191  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:30.399801  5025 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:30.393231  9658 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:30.398425  9432 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:30.412832  9432 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.414933  9481 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.407788  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 343) took 4572 ms. Trace:
I20260709 12:11:30.371068  9663 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.417428  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.417900  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.418090  5025 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:30.418762  9663 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:30.418936  9623 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.410117  9658 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.420188  9658 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:30.428686  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.432747  4916 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.434495  9444 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:30.434525  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:30.435111  9444 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:30.436122  9444 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.416972  4770 rpcz_store.cc:276] 0709 12:11:25.793372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.793566 (+   194us) service_pool.cc:224] Handling call
0709 12:11:30.364024 (+4570458us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:27.566104 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:27.577139 (+ 11035us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:27.577172 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:11:27.577189 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:27.577555 (+   366us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:27.577627 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:27.577654 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:11:27.577955 (+   301us) tablet.cc:701] Row locks acquired
0709 12:11:27.577973 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:11:27.578115 (+   142us) write_op.cc:270] Start()
0709 12:11:27.578223 (+   108us) write_op.cc:276] Timestamp: P: 1783599087578058 usec, L: 0
0709 12:11:27.578240 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:11:27.610658 (+ 32418us) log.cc:844] Serialized 913 byte log entry
0709 12:11:28.001396 (+390738us) op_driver.cc:464] REPLICATION: finished
0709 12:11:28.231344 (+229948us) write_op.cc:301] APPLY: starting
0709 12:11:28.231433 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:28.232921 (+  1488us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:28.233005 (+    84us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:28.234293 (+  1288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:28.234484 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:11:28.234525 (+    41us) write_op.cc:312] APPLY: finished
0709 12:11:28.236022 (+  1497us) log.cc:844] Serialized 33 byte log entry
0709 12:11:28.236172 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:28.236256 (+    84us) write_op.cc:454] Released schema lock
0709 12:11:28.236291 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:28.236630 (+   339us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:28.236653 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":440402,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":229729,"apply.run_cpu_time_us":3985,"apply.run_wall_time_us":5285,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":399218,"prepare.run_cpu_time_us":14841,"prepare.run_wall_time_us":132019,"raft.queue_time_us":309685,"raft.run_cpu_time_us":29634,"raft.run_wall_time_us":209569,"replication_time_us":423009,"thread_start_us":661956,"threads_started":4,"wal-append.queue_time_us":75937,"wal-append.run_cpu_time_us":27014,"wal-append.run_wall_time_us":1550354}]]}
I20260709 12:11:30.445578  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:30.440037  9432 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.425093  9481 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:30.453938  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 60087.7us
I20260709 12:11:30.455482  5600 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:30.450343  9691 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:30.458297  4990 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.464497  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1325) took 1524 ms. Trace:
I20260709 12:11:30.464581  4772 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:30.464908  5597 rpcz_store.cc:276] 0709 12:11:28.940332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.940641 (+   309us) service_pool.cc:224] Handling call
0709 12:11:30.450286 (+1509645us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b5800157898. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5a22 00007f2a606de8d9 00007f2a5f838ee0 00007f2a5f9020ab 00007f2a5f902131 00007f2a5f8c3fc0 00007f2a5f8ae929 00007f2a5f8ae3d2 00007f2a58e25bd4
0709 12:11:30.463890 (+ 13604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.464089 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:30.464114 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:30.464148 (+    34us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:30.464179 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.464224 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.464331 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8158464}
I20260709 12:11:30.467873  4772 catalog_manager.cc:5697] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.467811  9648 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:30.466141  9655 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.472879  9648 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:30.473342  9648 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.473373  9655 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.475306  9474 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.475740  9655 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.472447  4772 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 10 to 12, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.478217  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.481135  4772 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 13 to 14, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 14 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.482789  5605 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:30.486121  4772 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 11 to 13, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:30.486860  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 88913.4us
I20260709 12:11:30.487751  4772 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.487591  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.490197  9603 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.491194  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.491955  9623 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.491608  4772 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:30.492365  9623 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:30.492992  9623 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.469061  9663 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:30.497607  9663 raft_consensus.cc:697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:30.498512  9663 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.503347  9691 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.503801  9691 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:30.507377  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.515830  9691 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.517455  9432 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.518257  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.492945  9628 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:30.492344  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.520785  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.521863  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:30.522145  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.523226  4949 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:30.524132  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.507534  9630 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.530469  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.531106  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.557440  5604 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:30.556303  4944 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:30.558233  5605 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:30.558597  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.559428  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.566659  9572 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.567096  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.467549  9602 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:30.569764  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.572489  4841 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:30.567080  9572 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:30.576113  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 78730.9us
I20260709 12:11:30.576601  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.576890  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.577693  5601 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.579342  9400 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.579762  9400 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.580128  9400 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.580873  9655 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:30.581422  9655 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:30.582727  9603 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.582396  9655 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.585031  9560 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:30.588863  9572 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.597199  9630 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.597863  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.598205  9602 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.602094  9623 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.604184  9623 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.567569  9684 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:30.605146  9684 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:30.606145  9684 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.607095  9684 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.609119  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:30.609434  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:30.609655  4950 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.609941  9658 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.611866  9658 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.615231  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.615737  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.616062  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.616521  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.617187  5022 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:30.617547  4943 raft_consensus.cc:1240] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:30.618530  9560 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:30.619439  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.606781  5601 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:30.588678  5606 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:30.621508  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.622409  5600 raft_consensus.cc:2410] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:11:30.627672  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 135390us
I20260709 12:11:30.629925  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.630991  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.632316  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.632576  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.634891  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:30.635281  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:30.635890  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.636327  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.637632  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.638670  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.639395  9615 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:30.588758  9691 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.639971  9615 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.642014  9615 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.642448  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.643529  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.644042  5603 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.645100  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.633932  4949 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:30.644884  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.639609  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.645668  4948 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:30.648888  9676 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:30.649245  9726 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:11:30.649798  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.646850  5599 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:30.653544  5017 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:30.653908  5017 pending_rounds.cc:85] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 9
I20260709 12:11:30.654103  5017 pending_rounds.cc:107] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:30.654305  5017 raft_consensus.cc:2889] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:30.655541  4944 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.607031  9572 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.657459  4948 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.659375  9572 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.659996  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.662699  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.663968  4915 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.664654  9691 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:30.665620  9691 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.647174  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.636350  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.672235  5025 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:11:30.674918  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:30.676012  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.678606  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.644933  9630 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:30.683836  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.695542  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:30.695942  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 48828.5us
I20260709 12:11:30.677498  9658 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.642465  9615 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:11:30.695623  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 49264.1us
I20260709 12:11:30.703851  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.705787  4950 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:30.701849  4942 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:30.708775  9457 consensus_queue.cc:1059] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:30.709911  9457 raft_consensus.cc:3055] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:30.710283  9457 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:30.712939  4943 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.714088  4990 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.719696  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:30.720280  4944 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:30.711141  9457 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.704905  9602 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:30.729760  5016 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.670071  9648 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.741689  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.746721  4942 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:11:30.747699  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.749228  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.683527  9676 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.750519  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.754909  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.731724  9432 raft_consensus.cc:2764] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:30.745272  9602 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:30.740602  9615 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.755661  9638 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.766427  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:30.770313  9625 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.746389  9630 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.768985  9623 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:11:30.755421  9516 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:30.774003  9630 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.772246  9625 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.774673  9457 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.774923  9625 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.760979  9646 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.765753  4839 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.783645  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.785221  4915 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.787217  9692 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:30.787609  9692 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:30.788455  9692 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.789709  9692 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.790171  9560 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:30.789786  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 128159us
I20260709 12:11:30.767756  9638 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:30.774185  9516 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.798141  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.799324  5601 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.790927  9676 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:30.801460  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.779788  9400 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.795898  9638 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.808604  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.796217  9516 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:30.802947  9646 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:30.812449  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.813040  9599 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.805244  9691 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.816319  9572 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:30.819576  9376 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:30.820858  9675 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.821995  9449 consensus_queue.cc:1059] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:30.815220  9599 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:30.827065  9725 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 12:11:30.828593  4988 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:30.830730  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45595.4us
I20260709 12:11:30.832840  4951 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:30.815376  9646 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.820590  9630 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.841823  9516 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.843431  9376 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.845490  9376 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:30.842238  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.838724  5567 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:30.857201  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.846308  9646 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.837311  9599 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.843282  9516 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:30.867573  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 104001us
I20260709 12:11:30.869493  5604 raft_consensus.cc:2410] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:30.871759  4988 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.858682  9648 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.879685  9623 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:30.879916  9734 log.cc:927] Time spent T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:30.880249  5567 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:30.881527  4949 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:30.881896  9699 consensus_queue.cc:1059] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:30.882881  9699 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.883204  9686 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:30.884950  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:30.885950  9684 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:30.886312  9684 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:30.887120  9684 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.885100  9507 raft_consensus.cc:3055] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:30.888196  9507 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:30.884716  9677 consensus_queue.cc:1059] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:11:30.889600  9677 raft_consensus.cc:3055] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.889295  9507 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.889999  9677 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:30.883219  9699 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.890614  9699 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.890796  9677 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.892633  9677 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.893123  9376 raft_consensus.cc:3055] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:30.893492  9376 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:30.894304  9376 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.895428  9376 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:30.895896  9507 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.878288  9432 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:30.878517  9676 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:30.899154  9676 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.824900  9602 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.902745  5602 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:30.880164  9610 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:30.903374  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.888224  9684 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.899542  9676 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.931033  9400 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:30.931747  9648 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.932240  9648 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.934139  9648 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.935397  9599 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:30.938596  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:30.945324  4988 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.946578  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:30.947674  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.948334  9444 raft_consensus.cc:3055] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:30.948689  9615 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:30.948799  9444 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:30.963143  9675 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:30.948237  9432 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.965286  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.980818  5603 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:30.985788  4915 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.909247  9623 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.965970  9610 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:30.993958  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:30.966821  9457 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:30.965283  9675 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:30.994539  4841 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:30.967043  9432 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:30.996644  9630 consensus_queue.cc:1059] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:11:31.007228  9572 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.006860  9433 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:31.008081  9433 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:31.008458  9433 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:30.997923  9457 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:31.014707  9457 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:30.994918  9610 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:31.019580  9610 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:11:31.024890  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.967931  9699 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:30.994506  9691 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:31.002853  9675 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.988040  9686 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 12:11:31.042302  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 165856us
I20260709 12:11:31.005120  9432 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.043133  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 223315us
W20260709 12:11:31.043396  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54511.2us
I20260709 12:11:31.045858  4915 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:30.993297  9625 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.046931  4839 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:31.047813  4915 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.041996  9691 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:31.058693  9623 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.059080  9449 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:31.059538  9449 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.059697  9646 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.062426  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:31.062942  5597 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:31.063079  9692 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.060352  9449 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.064286  9638 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.065416  9555 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:31.066277  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.066411  9555 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:31.066583  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.067600  9692 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.067994  9692 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:31.068331  9692 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.049397  9444 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.069198  9444 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.071704  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:31.048478  9560 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.048717  9599 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:31.051240  9400 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.077880  4946 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.057281  9691 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.106557  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:31.107573  4951 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.108610  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.068014  9555 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.125233  5606 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:31.126780  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.082643  9400 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:31.120929  9555 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:31.137370  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.148274  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:31.148521  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.149648  4946 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:11:31.145110  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 143105us
I20260709 12:11:31.155962  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:31.156998  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.143270  9400 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.159955  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:31.162541  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:31.083115  5597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39450
I20260709 12:11:31.120800  9676 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.166597  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:31.142004  9684 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:11:31.166208  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:31.163340  5597 raft_consensus.cc:606] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:31.169533  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.172016  4946 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:31.178584  5602 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.182111  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:31.185521  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 182106us
I20260709 12:11:31.187892  5606 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:31.189513  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.190568  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.190302  9560 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.196307  9499 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:31.196838  9499 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.198791  9499 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:31.196728  9560 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.200037  9741 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.198509  9433 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.203215  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.203791  4951 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.200660  9457 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.184453  9699 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:31.211692  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.219528  9433 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:31.220438  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.220539  9457 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:31.204309  9646 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:31.234277  9555 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.235258  9676 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:31.235504  9555 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.215530  9625 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.200532  9741 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:31.247108  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 256626us
I20260709 12:11:31.254201  4915 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.255062  5568 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.258890  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.262562  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.263944  5018 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:31.264559  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:31.264707  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.265763  5021 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:31.266485  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 120829us
I20260709 12:11:31.270181  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.284477  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.289906  9692 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.262682  9699 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:31.294057  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.295126  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.295774  4942 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:31.296423  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.292713  9692 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.282928  9572 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:31.329092  9749 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.340463  9741 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.341239  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.342401  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.343698  4945 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:31.347808  4948 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:31.331607  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.355978  5602 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:31.357169  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:31.329615  9623 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.362499  9457 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:31.371923  4841 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:31.378361  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:31.378587  5597 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.340396  9638 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.382725  9675 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.385879  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:31.387516  9741 consensus_queue.cc:1059] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:31.388607  9426 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.388903  9426 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:31.390048  9748 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:31.389906  9426 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.390491  9748 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:31.390885  9748 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.391137  9426 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:31.330271  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 46993.7us
W20260709 12:11:31.330667  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:31.331126  9744 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.117s	user 0.000s	sys 0.005s
I20260709 12:11:31.395038  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:31.329167  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.395908  4839 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:31.397923  9755 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.398031  4951 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:31.333035  9691 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.333652  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.283123  9625 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.334640  9599 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:31.286495  9752 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:31.335201  9400 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.336208  9432 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.329039  4942 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.337644  9507 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:31.394433  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 65353.2us
W20260709 12:11:31.396011  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 66951.7us
I20260709 12:11:31.438077  9507 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:31.331615  9658 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:31.398277  9630 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:31.439766  9507 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.441071  9507 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.442385  9400 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:31.398712  9755 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.422915  9555 consensus_queue.cc:1059] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:31.446278  9675 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.447011  9555 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.447363  9555 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:31.399390  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:31.448441  4949 raft_consensus.cc:2410] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:31.403620  5568 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:31.332219  9754 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.063s	user 0.003s	sys 0.000s
I20260709 12:11:31.388893  9738 raft_consensus.cc:3055] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:31.449141  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45581.2us
I20260709 12:11:31.410569  5567 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:31.417122  4946 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:31.418203  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 132689us
I20260709 12:11:31.422401  4943 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:31.424084  4944 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:31.425091  9691 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:31.425630  9750 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.204s	user 0.003s	sys 0.002s
I20260709 12:11:31.426375  9759 consensus_queue.cc:1059] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:31.398764  9610 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.428227  9470 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:11:31.433916  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.452908  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.450047  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.460146  4840 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.466810  9684 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:31.457886  9433 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.467703  9433 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:31.468045  9433 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.470940  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:31.472836  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:31.473469  9646 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.473827  9646 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:31.474918  9610 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.474627  9646 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.448769  9599 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.476127  5023 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:31.477581  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.477885  9432 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.466750  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:31.478528  5025 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.463392  9699 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:31.480202  9755 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.453783  9738 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.481180  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.481379  9738 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.482406  9738 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.485307  9599 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:31.486164  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.486723  4946 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:31.486832  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.487864  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.488083  9596 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.488379  9655 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:31.488843  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 89504.8us
I20260709 12:11:31.489257  9770 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.489121  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.491677  9684 consensus_queue.cc:1059] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:31.492364  9756 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:31.492640  9684 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:31.493105  9376 consensus_queue.cc:1059] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:31.493602  9684 raft_consensus.cc:3055] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:31.493762  9677 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.494066  9376 raft_consensus.cc:3055] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.494494  9376 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.485595  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.495858  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.496315  5605 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:31.496367  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:31.497135  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:31.497706  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:31.497447  4942 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:31.498750  4950 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:31.506178  4943 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:31.480336  9699 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:31.504980  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:31.508134  9699 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.508673  9759 raft_consensus.cc:3055] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.509114  9759 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.509622  9599 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.510138  9599 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:31.461997  9555 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.511219  9555 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.511173  9599 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.489333  9630 raft_consensus.cc:697] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.509925  9759 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.512847  9630 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.513288  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.514324  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:31.514834  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.494624  9470 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.516986  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.519275  4947 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.521518  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.522605  4946 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.523247  4990 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:31.474570  9400 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.529318  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:31.494009  9684 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:31.475745  9646 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:31.535552  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47756.5us
I20260709 12:11:31.536489  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.494944  9677 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:31.537256  4990 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:31.535753  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.545389  5025 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:31.504266  9691 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:31.549278  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 100878us
I20260709 12:11:31.549741  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.519616  9470 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.551172  9596 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:31.552295  9449 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:31.531759  9658 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:31.516479  9676 consensus_queue.cc:1175] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "baa50eb5ed704004b7f391934a59d010" responder_term: 8 status { last_received { term: 8 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 8 index: 10 } }
I20260709 12:11:31.553411  9758 consensus_queue.cc:1059] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:11:31.551345  9476 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:31.554903  9376 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.556195  9376 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.557327  9655 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.531476  9741 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.554069  9577 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:31.546262  9752 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.518712  9675 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:11:31.515825  9748 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.564404  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:31.558910  9470 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.546722  9755 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.562799  9615 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:11:31.564971  9756 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:31.570317  9481 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:31.581907  9747 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:11:31.585037  9648 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.575958  9655 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:11:31.585374  9648 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.585960  9655 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.586328  9655 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.587188  9655 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.586251  9648 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.589781  9770 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.583042  9470 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.594344  9748 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.566883  9677 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.600625  5023 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:31.601847  5604 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:31.588516  9655 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.608788  9675 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:31.610976  9433 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.612041  5605 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:31.625149  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.632360  4869 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:11:31.637075  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 60423.7us
I20260709 12:11:31.638628  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.641494  9759 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.642567  9677 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.648285  9773 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:11:31.649362  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.650225  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.652275  4874 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:11:31.654174  9648 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.654071  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:31.652647  9769 log.cc:927] Time spent T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:11:31.656209  5601 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.649926  9684 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.659704  4872 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.661826  9684 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:31.671834  4915 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:31.704972  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.707059  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.707757  4867 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:11:31.708637  9499 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:31.706979  9615 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:11:31.709547  9499 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.709931  9499 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:31.710752  9499 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.711936  9499 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.721249  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.721886  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:31.724852  9781 log.cc:927] Time spent T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:11:31.726789  4869 raft_consensus.cc:1240] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:31.728315  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:31.728777  5025 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.706096  9691 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.737223  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.737799  4867 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:31.741310  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:31.744549  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.727068  9433 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:31.749590  4991 leader_election.cc:336] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.558s (SENT)
I20260709 12:11:31.757448  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.759197  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.759277  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.760382  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.761072  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.761380  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.761946  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.761392  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.762636  4870 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.763131  4875 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:31.763996  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.764149  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.762984  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.765232  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.767110  4876 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:31.744699  9691 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:31.768282  9691 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.770140  9755 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.770515  9755 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:11:31.776075  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.777221  4867 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:31.761982  4868 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:31.771818  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:31.784958  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.785082  4870 raft_consensus.cc:2410] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:31.791141  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.791992  4873 raft_consensus.cc:2410] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:31.805321  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.806875  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.814695  5025 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:31.815656  4872 raft_consensus.cc:2393] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:31.818691  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.820771  9755 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:31.822302  9755 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:31.825006  9782 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:11:31.816089  5568 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:31.850188  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.851105  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.851699  4874 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:31.852458  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.853003  4874 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:31.853176  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.854089  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.854398  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.855688  4868 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:31.857101  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.819324  4870 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:31.858668  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.855732  4867 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:31.860092  4873 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 19.
I20260709 12:11:31.868417  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.872447  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.873994  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.875244  4868 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.857966  9433 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:31.875911  9433 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:31.876643  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.876818  9433 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.878082  4871 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:31.888479  9675 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:31.889000  9675 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:31.890918  9675 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:31.893132  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:31.893603  4876 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.893718  5600 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:31.895015  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:31.895182  4990 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:31.895704  4942 raft_consensus.cc:2393] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:31.902530  4875 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:31.904038  9476 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:31.913478  9476 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:31.913836  9476 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.915112  4874 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:31.917701  4867 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:31.926987  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.931541  4772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 392) took 5978 ms. Trace:
I20260709 12:11:31.945634  4874 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:31.934876  4769 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:31.952788  4769 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 11 to 13, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 13 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:31.964128  4769 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:31.932705  4772 rpcz_store.cc:276] 0709 12:11:25.953152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.953281 (+   129us) service_pool.cc:224] Handling call
0709 12:11:31.931490 (+5978209us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:30.813866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:30.896963 (+ 83097us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:30.897008 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:11:30.897025 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:30.897870 (+   845us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:30.897944 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:30.897971 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:30.898659 (+   688us) tablet.cc:701] Row locks acquired
0709 12:11:30.898708 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:11:30.898872 (+   164us) write_op.cc:270] Start()
0709 12:11:30.899017 (+   145us) write_op.cc:276] Timestamp: P: 1783599090898804 usec, L: 0
0709 12:11:30.899037 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:11:30.902350 (+  3313us) log.cc:844] Serialized 2834 byte log entry
0709 12:11:31.400680 (+498330us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:31.551631 (+150951us) op_driver.cc:464] REPLICATION: finished
0709 12:11:31.620459 (+ 68828us) write_op.cc:301] APPLY: starting
0709 12:11:31.620567 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:31.624979 (+  4412us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:31.625022 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:31.768318 (+143296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:31.768606 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:11:31.768652 (+    46us) write_op.cc:312] APPLY: finished
0709 12:11:31.807504 (+ 38852us) log.cc:844] Serialized 73 byte log entry
0709 12:11:31.834051 (+ 26547us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:31.856170 (+ 22119us) write_op.cc:454] Released schema lock
0709 12:11:31.856236 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:31.873974 (+ 17738us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:31.874002 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":280740,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":59994,"apply.run_cpu_time_us":10918,"apply.run_wall_time_us":253497,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33373,"num_ops":7,"prepare.queue_time_us":294239,"prepare.run_cpu_time_us":47417,"prepare.run_wall_time_us":345831,"raft.queue_time_us":47932,"raft.run_cpu_time_us":10659,"raft.run_wall_time_us":88826,"replication_time_us":632222,"spinlock_wait_cycles":37636480,"thread_start_us":498048,"threads_started":4,"wal-append.queue_time_us":290187}]]}
I20260709 12:11:31.966975  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:31.971957  4769 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 9 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:31.974136  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.974395  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.974891  4875 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:31.978349  4874 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:31.979274  4870 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.976918  4769 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:11:31.981925  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.983317  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:31.984161  4874 raft_consensus.cc:2410] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:31.986269  4769 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:31.996608  9476 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.004535  4872 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:32.004964  9476 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:32.006186  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.008134  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:32.015951  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:32.018069  5604 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:32.022655  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.023237  4875 raft_consensus.cc:2376] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10. Re-sending same reply.
I20260709 12:11:32.024091  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.025164  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.026309  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.026661  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.027674  4868 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:32.028450  4942 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:32.029140  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.022964  9481 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:11:32.029714  4871 raft_consensus.cc:2376] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9. Re-sending same reply.
I20260709 12:11:32.030699  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.031311  4876 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:32.031816  4944 raft_consensus.cc:2393] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:32.028694  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.032614  4873 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 19.
I20260709 12:11:32.034179  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.034773  4872 raft_consensus.cc:2393] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:32.035768  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.036343  4870 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:32.040865  9677 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:32.042517  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.045328  4917 leader_election.cc:336] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.728s (SENT)
I20260709 12:11:32.045742  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.046397  9658 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.050207  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.051947  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.052711  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.053926  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.062273  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.062589  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.053114  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.062785  4870 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.053238  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.052676  4875 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:32.057117  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.066017  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:32.066879  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.066915  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.063964  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.068637  4867 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:32.069247  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.053587  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.070585  4871 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:32.063937  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.059290  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.071544  4868 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:32.071976  4872 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:32.070477  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.059329  5601 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:32.073406  4876 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:32.073809  4990 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.074872  9432 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:32.060079  4769 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:32.075388  9432 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:32.076542  9432 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.069375  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.081529  4867 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:32.082054  4873 raft_consensus.cc:2410] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:32.084787  4870 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:32.088526  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.086356  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.087889  4867 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:32.090369  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.086647  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.085815  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.086090  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.088313  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:11:32.101217  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.101622  4868 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:32.101948  4874 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:32.106019  4873 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:32.107668  4872 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 9: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:32.111423  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.114764  4875 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:32.100287  9677 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.115646  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.117313  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.117805  4867 raft_consensus.cc:2376] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13. Re-sending same reply.
I20260709 12:11:32.122892  4944 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:32.128593  9599 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:11:32.135186  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.126905  4871 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:32.143512  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.149394  4871 raft_consensus.cc:2376] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11. Re-sending same reply.
I20260709 12:11:32.125308  9677 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.156522  9677 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:32.162549  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:32.163129  4944 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:32.164281  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.164937  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:32.166576  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:32.167204  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:32.167812  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:32.168308  9474 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:32.168727  9474 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.167760  5018 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:32.169178  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:32.169093  9474 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.167732  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:32.170465  5023 raft_consensus.cc:2393] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:32.175911  5025 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:32.177573  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:32.181403  5024 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:32.185216  9555 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.185854  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:32.185690  9555 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.186621  5019 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:32.185604  5570 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.177297  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:32.185391  5021 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:32.187736  9555 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:32.188249  9555 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.188792  9599 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:32.188959  9433 consensus_queue.cc:1059] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:32.189291  9599 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.190048  9677 raft_consensus.cc:3055] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:32.190222  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:32.190456  9677 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:32.186566  5023 raft_consensus.cc:2410] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:32.186764  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.191304  9677 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.198163  9677 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.199630  9741 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.199748  4991 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:32.200378  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.200724  9432 raft_consensus.cc:2764] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:32.212862  9599 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:32.215289  9691 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.215757  9691 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:32.218398  9691 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:32.221846  9599 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:32.222363  9599 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:32.227530  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.193377  9474 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.190837  4948 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:32.194046  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.194079  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:32.194146  9555 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:32.197257  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:32.238245  5021 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:32.239663  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.241315  5568 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:32.242525  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 53777.5us
I20260709 12:11:32.243101  5570 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.244022  9658 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.244187  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:32.245085  5023 raft_consensus.cc:2410] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:32.245815  4991 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.246707  9675 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:32.247295  5025 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:11:32.249552  9802 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:11:32.249714  9433 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:32.250128  9433 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:32.253137  9776 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.253571  9776 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.253430  9433 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:32.254616  9776 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.255832  5570 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.256536  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:32.258919  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.248564  9610 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:32.254266  9599 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:32.265234  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.265820  4870 raft_consensus.cc:2376] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13. Re-sending same reply.
I20260709 12:11:32.266924  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.268451  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.270131  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.271097  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.271579  4871 raft_consensus.cc:2376] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10. Re-sending same reply.
I20260709 12:11:32.272746  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.261600  5019 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:32.263548  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.264796  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.273329  4875 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:32.274151  4867 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:32.253851  9555 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.277283  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.274156  9610 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:32.280320  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.280646  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.260578  9684 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.278002  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.239677  9432 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:11:32.269833  9638 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.278483  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.291532  4873 raft_consensus.cc:2393] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:32.299367  9610 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:32.304618  9432 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.304984  9432 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:32.305752  9432 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.306988  9432 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.280292  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.301350  9555 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:32.262413  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:32.311843  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 49493.7us
I20260709 12:11:32.310204  5017 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:32.302665  5604 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:32.313192  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.316192  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.316998  4872 raft_consensus.cc:2410] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:32.317850  9474 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:32.318171  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.318841  4872 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:32.320206  4872 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:32.321285  9638 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.321743  9481 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:32.322698  9481 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:32.322990  9481 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:32.323800  9481 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.314131  9400 raft_consensus.cc:2764] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:11:32.325505  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 47150.1us
I20260709 12:11:32.326020  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.260330  9646 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:32.330178  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 84422.9us
I20260709 12:11:32.331137  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.330884  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.337881  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:32.338414  4942 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.339370  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.341094  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.341452  4991 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:32.343155  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 79717.7us
I20260709 12:11:32.320271  9809 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:32.352241  5016 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:32.339085  9599 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.337294  9499 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.353219  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.352229  9738 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.370839  5570 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.371925  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.356184  9598 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:32.377436  9598 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:32.377763  9598 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:32.378538  9598 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.379712  9598 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.380710  4942 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:32.386554  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:32.356956  4840 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.357535  9646 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.389055  9755 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.358002  9433 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.391080  9433 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:32.391644  9433 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:32.392087  9433 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:32.355753  9481 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:32.393642  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:32.394863  9433 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.358242  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.343797  9648 raft_consensus.cc:2764] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:32.369498  9474 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.399121  9474 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:32.399514  9474 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.376312  9684 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.376673  9677 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.399156  9646 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.402774  9776 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.405715  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:32.406231  5016 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.344909  9610 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:32.408497  9610 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:32.409576  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:32.400919  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.411175  4991 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.388233  5570 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.412942  5016 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:32.413069  4942 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.414121  5568 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:32.417035  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 103918us
I20260709 12:11:32.418042  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.419152  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.425451  4942 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
W20260709 12:11:32.425134  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.439201  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.440176  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.440997  9432 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:32.415820  9807 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:32.415738  9599 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.461252  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:32.485702  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 45584us
W20260709 12:11:32.486433  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47316us
I20260709 12:11:32.486901  4917 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.417205  9677 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.418196  9684 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.421149  9776 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:32.492507  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.420879  9555 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:32.501245  4840 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.416577  9646 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:11:32.491793  9400 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.491870  9476 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.441622  9625 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.507479  4769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 359) took 2209 ms. Trace:
W20260709 12:11:32.507987  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 46802.5us
I20260709 12:11:32.488016  9432 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:32.502880  9499 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.442485  9577 consensus_queue.cc:1059] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:11:32.438666  9610 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:32.505476  9809 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:32.574934  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 60355us
W20260709 12:11:32.561374  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 43951.2us
W20260709 12:11:32.581086  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 67512.9us
I20260709 12:11:32.585479  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.582132  5604 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:32.508548  9638 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.511762  9433 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.611003  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.513262  9555 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:32.553687  4774 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.517760  9449 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.504824  9677 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.509706  4769 rpcz_store.cc:276] 0709 12:11:30.294481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.294750 (+   269us) service_pool.cc:224] Handling call
0709 12:11:32.503369 (+2208619us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:32.196456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:32.213923 (+ 17467us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:32.213956 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:11:32.213969 (+    13us) tablet.cc:662] Decoding operations
0709 12:11:32.214737 (+   768us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:32.214790 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:32.214814 (+    24us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:32.215361 (+   547us) tablet.cc:701] Row locks acquired
0709 12:11:32.215375 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:11:32.215519 (+   144us) write_op.cc:270] Start()
0709 12:11:32.236658 (+ 21139us) write_op.cc:276] Timestamp: P: 1783599092215472 usec, L: 0
0709 12:11:32.236682 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:11:32.250783 (+ 14101us) log.cc:844] Serialized 2820 byte log entry
0709 12:11:32.315733 (+ 64950us) op_driver.cc:464] REPLICATION: finished
0709 12:11:32.316070 (+   337us) write_op.cc:301] APPLY: starting
0709 12:11:32.316146 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:32.319619 (+  3473us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:32.319711 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:32.326471 (+  6760us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:32.355927 (+ 29456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:11:32.385392 (+ 29465us) write_op.cc:312] APPLY: finished
0709 12:11:32.406380 (+ 20988us) log.cc:844] Serialized 73 byte log entry
0709 12:11:32.407195 (+   815us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:32.407299 (+   104us) write_op.cc:454] Released schema lock
0709 12:11:32.407341 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:32.407700 (+   359us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:32.407726 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39934,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":9367,"apply.run_wall_time_us":91587,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29246,"num_ops":7,"prepare.queue_time_us":60617,"prepare.run_cpu_time_us":3396,"prepare.run_wall_time_us":109068,"replication_time_us":75718,"thread_start_us":28029,"threads_started":1}]]}
I20260709 12:11:32.514256  9432 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:32.615898  9691 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.617319  4774 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.587921  9809 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:32.613555  9684 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.591789  9807 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:32.621730  9577 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.632647  4774 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.619119  9433 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.628244  9809 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:32.650019  9433 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:32.659072  9677 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:32.661912  9432 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.663798  9432 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:32.640333  9555 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.664939  9809 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.673491  4774 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:32.685091  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 177655us
W20260709 12:11:32.685619  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 45682.3us
I20260709 12:11:32.686147  9625 raft_consensus.cc:3055] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:32.689363  9625 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:32.690219  9625 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.691263  9625 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.687040  9449 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:32.692955  9738 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:32.693176  9648 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:32.695919  9677 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:32.698550  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.706620  5570 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.707410  9433 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.631561  9684 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.708256  9809 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:32.711572  9476 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.714002  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.715047  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.715175  9433 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.715790  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:32.716498  5604 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:32.716951  9675 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.717579  9675 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.708228  9474 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.717598  5601 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:32.719919  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.730871  4774 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.711431  9684 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:32.737313  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.737258  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.737922  4874 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.734639  4774 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 12, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:32.719811  9677 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.729349  9752 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.749799  4942 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.749763  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.749524  9474 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:32.751130  4873 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:32.754788  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.756135  4874 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:32.760445  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.761153  4871 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:32.755448  4873 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:32.761610  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:32.762171  4874 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:32.768960  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.767804  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:32.770689  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:32.770895  9474 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:32.771292  4942 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:32.772573  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:32.773397  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:32.779749  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:32.780331  4942 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:32.782280  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:32.785290  4944 raft_consensus.cc:1275] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 12:11:32.785781  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 174829us
I20260709 12:11:32.787402  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:32.788659  5024 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:32.791323  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:32.791899  5024 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:32.795658  4942 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:32.796492  4946 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:32.801023  4917 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.802343  4917 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.805279  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.807303  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.810900  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.785061  9815 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:32.767599  9648 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:32.802227  9433 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.797915  9819 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:32.807332  9776 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:32.804446  9677 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.829548  9691 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.805075  9810 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.806460  9812 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:32.809733  9658 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:32.847093  5604 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:32.835760  9400 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:32.862895  5567 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:32.872063  4871 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:32.846223  9433 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.832830  9555 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:11:32.878134  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:32.851523  9776 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.856752  9820 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.857445  9577 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:32.889461  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 88028.9us
I20260709 12:11:32.884970  9432 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:32.873395  9658 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:32.878391  9433 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.875229  9400 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:32.893821  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 82982.8us
I20260709 12:11:32.882606  9815 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:32.882797  9474 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.855127  9819 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.895649  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.883387  9776 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.859112  9677 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.862000  9810 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:32.905994  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 67670.3us
I20260709 12:11:32.906530  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.893728  9820 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:32.898123  9815 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.915086  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:32.892210  9577 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.909601  9474 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.930294  4874 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:32.930748  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:32.931947  9638 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:32.945246  9829 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:11:32.946856  9400 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.904090  9648 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:32.937098  9835 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:32.916363  9815 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.957489  9658 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:32.909874  9836 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:32.921887  9691 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.953774  9684 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.913179  9646 consensus_queue.cc:1048] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:11:32.962378  4868 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:32.970623  4872 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:32.973202  5025 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 19. Current term is 20. Ops: []
I20260709 12:11:32.975526  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:32.960744  9827 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:11:32.985483  9824 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:32.987851  9577 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:32.952611  9767 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.032312  4946 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:11:33.036733  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 226615us
I20260709 12:11:33.037422  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:32.974361  9831 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:33.044255  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.046051  5025 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:32.952948  9474 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:33.051694  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.030225  9599 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:33.043239  9432 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:11:32.974905  9684 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:33.060330  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 71367.4us
I20260709 12:11:33.038111  9767 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:33.115818  9828 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:11:33.123308  9684 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.123914  9684 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:33.079753  9840 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:11:33.126005  9840 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:11:33.126381  9840 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:33.127146  9840 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.129164  9819 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.130693  9474 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.057355  9831 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.141455  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.142107  4948 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:33.079736  9599 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.088150  9839 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:11:33.145797  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 89985.7us
I20260709 12:11:33.149371  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:33.147244  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 99263.2us
I20260709 12:11:33.149997  5604 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:33.151963  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.152959  5567 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.044896  9820 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:33.153839  4949 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:33.155139  5604 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:33.160080  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:33.160887  5604 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:33.146522  9810 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.161793  4916 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:33.165007  9449 raft_consensus.cc:3055] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:33.190871  4990 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:33.191870  9844 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:33.201612  4917 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:33.187017  9823 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:33.188464  9836 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.209369  9610 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:33.209769  9610 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:33.209860  9844 raft_consensus.cc:3055] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:33.210160  9610 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.210465  9844 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:33.191118  9449 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:11:33.216995  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 155590us
I20260709 12:11:33.217096  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.220319  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.220952  5017 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:33.222815  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.228428  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:33.229605  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.230316  5017 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:33.214628  9823 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.206314  9836 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:33.238258  4869 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:33.238819  4869 raft_consensus.cc:606] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:33.239121  4869 raft_consensus.cc:614] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:33.225255  9812 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:33.251310  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:33.269263  4916 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:33.237375  9810 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.239802  9836 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.237927  9823 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.237568  9638 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.271206  9835 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:33.252067  9767 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.272769  9810 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.278209  9555 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.273746  9812 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:33.300232  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:33.294814  9759 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.303670  9812 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.304416  9759 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:33.304831  9847 log.cc:927] Time spent T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:11:33.285146  9449 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.293092  9855 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:33.309160  9855 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.301196  9555 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.315946  4873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:33.316488  4873 raft_consensus.cc:606] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:11:33.279738  9638 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.296514  9810 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.318104  5025 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:33.322635  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.299233  9599 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.325227  4948 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:33.329283  9815 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.331605  4839 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:33.348781  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.349716  5025 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:11:33.354861  4868 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:33.355698  9868 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.356117  9868 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.356434  9868 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.358063  9831 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.358476  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:33.359978  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:33.360697  4869 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:33.360937  9767 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:33.361404  9767 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.363255  9767 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.362957  9433 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.368335  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:33.377357  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.378118  5025 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:33.368919  5601 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:11:33.379685  4916 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.349368  9555 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.386219  9677 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.383958  9812 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:33.387043  9812 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:33.387382  9812 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:33.392107  9433 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:33.393465  9815 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.393941  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.395040  9638 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.395430  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:33.395568  9855 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.385030  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.395963  5024 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.405290  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.400334  9840 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:33.401880  9759 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.402212  9807 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:33.414600  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.402793  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:33.415823  4868 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.415910  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.416469  4949 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:33.416760  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.403286  4946 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:33.419624  9812 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.420611  4942 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
I20260709 12:11:33.421113  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:33.415844  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:33.425390  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.426426  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.427116  4944 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:33.427801  5024 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:33.421772  5605 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:33.431342  9815 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:33.437422  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:33.440544  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.441957  5021 raft_consensus.cc:2393] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:33.443531  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.451004  4916 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.448676  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:33.452888  4944 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.452265  5567 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.455574  5567 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:33.461241  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.465248  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:33.469259  4946 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.463302  9855 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.463128  9831 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:11:33.457778  9638 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.476825  9638 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.477183  9638 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.477667  5605 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:33.457374  9555 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.479225  9555 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.479564  9555 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.449510  9815 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:33.481212  9815 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:33.481590  4944 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:33.482088  9815 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.516825  9812 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:33.517264  9776 consensus_meta.cc:287] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.004s
I20260709 12:11:33.517705  9776 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.518044  9807 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.519706  5605 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:11:33.520150  9838 log.cc:927] Time spent T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.433s	user 0.006s	sys 0.000s
I20260709 12:11:33.522058  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:33.522743  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:33.523409  4942 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:33.524518  9776 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:33.526525  9638 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.527911  4876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:33.528442  4876 raft_consensus.cc:606] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:33.531399  9855 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.536214  4946 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:33.545408  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:33.545356  5567 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.547137  4942 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:33.547639  5567 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.550972  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:33.549125  5601 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 5.
I20260709 12:11:33.557358  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:33.437455  9823 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.440034  9836 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.563512  4916 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.569806  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:33.570341  4871 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.531821  9610 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.590116  9855 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.531330  9810 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.590727  9449 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:33.591102  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 58007.8us
I20260709 12:11:33.592211  9810 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.592756  9810 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:33.593204  9810 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.573894  9853 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:33.594321  9853 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.551556  9658 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:11:33.594691  9853 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:33.590673  9855 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:33.595944  9555 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.596079  9855 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.574292  9840 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:33.597926  9555 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.567973  9849 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.578925  9823 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.580216  4876 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:33.581249  9868 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.598714  9849 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.600553  9868 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.582466  9867 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.601326  4945 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:33.583045  5604 raft_consensus.cc:2368] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:33.592243  5019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:33.602641  5019 raft_consensus.cc:606] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:33.546671  9684 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.603745  9684 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.604513  9823 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:33.574141  9615 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.606781  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 45597.3us
W20260709 12:11:33.606937  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 45367.4us
I20260709 12:11:33.605970  4948 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:33.606817  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:33.609869  4942 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.607831  5600 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:33.528396  9638 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.573248  5568 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:33.614938  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:33.615636  5604 raft_consensus.cc:2368] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:33.612790  4871 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:33.622886  9810 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:33.644313  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:33.644969  4945 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.645625  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:33.646219  4947 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.646948  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:33.647693  4946 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:33.584967  9809 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:11:33.651639  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 45630.6us
I20260709 12:11:33.632210  4942 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:33.649199  5016 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:33.650393  4916 leader_election.cc:400] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:33.653126  4916 leader_election.cc:403] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.650585  4990 leader_election.cc:400] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:33.653577  4990 leader_election.cc:403] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.600725  9849 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:33.657683  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.658468  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 50040.5us
I20260709 12:11:33.659482  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:33.660799  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:33.661077  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:33.611927  9577 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.669260  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 55407.6us
I20260709 12:11:33.665016  5019 raft_consensus.cc:2393] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 5: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:33.667743  5021 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:11:33.668460  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 43597.9us
I20260709 12:11:33.658166  9841 raft_consensus.cc:993] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:33.632294  9555 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:33.625327  9836 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.675160  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:33.601241  9867 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.666326  9844 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.686957  4871 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:33.687134  9844 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.687491  4871 raft_consensus.cc:606] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
W20260709 12:11:33.687765  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 79114.2us
I20260709 12:11:33.688663  9818 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.689724  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:33.684059  4839 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:33.692111  9817 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:33.692597  9817 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:33.693202  9610 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.693393  9817 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.649951  9812 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:11:33.694896  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:33.695593  9841 raft_consensus.cc:1081] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:33.696251  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.696830  5023 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:33.699642  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:33.700210  5601 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:33.700661  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:33.699661  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:33.701465  4873 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:33.699671  4945 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:33.702943  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.703181  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.703752  5018 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:33.668654  9809 raft_consensus.cc:697] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:33.705963  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:33.706528  5024 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.708386  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.708942  5018 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:33.712384  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:33.713179  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:33.713610  5598 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.625178  9615 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.713712  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:33.714402  4876 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:33.715582  5016 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:33.677940  9577 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.717150  9809 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.669524  9599 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:11:33.722513  4947 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:33.687686  9867 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.704459  9831 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:33.705432  9843 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:33.730139  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:33.731943  4947 raft_consensus.cc:2368] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12.
I20260709 12:11:33.735255  5016 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:33.739861  5024 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:33.743003  9816 raft_consensus.cc:993] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:11:33.743464  9816 raft_consensus.cc:1081] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Signalling peer ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:11:33.745968  9577 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:33.760166  5598 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:33.731429  9868 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.779942  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:33.773824  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 110894us
I20260709 12:11:33.731287  9854 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.786355  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:33.785789  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:33.789324  5597 raft_consensus.cc:2368] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12.
I20260709 12:11:33.782125  4988 leader_election.cc:400] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12.
I20260709 12:11:33.790042  4988 leader_election.cc:403] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:33.782528  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:33.783535  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:33.791373  5604 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:33.799127  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:33.799746  4868 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:33.800870  5567 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:33.813997  5568 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:33.772001  9831 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:33.795769  9863 log.cc:927] Time spent T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:33.787822  9868 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.821061  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:33.793768  4942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:11:33.830297  4942 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:33.836506  4942 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.845630  9831 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.794977  9886 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.825856  9855 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:33.803103  9875 log.cc:927] Time spent T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:11:33.849840  4876 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:33.814915  9815 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:33.851468  5568 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:33.852615  4942 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:33.819388  9646 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12.
I20260709 12:11:33.877848  5568 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:33.833732  9868 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:33.874221  9823 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:33.897745  9433 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.869906  9684 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:33.910009  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 91994.7us
I20260709 12:11:33.897172  9855 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:33.915205  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 133206us
I20260709 12:11:33.796742  9854 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:33.899533  9815 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:33.915688  9823 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:33.962970  9881 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:33.964157  9862 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.967485  5023 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:33.921927  9433 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:33.943517  9823 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.964607  9862 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:34.013540  9824 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:11:33.924860  9853 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.019477  9862 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:34.043362  9876 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:11:34.044514  9882 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:11:34.045827  9853 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:34.047101  9818 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:34.054178  9615 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:34.052528  9823 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.054916  9433 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.056931  9823 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:34.059509  9854 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:34.038802  9815 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.033535  9855 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:34.068588  9890 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.290s	user 0.000s	sys 0.009s
I20260709 12:11:34.084913  9868 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.087045  9868 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:34.079609  9862 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.087867  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:34.088827  9862 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:34.341135  9759 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.341696  9759 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.343643  9887 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.343758  9759 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:34.344240  9887 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:34.346324  9887 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:34.350291  4841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.037s	sys 0.023s
W20260709 12:11:34.350610  4841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.037s	sys 0.023s
W20260709 12:11:34.350862  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 573165us
I20260709 12:11:34.638485  9841 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.639056  9841 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.687652  9901 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.688230  9901 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:34.690380  9901 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:34.878223  9841 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:34.995609  9807 raft_consensus.cc:993] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: : Instructing follower 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:35.027432  9841 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.028170  9841 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.030434  9841 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:35.031003  9841 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.193471  9432 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.245786  9432 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:35.190233  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.24357e+06us
I20260709 12:11:35.248044  9432 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:35.248214  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:35.248944  4867 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:35.252157  9841 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.254298  9841 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:35.254820  9841 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:35.258097  9841 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.232908  9862 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.344916  9862 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.346479  9905 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:35.347007  9862 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:35.347520  9862 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.347946  9862 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.349725  9862 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.300190  5019 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:35.307121  9840 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:35.351047  9840 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.347060  9905 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:35.353034  9840 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:35.342154  9831 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:35.353683  9831 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.354986  9905 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.355486  9905 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.342185  9870 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:35.355861  9905 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.355998  9870 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:35.358109  9759 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:35.358253  9870 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.359115  9870 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.358831  9759 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.359581  9870 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:35.353755  9841 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:35.360888  9841 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.361321  9841 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.361943  9759 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:35.363359  9841 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:35.363804  9841 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.364162  9841 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:35.365278  9905 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:35.366096  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffca0 after lost signal to thread 3728
I20260709 12:11:35.368129  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 1033) took 1825 ms. Trace:
I20260709 12:11:35.369095  9841 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.368486  4943 rpcz_store.cc:276] 0709 12:11:33.542508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.542624 (+   116us) service_pool.cc:224] Handling call
0709 12:11:33.542880 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.549143 (+  6263us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:33.651474 (+102331us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b1800226cc0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a57777c0a 00007f2a60eb7219 00007f2a577ffa40 00007f2a577fa4e4 00007f2a577fa455 00007f2a5e2e23c7 00007f2a5a8f49a7 00007f2a5a9040bf 00007f2a5a904038
0709 12:11:33.715765 (+ 64291us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.922200 (+206435us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.935344 (+ 13144us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.935474 (+   130us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:33.935502 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.935569 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:35.367837 (+1432268us) raft_consensus.cc:1685] finished
0709 12:11:35.367947 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.368072 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38525,"prepare.queue_time_us":156101,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":10251,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":24263,"spinlock_wait_cycles":22325120,"thread_start_us":238684,"threads_started":2,"wal-append.queue_time_us":313175}
I20260709 12:11:35.377460  9870 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.355602  9831 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:35.382293  9841 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:35.382761  9841 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.383108  9470 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.383631  9470 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:35.384720  9906 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:35.385231  9906 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:35.385568  9470 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:35.386097  9470 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:35.386523  9470 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.387116  9906 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.388337  9841 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:35.388468  9470 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:35.396382  5568 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.643s (SENT) [suppressed 46 similar messages]
I20260709 12:11:35.433121  9841 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:35.652684  9841 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.654928  9841 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:35.524909  9870 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.655748  9870 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:35.657733  9870 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:35.763348  5019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 1191) took 2068 ms (client timeout 1643 ms). Trace:
W20260709 12:11:35.763811  5019 rpcz_store.cc:269] 0709 12:11:33.694581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.694687 (+   106us) service_pool.cc:224] Handling call
0709 12:11:35.763128 (+2068441us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54003b51d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:35.763243 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420716800}
W20260709 12:11:35.855259  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.986s	user 0.015s	sys 0.041s
W20260709 12:11:35.855765  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.986s	user 0.015s	sys 0.041s
I20260709 12:11:35.857692  4867 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:35.857918  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:35.858572  4868 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:35.858839  4868 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:35.859584  4868 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:35.860448  4868 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.867580  4868 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:35.904640  4942 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.905354  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:52376 (request call id 2919) took 2132 ms. Trace:
I20260709 12:11:35.905743  4942 rpcz_store.cc:276] 0709 12:11:33.779074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.780744 (+  1670us) service_pool.cc:224] Handling call
0709 12:11:35.852555 (+2071811us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4c00020ec0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a58bb6a20 00007f2a58bc7a29 00007f2a58bc813f 00007f2a58b8c2ab 00007f2a58bb9f3c 00007f2a58bba3fe 00007f2a58e4788b 00007f2a5a846495 00007f2a5a89730f 00007f2a5a8e1a55 00007f2a5f8b1cd0
0709 12:11:35.905232 (+ 52677us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47518464}
W20260709 12:11:35.907910  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.933931  9908 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:35.940580  9908 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.944427  9908 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:35.945412  9909 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:35.946216  9909 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.945694  9815 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:35.950120  9906 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.950251  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3544) took 2006 ms. Trace:
I20260709 12:11:35.950065  9815 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.950690  9906 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:35.950690  4876 rpcz_store.cc:276] 0709 12:11:33.943682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.943825 (+   143us) service_pool.cc:224] Handling call
0709 12:11:33.961169 (+ 17344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.961352 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:35.949667 (+1988315us) log.cc:844] Serialized 14 byte log entry
0709 12:11:35.949842 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:35.949960 (+   118us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:35.950005 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.950074 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:35.950180 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":7898,"threads_started":1}
I20260709 12:11:35.952059  9815 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:35.960439  9913 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:35.960960  9913 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.963737  4868 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:35.965472  9815 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.965932  9815 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.967799  9815 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.968242  9815 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:35.972072  9912 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:35.972556  9912 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.974509  9912 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.974941  9912 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:35.975333  9912 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.977084  5598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:37906
I20260709 12:11:35.977599  5598 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:35.977900  5598 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.985427  5598 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:35.987161  5598 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.988631  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:35.989255  5598 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:35.989867  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:35.997852  9909 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.998346  9908 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.003093  5597 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.009064  9908 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.003002  5600 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:36.009405  5597 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:36.010747  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.011320  5602 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:36.011523  9908 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:35.968669  9815 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.016644  9815 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.018440  9908 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.018946  9908 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.020787  9908 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.023682  9908 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.024188  9908 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.026651  9867 raft_consensus.cc:993] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:11:36.028247  9908 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.032589  5602 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:36.035877  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.036407  5602 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:36.031338  9913 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.038944  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.039454  5602 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:36.040575  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.041170  5602 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:36.042398  9912 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.042987  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.045243  5602 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:36.044562  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.043107  9906 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.047048  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.047632  5597 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:36.048749  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.050115  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.050675  5597 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:36.027086  9901 raft_consensus.cc:1081] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Signalling peer ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:11:36.053251  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.053853  5597 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 20.
I20260709 12:11:36.055058  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.056109  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.057772  9906 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.058259  9906 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.059775  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.060109  9906 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.060328  5602 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:36.062116  5602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:37906
I20260709 12:11:36.062554  5602 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.062649  9901 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.062855  5602 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.063400  9906 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.063889  9906 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.065514  9901 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:35.999009  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 602591us
I20260709 12:11:36.069590  9887 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.070075  9887 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.071940  9887 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.072899  9906 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.074033  9901 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.079902  9810 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.080613  9776 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.081107  9776 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.083074  9776 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.083498  9776 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.083917  9776 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:36.085089  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002fff00 after lost signal to thread 4808
I20260709 12:11:36.086516  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:36.087173  4868 raft_consensus.cc:2368] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:36.087710  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.087894  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.088276  4871 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:36.088714  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:36.088233  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.088922  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.089566  4874 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:36.088940  4870 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:36.090257  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.091398  9918 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.080197  9855 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.092770  9855 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.094673  9855 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.095116  9855 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.095536  9855 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.080389  9810 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:36.097487  5017 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.303s	user 0.049s	sys 0.098s
W20260709 12:11:36.097832  5017 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.312s	user 0.049s	sys 0.098s
I20260709 12:11:36.098420  9810 leader_election.cc:290] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.098881  9810 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.099308  9810 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.101172  4876 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:36.101459  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb520 after lost signal to thread 4900
W20260709 12:11:36.101754  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080037e6a0 after lost signal to thread 4901
W20260709 12:11:36.102039  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffe60 after lost signal to thread 4915
I20260709 12:11:36.102228  4774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 246) took 6680 ms. Trace:
W20260709 12:11:36.102964  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff480 after lost signal to thread 4975
W20260709 12:11:36.103566  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff460 after lost signal to thread 4976
I20260709 12:11:36.091889  9918 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:36.104703  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5780 after lost signal to thread 5049
W20260709 12:11:36.104996  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3920 after lost signal to thread 5050
I20260709 12:11:36.105837  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.105149  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:36.106231  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080035efe0 after lost signal to thread 5630
W20260709 12:11:36.106980  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080027f180 after lost signal to thread 5631
I20260709 12:11:36.107231  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:36.102573  4774 rpcz_store.cc:276] 0709 12:11:29.421664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.421909 (+   245us) service_pool.cc:224] Handling call
0709 12:11:36.102174 (+6680265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.195633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.281793 (+ 86160us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.282969 (+  1176us) write_op.cc:435] Acquired schema lock
0709 12:11:33.286206 (+  3237us) tablet.cc:662] Decoding operations
0709 12:11:33.328586 (+ 42380us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.328645 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.328673 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:11:33.329187 (+   514us) tablet.cc:701] Row locks acquired
0709 12:11:33.329202 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:11:33.329345 (+   143us) write_op.cc:270] Start()
0709 12:11:33.329456 (+   111us) write_op.cc:276] Timestamp: P: 1783599093329292 usec, L: 0
0709 12:11:33.329479 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.357534 (+ 28055us) log.cc:844] Serialized 2434 byte log entry
0709 12:11:33.711858 (+354324us) op_driver.cc:464] REPLICATION: finished
0709 12:11:34.073277 (+361419us) write_op.cc:301] APPLY: starting
0709 12:11:34.073369 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:34.076657 (+  3288us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:34.076742 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:34.080527 (+  3785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:34.080762 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:11:34.080822 (+    60us) write_op.cc:312] APPLY: finished
0709 12:11:34.081134 (+   312us) log.cc:844] Serialized 65 byte log entry
0709 12:11:34.081290 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:34.081402 (+   112us) write_op.cc:454] Released schema lock
0709 12:11:34.081448 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:34.081816 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:34.081842 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":914973,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":351984,"apply.run_cpu_time_us":8109,"apply.run_wall_time_us":8515,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29195,"num_ops":6,"prepare.queue_time_us":381317,"prepare.run_cpu_time_us":4133,"prepare.run_wall_time_us":167400,"replication_time_us":356450,"thread_start_us":478869,"threads_started":2}]]}
I20260709 12:11:36.107383  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.107916  4949 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:36.105322  9918 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.108242  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.108582  4875 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:36.108935  4946 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:36.110090  4946 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:36.110275  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.111025  4947 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:36.111297  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.113118  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.115483  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:36.116024  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.116662  4950 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 5.
W20260709 12:11:36.118086  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 2.1498e+06us
I20260709 12:11:36.119987  4876 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:36.120366  4917 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:36.120937  9809 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.121418  9809 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.121758  9767 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.122241  9691 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.122383  9625 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.122747  9691 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.122920  9625 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:36.123616  9809 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.124154  9809 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:36.121950  9888 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.124987  9812 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.125512  9812 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:36.125263  9888 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.121956  9776 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.127204  9888 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.125140  9820 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:11:36.122246  9767 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.105499  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.129518  4942 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:36.115985  4868 raft_consensus.cc:3055] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:36.112591  4945 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.130460  4868 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:36.130677  4945 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:36.131340  4868 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.106748  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.132315  4868 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.132638  4943 raft_consensus.cc:2393] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:36.126322  9812 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.128623  9820 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.131451  4945 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:36.140625  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb440 after lost signal to thread 9891
I20260709 12:11:36.140832  4945 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.138166  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1195) took 2442 ms. Trace:
I20260709 12:11:36.104954  9843 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.140048  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.143888  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.144454  5601 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:36.145393  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.147550  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.148108  4875 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:11:36.149204  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.149756  4875 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:36.154889  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.155539  4876 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:36.157315  4876 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:36.159718  5601 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.124908  9625 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.142683  5017 rpcz_store.cc:276] 0709 12:11:33.695664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.695762 (+    98us) service_pool.cc:224] Handling call
0709 12:11:33.696026 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.696364 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:33.696627 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.067939 (+371312us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:36.098091 (+2030152us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:36.098545 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:11:36.133075 (+ 34530us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:36.133115 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.133180 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.133222 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:36.137998 (+  4776us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.138114 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35099,"prepare.queue_time_us":465,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2043,"raft.queue_time_us":25489,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":15772,"spinlock_wait_cycles":3954816,"thread_start_us":2427906,"threads_started":3,"wal-append.queue_time_us":82542,"wal-append.run_cpu_time_us":25984,"wal-append.run_wall_time_us":1571278}
I20260709 12:11:36.161893  4875 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.164659  5570 leader_election.cc:400] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:36.164984  5570 leader_election.cc:403] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:36.136591  9691 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.142423  4868 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:36.170384  5570 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.171308  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.171470  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:36.171864  5019 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:36.172326  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:36.172859  5023 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:36.172780  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:36.173604  5016 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.171054  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.175474  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.167307  4945 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:36.179826  5016 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:36.166270  4772 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 11, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:36.181324  4772 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.154088  5602 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.183298  4772 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 13 to 14, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 14 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:11:36.184849  4772 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: config changed from index 9 to 10, term changed from 11 to 12, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to <none>, ab9da67236874634be59ebfd05b18255 (127.3.163.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:36.150444  9810 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.187672  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.189770  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.189922  5601 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:36.192368  5016 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:36.194598  4990 leader_election.cc:400] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12.
I20260709 12:11:36.194718  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.197434  5024 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:36.201795  5602 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.173425  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.204031  5018 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:36.205565  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:36.206056  5018 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.209537  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.210094  4868 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:36.210482  5023 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:11:36.202595  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.206804  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.213748  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.217679  5017 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:36.214643  5601 raft_consensus.cc:2393] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:36.222924  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.223506  5016 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:36.181052  9888 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.221678  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:36.225068  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.145431  9843 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.226436  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.242131  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.190413  9691 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.226969  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:36.246460  5016 raft_consensus.cc:2376] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10. Re-sending same reply.
I20260709 12:11:36.145690  9820 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.241178  5570 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.215934  9913 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:36.245507  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:36.226795  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 105441us
I20260709 12:11:36.200971  9476 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.262193  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.241861  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.262790  4875 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 19.
I20260709 12:11:36.241114  4841 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.212397  9844 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.216296  9432 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.216079  9400 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.225301  9776 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.250937  4772 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 7 to 8, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.254769  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.257105  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.264006  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.241549  9738 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:36.264497  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 61837.7us
I20260709 12:11:36.301832  4772 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.302587  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.265864  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.264289  4944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 3450) took 2728 ms. Trace:
I20260709 12:11:36.303942  4772 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.304538  4944 rpcz_store.cc:276] 0709 12:11:33.535423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.536664 (+  1241us) service_pool.cc:224] Handling call
0709 12:11:33.536943 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.537122 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:36.052689 (+2515567us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b18002993e0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a5a4924bc 00007f2a577e048b 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fa455 00007f2a5e2e23c7 00007f2a5a8f49a7 00007f2a5a9040bf
0709 12:11:36.052828 (+   139us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.263996 (+211168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:36.264042 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:36.264085 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.264146 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.264238 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41115,"prepare.queue_time_us":167632,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":6457,"raft.queue_time_us":42777,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":64,"spinlock_wait_cycles":11742592,"thread_start_us":347928,"threads_started":3,"wal-append.queue_time_us":32011}
I20260709 12:11:36.277529  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.305416  4772 catalog_manager.cc:5697] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 11, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:36.224761  9675 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.306983  9675 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:36.308890  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 67765.7us
I20260709 12:11:36.301970  4841 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.243891  9854 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:11:36.288432  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.227659  9884 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.244215  9815 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.239595  9895 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:36.249958  9855 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:36.319526  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.309343  9675 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.280587  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.309792  5017 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:36.249858  9852 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.313627  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.301110  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.248107  9646 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.297268  9868 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.278604  9912 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:36.311012  4841 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.244073  9909 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:11:36.310276  9899 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.297917  9599 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.314004  9812 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.243692  9888 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.367964  9937 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.343555  9658 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.296846  9476 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.370162  9928 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:36.370663  9928 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.371338  9476 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.335176  9610 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.371919  9610 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.372284  9610 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.372618  9928 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.373013  9857 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.373237  9928 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.373508  9857 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.373667  9928 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.375449  9857 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.373679  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.376391  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.377040  5016 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:36.320272  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.378098  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.378237  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:36.378834  5025 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.336575  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.337687  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:36.379717  5019 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.336931  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.320150  5570 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.339668  4943 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:36.380245  5024 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
W20260709 12:11:36.380364  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 60278.5us
I20260709 12:11:36.380997  5570 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.340863  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.334749  5021 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:36.248056  9470 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:11:36.306923  4772 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 13, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:36.277644  9911 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.344221  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.346288  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.347594  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.409268  5018 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:36.300781  9776 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.344126  9868 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.316627  9815 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:36.331148  9914 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:11:36.361913  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 50991.8us
I20260709 12:11:36.420439  4841 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.421571  4841 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.298274  9922 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.358201  9926 raft_consensus.cc:1081] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Signalling peer 4f3bf546572147c3abe4522189e86ce6 to start an election
I20260709 12:11:36.320420  9499 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.322882  9738 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:36.253679  9691 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.355959  9577 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.366209  9599 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.369472  9888 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.368467  9937 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.375473  9928 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.336618  9675 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.437944  9675 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.323348  9884 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.439617  9937 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.439989  9675 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.381095  4944 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:36.440369  4949 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:36.440680  9884 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.441094  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.442086  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.442572  4944 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 19.
I20260709 12:11:36.313982  9755 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:36.443660  9610 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.444089  9755 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.444507  9755 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.414013  9911 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.445015  9911 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.433413  9577 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.446720  9577 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.447124  9691 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.379217  9899 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.424800  9868 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.339551  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.449330  5022 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:36.450034  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.382484  5570 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.389636  5019 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
W20260709 12:11:36.450829  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 68404.7us
I20260709 12:11:36.451164  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.408442  9812 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.452159  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.356393  9646 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.409034  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.460620  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.461184  4943 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:36.300433  9844 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.409072  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:36.360545  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 94103.3us
I20260709 12:11:36.465806  5021 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.413002  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:36.414791  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 219386us
I20260709 12:11:36.418035  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.466773  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.467149  4942 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:36.427145  9499 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.418083  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.468017  4948 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:36.418987  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:36.419176  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 97507.1us
I20260709 12:11:36.310801  9432 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.469341  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.466459  5567 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:36.470498  9432 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.425101  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.422605  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:36.472916  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 50375.7us
I20260709 12:11:36.323647  9854 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.474782  9854 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.317055  9400 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.379118  9912 raft_consensus.cc:697] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:36.419873  9776 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.369426  9658 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.453120  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.343873  9839 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.453452  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.454205  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:11:36.456244  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 177559us
I20260709 12:11:36.424134  9815 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.458170  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.437526  4951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 1039) took 2767 ms. Trace:
I20260709 12:11:36.464125  5025 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:36.465039  9812 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.489995  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.491004  5022 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:36.427003  9887 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:36.343405  9852 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.473006  9867 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:36.415693  9818 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.323100  9895 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.424083  9909 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:36.436232  9889 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.507731  4875 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39324
I20260709 12:11:36.507722  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.508494  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.498744  9867 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:36.480288  5019 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:36.430369  9936 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.480849  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.484766  4867 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:36.518282  4841 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.467402  9810 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:36.484333  4951 rpcz_store.cc:276] 0709 12:11:33.670582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.670704 (+   122us) service_pool.cc:224] Handling call
0709 12:11:33.671013 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:33.917536 (+246523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.917567 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:35.986943 (+2069376us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b2c00010c48. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a591e3a11 00007f2a591f3372 00007f2a5a925a01 00007f2a5a8ea43a 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2
0709 12:11:35.987542 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 12:11:36.070765 (+ 83223us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:36.226633 (+155868us) log.cc:844] Serialized 14 byte log entry
0709 12:11:36.407506 (+180873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.419561 (+ 12055us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:36.423156 (+  3595us) raft_consensus.cc:1685] finished
0709 12:11:36.437356 (+ 14200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:36.437473 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30526,"prepare.queue_time_us":196277,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":156341,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":9266,"spinlock_wait_cycles":2577152,"thread_start_us":596504,"threads_started":4,"wal-append.queue_time_us":25403}
I20260709 12:11:36.494686  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.499114  9857 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.480269  5023 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:11:36.497172  4990 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.498234  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.496624  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:36.476737  9499 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.499271  5024 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:36.497689  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:36.429733  9922 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.548075  9844 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.549021  4950 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:36.495272  9887 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.550307  9887 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:36.550666  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.515647  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.551672  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.552345  5022 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 20: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:36.552199  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.516072  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.553004  9843 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.495110  9918 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.553560  9918 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.518805  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.553978  9895 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.553957  9918 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:36.555632  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 58010.9us
I20260709 12:11:36.549259  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.557240  5016 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:36.479236  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.427632  9930 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:36.525588  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.559684  4942 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:36.529590  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:36.525935  4867 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:36.492622  5568 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:36.560978  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:36.561393  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 68833.3us
I20260709 12:11:36.562292  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:36.562456  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.563031  4868 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:36.494395  9839 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.565940  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.531915  5025 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:36.517263  9432 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.502884  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.563964  4867 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:36.558370  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 61276.1us
I20260709 12:11:36.593436  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.506543  9889 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.526005  9867 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:36.563935  4991 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:36.608415  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 44561.5us
I20260709 12:11:36.595073  4867 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:36.593466  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.532119  9936 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.539702  9470 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.606366  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.607161  9852 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.600781  9920 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.612358  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.613123  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.506103  9818 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.634178  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.565860  9869 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.611673  4916 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:36.595824  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.632205  4942 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:36.631676  5025 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:36.549814  9810 raft_consensus.cc:697] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:36.591881  9933 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:36.635012  5016 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:36.539515  9820 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.602499  9577 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.636085  4946 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:36.636408  5018 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:36.566063  9931 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.559377  9930 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.536783  9855 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:11:36.589900  9909 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:36.607859  9889 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.557081  9922 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.661530  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:36.663942  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 52334.3us
I20260709 12:11:36.687594  5016 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:36.664266  5020 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:36.634302  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 71054.1us
I20260709 12:11:36.688448  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.667832  5024 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:36.631589  9767 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.669360  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.697587  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.634918  9610 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.697971  5021 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
W20260709 12:11:36.673429  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.698961  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.673857  9839 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.637141  9752 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.700556  9752 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.685277  9400 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.613545  9432 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.702615  9752 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.676880  9928 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.703176  9928 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.631032  9895 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.561735  9857 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.705466  9857 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.654000  9933 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:36.634228  9470 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.706068  9933 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:36.706171  9470 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.703850  9895 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.707652  9895 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.680330  9899 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.703526  9928 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.661111  9931 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.713112  9931 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.713789  9776 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.715737  9776 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.681038  9945 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:36.631959  9936 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.650116  9935 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.721025  9935 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.721419  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:36.723057  9935 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.683420  9809 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:36.685014  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 214163us
I20260709 12:11:36.724521  5567 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:36.689666  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.725914  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.665450  9577 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.690254  9658 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.515442  9738 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.688640  5568 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:36.733541  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:36.733778  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45231.1us
I20260709 12:11:36.666955  9930 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:36.690904  9810 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.743156  4916 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:36.670861  9646 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.689328  9909 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:36.705343  9755 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.555716  9912 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.727626  5567 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:36.703876  5017 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:36.729085  4867 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:36.734520  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.734663  5568 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:36.595736  9906 consensus_queue.cc:1175] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab9da67236874634be59ebfd05b18255" responder_term: 9 status { last_received { term: 8 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:36.740514  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.701061  9599 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.703454  9432 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.750141  9577 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.744449  9908 raft_consensus.cc:2764] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:36.752408  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.754963  9911 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.649542  9920 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.758876  4916 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:36.788115  4876 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:36.759733  9928 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.760610  9400 consensus_queue.cc:1059] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:36.762951  9867 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.744086  9899 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:36.795312  9815 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.796847  9928 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.797557  9400 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.798185  9400 raft_consensus.cc:3055] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:36.798499  9400 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:36.799186  9400 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.800225  9400 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:36.764297  9895 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:36.802346  9920 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.802588  9895 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.765288  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.765837  9944 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.767529  5568 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.742043  9945 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.774556  5024 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:36.809125  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.759356  9809 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:36.724181  9470 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.792078  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:36.794394  9867 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.803369  5016 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:36.804028  5021 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:36.773319  9776 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:36.769550  9499 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.807754  5568 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:36.810835  5024 raft_consensus.cc:2410] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:36.744159  9868 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.835307  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.820362  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.817991  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:36.819631  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.836889  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:36.807164  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 52903.2us
I20260709 12:11:36.806218  9944 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.808403  9945 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.852375  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.834129  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.853132  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.835884  4874 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 20.
I20260709 12:11:36.809885  9908 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:36.843434  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.845635  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:36.859959  5016 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:36.846184  9933 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:36.861119  9470 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.861472  9911 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.830909  9776 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.861696  9951 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:11:36.862197  9933 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.829478  9922 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.851135  9931 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.867014  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.828722  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.853243  5602 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:36.844408  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.868198  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.868351  5597 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:36.868707  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.869347  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.858178  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.870528  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:36.869870  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.871712  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.872323  5605 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 20.
I20260709 12:11:36.858989  9815 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:36.873265  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.859896  9936 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.863667  4942 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:36.865283  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.865934  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.886706  4944 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:36.887018  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.887445  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.887881  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.887018  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:36.858881  9499 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.873024  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.888407  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.889694  4942 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 19. Current term is 20. Ops: []
I20260709 12:11:36.888708  4945 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.873818  9815 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.849898  9918 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.873421  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.892387  9957 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:11:36.893096  9957 consensus_queue.cc:1243] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:36.893426  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.894436  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.852703  9944 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.875095  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.875242  9868 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.875787  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.862150  9776 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:36.877077  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.877552  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:36.879029  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.879142  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.879746  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.881202  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.880456  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.882375  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:36.882910  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 108992us
I20260709 12:11:36.883519  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.883534  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.884141  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.852623  9809 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.918228  4949 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:36.917776  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:36.919992  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.919301  5600 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:36.852602  9928 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.862943  9945 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.886029  4990 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:36.873647  9956 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:36.890252  4944 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:36.890194  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:36.890571  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.891772  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.895129  4868 raft_consensus.cc:2410] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:36.874302  9755 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.895330  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.927738  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.896849  5025 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:36.928648  5603 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:36.898419  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:36.898403  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 71254us
I20260709 12:11:36.917819  4871 raft_consensus.cc:2410] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:36.930111  4945 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:36.920492  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.825299  9909 raft_consensus.cc:697] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:36.917977  4950 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:36.921550  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.930298  5605 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:36.921859  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.934346  9869 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:36.934820  9869 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.935164  9936 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.936280  9889 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:36.937390  9954 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.002s
I20260709 12:11:36.896688  9930 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:36.938395  9889 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.931116  9895 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:36.939198  9895 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.939538  9895 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:36.931107  9949 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:11:36.918589  9809 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:36.943682  9809 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.944329  9930 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:36.945621  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.922628  4870 raft_consensus.cc:2393] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:36.892320  9815 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:36.948338  5601 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:36.950522  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 142827us
I20260709 12:11:36.951259  5568 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.924556  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:36.924333  4990 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.931990  4873 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.946368  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.947395  9931 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:36.947546  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.954190  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.960879  5568 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.921772  9928 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.972595  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:36.973718  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:36.972934  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:36.936945  9956 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:36.957337  9815 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:36.973471  3730 debug-util.cc:398] Leaking SignalData structure 0x7b080000fe00 after lost signal to thread 4915
I20260709 12:11:36.977041  5568 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:36.985529  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:36.958141  9948 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:36.969271  9432 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:11:37.001507  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.002091  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:36.969326  9599 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:36.972370  9855 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:37.011047  4839 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:11:36.987802  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 149367us
I20260709 12:11:37.013258  4873 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:36.976279  9928 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:37.037627  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.020463  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.972149  9951 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:37.017810  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.044224  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:37.045009  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 68042.3us
I20260709 12:11:37.046464  5023 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:37.046818  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:37.019608  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.047180  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.046434  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.048260  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.049635  5020 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:37.045635  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.047606  4949 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:37.052541  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.053898  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.054111  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.056419  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.057264  9755 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:37.016674  9855 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:37.058790  9855 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:37.015625  9599 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:37.060969  9933 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:37.061249  9887 consensus_meta.cc:287] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.004s
I20260709 12:11:37.061640  9887 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.062160  4870 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:37.053593  9400 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.066147  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.066946  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.062695  4870 raft_consensus.cc:606] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.015331  9432 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.067128  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.061091  9599 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:37.082063  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.082639  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.082826  4873 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:37.083196  4945 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:37.083984  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.084523  4951 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.085296  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.086372  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.087389  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.051370  9889 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.071130  9499 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:37.089793  9933 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:37.099169  9499 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:37.009588  9909 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.099712  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:37.100746  9675 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:37.101145  9675 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.101471  9675 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.102411  4873 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:37.099576  9499 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.078473  9918 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:37.119984  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.120527  5021 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.089653  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.075955  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.123723  4944 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 20: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:37.125802  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.129246  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.090806  5018 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:37.044337  9951 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:37.130952  9951 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:37.131408  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.093895  4951 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:37.096261  4872 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:37.096871  9936 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:37.138738  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.139176  5021 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:37.140489  4875 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:37.140888  4988 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.140898  4875 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:37.142158  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.142387  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.142936  4988 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.075655  9432 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:37.041776  9854 consensus_queue.cc:1059] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:37.094933  9889 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.150185  9889 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.102969  4873 raft_consensus.cc:606] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.060994  9948 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:37.144438  4988 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.152117  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:37.152994  5021 raft_consensus.cc:2368] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
I20260709 12:11:37.153903  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:37.154978  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:37.156390  5567 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.157565  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.159075  5567 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.070888  9895 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.103008  5017 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:37.102842  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:37.108841  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.115302  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:37.095818  9922 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 12:11:37.162483  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47241.9us
I20260709 12:11:37.164739  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.170403  5597 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.162159  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.172171  5024 raft_consensus.cc:2376] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15. Re-sending same reply.
I20260709 12:11:37.169106  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.145504  9911 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.185338  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.185947  5601 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.145712  9852 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.144990  9926 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.174175  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:37.168205  4916 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.167490  5567 leader_election.cc:304] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.192147  5567 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.162971  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.144922  9936 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.195406  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:37.185489  4839 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:37.161091  9957 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.159947  9948 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:37.196956  5606 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:37.164925  9933 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:37.170992  9610 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.178834  9913 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:37.214447  4915 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.206689  9959 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.199098  9615 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:37.223143  9615 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.223512  9615 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:37.223734  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.225080  5599 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.225940  9752 raft_consensus.cc:3055] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:37.198148  9854 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.147558  9918 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:37.227058  9937 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:37.221319  9960 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:37.228586  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 60459.1us
I20260709 12:11:37.097077  9956 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.229496  4916 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.230509  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:37.233469  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.234192  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.234571  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.235303  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:37.236753  9950 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:37.237668  9867 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.238025  9867 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:37.238787  9776 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.239768  5599 raft_consensus.cc:1240] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:37.208096  9895 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.211426  9889 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:37.184862  9945 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.197824  9936 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:37.199994  9908 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:37.221837  9899 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:37.285535  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 148311us
I20260709 12:11:37.231935  4916 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.171321  9928 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.217227  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.205549  4875 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.245837  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:37.232975  9577 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.203215  9948 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:37.206022  9933 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:37.287106  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 92465.8us
I20260709 12:11:37.287443  5597 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:37.241866  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:37.297959  4988 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.226263  9752 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:37.254362  9961 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:11:37.299386  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:37.299520  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 85125.5us
I20260709 12:11:37.275496  5601 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
W20260709 12:11:37.296416  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 79252.2us
I20260709 12:11:37.301549  4841 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:37.226323  9962 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:37.298226  5025 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:37.288642  5024 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:37.275516  9922 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:37.312012  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 80125us
I20260709 12:11:37.312593  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.314702  4947 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:37.304643  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.304167  9752 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.275385  9400 raft_consensus.cc:2764] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:37.316346  4988 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.312750  4916 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.300753  9933 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.386432  5601 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:37.289983  9899 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.200241  9855 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.319317  5025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:37.357932  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.319700  9691 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:37.394933  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 82264.9us
I20260709 12:11:37.396065  4916 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.391886  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.397442  5605 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:37.367669  9951 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.305912  9962 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:37.368978  9776 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:37.370538  9928 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.374078  9889 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:37.375200  9615 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.376055  9741 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:37.401242  9899 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.306660  9950 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.390514  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.390573  9929 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.391765  9944 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.305342  9658 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.311417  9868 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.307847  9738 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:37.392997  9675 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.311774  9610 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 12:11:37.472563  9610 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:11:37.472922  9610 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:37.473456  9820 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:37.473836  9820 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:37.473762  9610 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:37.474730  9820 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.308701  9895 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.475654  9820 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:37.368924  9968 log.cc:927] Time spent T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:11:37.356564  9887 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.357542  9857 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:37.238782  9867 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:37.478083  9976 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:11:37.377812  9945 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:37.478225  9867 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:37.479440  9980 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:37.479728  5602 raft_consensus.cc:1240] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.481034  5602 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:37.481740  9855 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:37.408540  9815 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.484222  9815 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:37.407773  9962 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.486385  9948 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.486896  5598 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.488253  5018 raft_consensus.cc:2368] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:37.488430  9948 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:37.465152  9809 consensus_meta.cc:287] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 12:11:37.419667  4988 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:37.488988  9809 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:37.489459  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 69882us
I20260709 12:11:37.490124  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:37.443754  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.407577  9937 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.449735  5599 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:37.414808  9752 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:37.492974  9818 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.412317  9906 consensus_queue.cc:1059] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:11:37.414076  9741 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:37.456956  9599 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.465672  9738 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:37.411803  9922 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.494323  9868 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:37.458256  9854 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.496009  9935 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:37.508778  5025 raft_consensus.cc:606] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.511088  5025 raft_consensus.cc:614] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:37.511564  9809 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.511260  9738 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.510269  4948 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:37.494215  5603 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:37.493551  9818 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:37.513064  9818 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:37.514209  5568 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:37.514860  9599 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.510632  9935 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:37.515729  9935 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:37.513168  9741 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.519289  9610 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:37.510262  9906 raft_consensus.cc:3055] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:37.521407  9948 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:37.521435  9906 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:37.532292  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:37.509402  9869 consensus_meta.cc:287] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.000s
I20260709 12:11:37.524822  9950 consensus_queue.cc:1059] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:37.527148  9499 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.489753  9951 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:37.549841  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.499097  9944 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:37.528065  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.513963  9818 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:37.553768  9499 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.554808  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.528667  5604 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 20.
I20260709 12:11:37.530942  5019 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:37.532914  5024 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.557256  9906 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.558486  9906 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:37.533368  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.533281  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.564839  9432 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.566063  9675 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.566851  9432 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.567564  5022 raft_consensus.cc:2368] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 20. Current term is 21.
I20260709 12:11:37.524884  9755 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:11:37.571059  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:37.539595  9615 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.577190  9950 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:11:37.578444  9950 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 20 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:37.579269  9950 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.542917  9948 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:37.586417  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.594473  5024 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:37.515805  9868 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.598582  9947 raft_consensus.cc:3055] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.598973  9947 raft_consensus.cc:740] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:37.599697  9947 consensus_queue.cc:260] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.540093  9815 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:11:37.600698  9935 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.542666  9869 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.606071  4867 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:37.606844  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.607081  9869 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.608067  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.608775  5599 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:37.508665  9962 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:37.611433  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 215423us
I20260709 12:11:37.504444  9936 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:37.615068  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.635188  4916 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:37.635500  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.635315  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.639281  5606 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 17: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:37.639532  5019 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:37.647362  4875 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:37.640400  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.640673  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.648214  5601 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:37.649978  9937 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:37.650597  9937 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:37.650949  9937 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.648288  5016 raft_consensus.cc:1240] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:37.648741  4916 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:37.649150  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:37.648123  9577 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.669211  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.670655  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.675494  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.676924  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39324 (request call id 3556) took 1148 ms. Trace:
I20260709 12:11:37.677389  4947 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:37.672142  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:37.678303  4942 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:37.675729  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.680660  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.681663  5599 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:37.681043  4950 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.682360  4942 raft_consensus.cc:1240] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:37.683169  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.684239  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.685909  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.690984  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.692119  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.634999  9843 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:37.682991  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.677259  4875 rpcz_store.cc:276] 0709 12:11:36.507508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.507625 (+   117us) service_pool.cc:224] Handling call
0709 12:11:37.610173 (+1102548us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b540004ea54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e1a3d 00007f2a5f8b1cd0 00007f2a58e36254 00007f2a58e361e2 00007f2a58e36111 00007f2a58e3608c 00007f2a58e35342 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:37.655616 (+ 45443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453866240}
I20260709 12:11:37.636163  9922 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:37.702530  4948 raft_consensus.cc:2368] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:37.703790  4942 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:37.705833  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.700651  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:37.706741  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:37.709086  9912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.025s	sys 0.012s
W20260709 12:11:37.709452  9912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.025s	sys 0.012s
I20260709 12:11:37.710172  9983 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:37.710691  9983 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:37.652689  9982 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:37.711555  9983 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.711848  9982 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.635731  9935 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.720873  9928 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:37.718016  5020 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:37.636654  9809 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 12:11:37.657313  9920 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.728673  4988 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.700297  9599 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.736111  4988 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.763012  5017 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:37.740041  9948 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.742058  9923 consensus_queue.cc:1059] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:37.744130  9933 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.748283  9936 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:37.749698  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.749855  9982 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.750533  5601 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:37.751174  9962 leader_election.cc:290] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:37.751360  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:37.752270  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.775640  5604 raft_consensus.cc:2393] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:37.754177  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.765486  5018 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:37.755523  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.776054  5602 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:37.769060  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.776976  5603 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 16: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:37.771153  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:37.768527  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.701004  9869 consensus_queue.cc:1059] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:11:37.781273  9610 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.782025  9869 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.782068  9610 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.704890  9951 consensus_queue.cc:1059] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:11:37.702349  9577 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.783466  9951 raft_consensus.cc:3055] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.783828  9951 raft_consensus.cc:740] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:37.784196  9610 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.770236  5568 leader_election.cc:400] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:37.784592  9951 consensus_queue.cc:260] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.704933  9957 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:11:37.785923  9957 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:37.786273  9957 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:37.727886  9928 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:37.786998  9957 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.785281  5568 leader_election.cc:403] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:11:37.788177  9928 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:37.789091  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:37.722503  9922 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:37.789635  4875 raft_consensus.cc:606] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.785023  4948 pending_rounds.cc:85] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 10
I20260709 12:11:37.789451  9930 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:37.771456  9599 consensus_queue.cc:1059] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:11:37.777508  5025 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:11:37.789997  4875 raft_consensus.cc:614] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:37.782444  9869 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:37.792568  4948 pending_rounds.cc:107] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:11:37.800604  4948 raft_consensus.cc:2889] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:37.797073  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:37.802338  5023 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:37.805240  5602 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 21.
I20260709 12:11:37.755229  9818 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.751915  9899 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.773931  9931 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.719077  9843 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.811021  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:37.809422  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:37.807597  4945 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:37.816104  5025 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:37.812661  4990 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:37.799166  9776 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:37.818061  9937 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:37.821677  9930 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:37.822315  9937 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:37.823036  9930 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:37.828552  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:37.829123  4875 raft_consensus.cc:606] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.829439  4875 raft_consensus.cc:614] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:37.832124  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:37.832633  4875 raft_consensus.cc:606] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:37.832983  4875 raft_consensus.cc:614] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:37.834415  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:37.785960  9951 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:37.844920  9922 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:37.869622  9933 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:37.879985  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 67403.2us
W20260709 12:11:37.895464  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.895618  4944 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.809056  9577 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:37.897256  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 173180us
I20260709 12:11:37.774439  9815 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 12:11:37.907088  5599 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:37.916599  4841 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:37.916571  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.895318  9839 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:37.966148  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.033762  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 109045us
W20260709 12:11:38.033146  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 976995us
I20260709 12:11:38.033262  9933 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:38.036576  9933 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.037186  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.038172  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:38.038417  5567 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.039386  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.039510  5567 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.039947  4875 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.040295  9815 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.040644  5567 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:38.040953  9815 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.042263  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:38.043493  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:38.044600  9400 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:38.045131  9400 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.046533  4875 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:38.046742  9815 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.047122  5567 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.047811  9815 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:38.047992  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.048286  5567 leader_election.cc:400] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:38.048648  9928 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:38.049597  9920 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:11:38.049401  9933 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:38.050649  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.055738  4916 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.055307  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:38.033152  9922 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:37.923014  9911 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:38.067309  4916 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.080269  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.068950  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.077363  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.078099  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:37.898974  9741 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.068612  4873 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:38.087539  4772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 344) took 6037 ms. Trace:
I20260709 12:11:38.099064  4876 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:38.101785  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:38.083462  4874 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:38.095647  4942 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:38.140532  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:38.087605  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:38.095193  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:38.144114  4945 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:11:38.087886  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.146333  4868 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 17: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:38.101028  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:38.147544  5602 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:38.064021  5567 leader_election.cc:403] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:11:38.148686  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 100575us
I20260709 12:11:38.149575  5567 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.070037  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.142324  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:38.099725  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:38.138286  5604 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:38.142026  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:38.160526  4876 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:38.161847  4874 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:38.137277  4772 rpcz_store.cc:276] 0709 12:11:32.050020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.050149 (+   129us) service_pool.cc:224] Handling call
0709 12:11:32.092356 (+ 42207us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:38.087476 (+5995120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:36.757784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:36.758279 (+   495us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:36.758311 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:11:36.758328 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:36.759175 (+   847us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:36.759222 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:36.759249 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:36.759900 (+   651us) tablet.cc:701] Row locks acquired
0709 12:11:36.759914 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:11:36.760053 (+   139us) write_op.cc:270] Start()
0709 12:11:36.760163 (+   110us) write_op.cc:276] Timestamp: P: 1783599096760008 usec, L: 0
0709 12:11:36.760182 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:11:36.760736 (+   554us) log.cc:844] Serialized 3627 byte log entry
0709 12:11:37.064182 (+303446us) op_driver.cc:464] REPLICATION: finished
0709 12:11:37.184333 (+120151us) write_op.cc:301] APPLY: starting
0709 12:11:37.188407 (+  4074us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:37.360008 (+171601us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:37.360100 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:37.402199 (+ 42099us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:37.463488 (+ 61289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:11:37.469054 (+  5566us) write_op.cc:312] APPLY: finished
0709 12:11:37.490133 (+ 21079us) log.cc:844] Serialized 89 byte log entry
0709 12:11:37.490283 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:37.490393 (+   110us) write_op.cc:454] Released schema lock
0709 12:11:37.490438 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:37.490807 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:37.490834 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18,"reported_tablets":21,"spinlock_wait_cycles":86801152,"child_traces":[["op",{"apply.queue_time_us":117157,"apply.run_cpu_time_us":11643,"apply.run_wall_time_us":306450,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41729,"num_ops":9,"prepare.queue_time_us":278559,"prepare.run_cpu_time_us":20953,"prepare.run_wall_time_us":81537,"raft.queue_time_us":181841,"raft.run_cpu_time_us":9217,"raft.run_wall_time_us":74801,"replication_time_us":303865,"thread_start_us":422355,"threads_started":4,"wal-append.queue_time_us":101557}]]}
I20260709 12:11:38.099961  9920 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.160755  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.172456  4873 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:38.174335  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.067426  9933 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.061195  9499 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.184113  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 84461.1us
W20260709 12:11:38.199142  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.090006  9895 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:38.185141  4876 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.200484  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:37.904665  9869 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:38.202193  9992 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:11:38.188009  5016 raft_consensus.cc:1240] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:38.079548  9868 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:38.205426  9868 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.207528  9868 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:38.208173  9741 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:38.063329  9928 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:38.187886  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:38.213658  4874 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:38.213984  5025 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:38.214433  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:38.216284  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:38.217149  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:38.218093  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:38.218760  5024 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 17: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:38.188961  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:38.189654  5567 leader_election.cc:304] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.197285  4868 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:38.097922  9911 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:38.219571  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:38.223831  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:38.216841  5017 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:38.215720  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:38.225513  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:38.196506  4870 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:11:38.221467  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:38.217697  4876 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:38.166606  9898 raft_consensus.cc:3055] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:38.160683  9948 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:38.229574  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:38.233951  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:38.235248  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:38.229763  4944 raft_consensus.cc:2393] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:11:38.237172  4949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.014s	sys 0.041s
W20260709 12:11:38.237540  4949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.014s	sys 0.042s
I20260709 12:11:38.239404  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.243049  4875 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:38.067181  9691 consensus_queue.cc:1059] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 12:11:38.095891  9906 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:38.249871  4945 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:38.182005  9815 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:38.234519  4840 connection.cc:256] RPC call timeout handler was delayed by -1.1995653240001047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 12:11:38.100013  9922 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.255569  4951 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:38.208941  9839 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:11:38.257066  5567 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:38.257560  4945 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 12:11:38.262050  4840 connection.cc:256] RPC call timeout handler was delayed by -1.1747195900002225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 12:11:38.249588  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 50379us
W20260709 12:11:38.266592  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.266904  4840 connection.cc:256] RPC call timeout handler was delayed by -1.0863621500002409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:11:38.267710  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.269009  4945 pending_rounds.cc:85] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 6
I20260709 12:11:38.211952  9895 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:38.254383  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:38.224110  9928 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:38.270597  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.269325  4945 pending_rounds.cc:107] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:11:38.271338  5601 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:11:38.198638  9855 consensus_queue.cc:1059] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:11:38.238749  9944 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.246160  9868 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:38.273102  5604 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:38.253510  9975 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:38.276903  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 134633us
I20260709 12:11:38.240518  9898 raft_consensus.cc:740] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:38.280753  5605 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:38.253646  9935 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.275645  4945 raft_consensus.cc:2889] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:38.292197  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:38.223213  9499 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:38.299744  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.300351  5601 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:38.269945  9906 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:38.265264  9936 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:11:38.282681  9921 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:11:38.297135  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.269709  9945 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:38.296797  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:38.273773  9913 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:38.295300  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:38.298408  9899 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:38.282862  9962 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:11:38.303103  9843 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:38.336349  9944 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:38.361089  9839 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:38.364298  9839 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:38.365504 10002 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:11:38.367625  9400 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:38.373544  9818 consensus_meta.cc:287] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.004s
I20260709 12:11:38.373987  9818 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.329579  9911 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.378249  9911 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.379565  9615 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.382838  9499 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:38.350310  9950 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.355203  9898 consensus_queue.cc:260] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:38.387449  9922 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:38.389690  9951 consensus_meta.cc:287] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.000s
I20260709 12:11:38.392136  9658 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:38.392531  9658 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:38.393373  9658 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.394352  9658 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:38.333055  9937 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:11:38.414328  9869 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.414479  9944 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:38.417424  9997 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.002s
W20260709 12:11:38.419016 10003 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:38.422885  9895 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.423868  9895 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.411168  5020 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:38.431244  9957 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.442021  5599 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:11:38.462575  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.480299  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 226390us
I20260709 12:11:38.485287  5019 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:38.486766  5016 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:38.436219  9776 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:38.491801  5020 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:38.357316  9691 consensus_queue.cc:1059] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
W20260709 12:11:38.480890 10012 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.055s	user 0.000s	sys 0.004s
I20260709 12:11:38.494464  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:38.495985  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 196306us
I20260709 12:11:38.495111  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:38.495047  5019 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:38.497406  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:38.495281  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 244926us
I20260709 12:11:38.498955  4840 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.499451  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:38.501861  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:38.483261 10004 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.062s	user 0.001s	sys 0.003s
I20260709 12:11:38.506145  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:38.512779  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:38.532902  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.531103  9615 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.535097  9937 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.535573  9937 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.531483  9755 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:38.532778  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:38.537539  9937 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:38.538618  9933 raft_consensus.cc:3055] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:38.538992  9933 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:38.539819  9933 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.493827  9776 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:38.544847  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 45296.7us
I20260709 12:11:38.545851  4839 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:38.544854  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.547080  9839 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:11:38.545600  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 45976.2us
I20260709 12:11:38.548309  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:38.548589  5016 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:38.549602  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:38.552485  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:38.555858  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:38.556973  4840 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:38.558109  4840 leader_election.cc:400] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
I20260709 12:11:38.558375  4840 leader_election.cc:403] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:38.560298  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:38.480033  9944 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:38.575304  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 281022us
I20260709 12:11:38.550410  9755 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.545708  9499 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.555588  9868 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:38.496062  9906 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.576994  4943 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:38.586994  5599 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:38.560478  4839 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:38.579493  4840 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:38.704442  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 144002us
I20260709 12:11:41.720026  4872 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
W20260709 12:11:41.722498  4872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1100) took 3644 ms (client timeout 1500 ms). Trace:
W20260709 12:11:41.722874  4872 rpcz_store.cc:269] 0709 12:11:38.077785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.077893 (+   108us) service_pool.cc:224] Handling call
0709 12:11:41.722293 (+3644400us) spinlock_profiling.cc:243] Waited 3.57 s on lock 0x7b54002fc454. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:41.722434 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8215810816}
W20260709 12:11:40.816113  4915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.015s	sys 0.014s
W20260709 12:11:39.878207 10038 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 1.037s	user 0.001s	sys 0.000s
W20260709 12:11:39.868773 10039 log.cc:927] Time spent T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.942s	user 0.001s	sys 0.000s
W20260709 12:11:41.724948  4915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.709s	user 0.016s	sys 0.014s
I20260709 12:11:41.725889 10059 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.624611 10042 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.679823 10044 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:40.667382 10045 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:38.625475  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.679471  5568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.019s	sys 0.034s
W20260709 12:11:40.706598  5569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.015s	sys 0.040s
W20260709 12:11:41.933794  5569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.934s	user 0.017s	sys 0.040s
W20260709 12:11:38.595685  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 320258us
I20260709 12:11:38.582099  9499 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.575515  9615 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
I20260709 12:11:38.581502  9755 consensus_queue.cc:1059] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:38.582459  9738 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:11:41.948947  9738 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:11:41.949373  9738 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:41.950541  9738 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.952232  9738 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:38.704979  9869 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.589053  9776 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.589792  9818 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.700357  9868 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:38.559477  9887 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:41.571462  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 306258us
I20260709 12:11:41.963299  9887 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:38.676086  9913 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:11:39.821652  9930 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:41.970075  9930 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.972461  9930 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:38.573223  9929 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:41.575245  4916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.007s	sys 0.004s
I20260709 12:11:39.957326  9944 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.723966  9947 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.979364  9944 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:38.672201  9948 consensus_queue.cc:1059] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:11:38.560664  9950 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.982661  9950 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:41.983181  9950 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.583768  9959 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 12:11:38.894495  9960 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:41.988314  9960 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.576953 10047 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:39.236362  9962 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:38.825747 10001 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.543s	user 0.012s	sys 0.029s
I20260709 12:11:41.988765  9944 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:38.581504 10011 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.559333 10020 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:38.703387 10021 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:41.999539  5600 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:11:41.999907 10021 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.679248 10031 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:11:41.599328 10048 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:42.003280 10048 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.005945 10048 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:41.604960  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.006943  4991 connection.cc:256] RPC call timeout handler was delayed by -2.6105607660001624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 12:11:42.007459  4991 connection.cc:256] RPC call timeout handler was delayed by -2.2630327480001142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 12:11:42.000564 10021 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:42.008083  5570 connection.cc:256] RPC call timeout handler was delayed by -3.5947520120000718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 12:11:41.618368  5017 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.084s	user 0.051s	sys 0.080s
I20260709 12:11:41.626734 10049 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:42.009505 10049 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.010398 10048 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.011162 10048 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.627300 10050 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:42.012315 10050 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.013550 10048 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.014166 10048 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.014621 10050 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.014781 10048 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.015259 10050 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:41.634570 10051 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:41.990386  9776 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.639429  9675 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:41.640830  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:42.017285  9675 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:42.018543  9675 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.020102  9675 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.653716 10054 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:41.693897  9432 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.021311  9432 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.023276  9432 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:41.705837  4867 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1092) took 3657 ms (client timeout 1550 ms). Trace:
W20260709 12:11:42.023787  4867 rpcz_store.cc:269] 0709 12:11:38.047698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.050432 (+  2734us) service_pool.cc:224] Handling call
0709 12:11:41.705315 (+3654883us) spinlock_profiling.cc:243] Waited 3.51 s on lock 0x7b540004ea54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:41.705559 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8074355456}
W20260709 12:11:39.480301 10040 log.cc:927] Time spent T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.530s	user 0.001s	sys 0.000s
I20260709 12:11:41.990630  9960 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:41.991036 10047 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.727705 10044 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.727607 10042 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.992429  9962 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.028419 10042 leader_election.cc:290] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:41.729955 10045 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.029477  9962 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.030535 10045 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:41.732486  9933 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:41.726656 10059 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.032696 10059 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:41.803542 10055 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.809284 10056 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:41.785936  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.034637  4917 connection.cc:256] RPC call timeout handler was delayed by -2.4570002769999064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
I20260709 12:11:42.034389 10056 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.811923  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1093) took 3754 ms. Trace:
I20260709 12:11:41.819828 10058 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:41.821058 10060 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:41.841313  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 3.2615e+06us
W20260709 12:11:42.011802  5570 connection.cc:256] RPC call timeout handler was delayed by -3.3114298230000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 12:11:41.850270 10063 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:41.866365 10064 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:41.867070  9741 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:41.869943 10057 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:41.871472 10061 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:11:41.877674  4839 connection.cc:256] RPC call timeout handler was delayed by -1.4282950970000456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
I20260709 12:11:41.878130 10065 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.881551  9898 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.891782 10066 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:41.892593  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.896838  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.918128 10070 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:41.918833 10071 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:41.922417  9928 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.925570  9936 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:41.931905  5568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.917s	user 0.020s	sys 0.035s
I20260709 12:11:41.958166  9818 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:41.961112  9499 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:41.962476  9867 raft_consensus.cc:3055] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:41.963802  9887 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.965283  9809 raft_consensus.cc:3055] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:42.077453  9962 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.077797  9809 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:42.078212  5605 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:41.995815  9918 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.079034  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.079463  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.080235  5604 raft_consensus.cc:2393] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 7: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:42.078392  9962 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.080634  9933 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.081362  9933 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.078971  9809 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.083606  9809 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.084148  9933 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:41.638394 10053 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:42.030620 10047 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:41.813004 10062 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.084759  9867 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:42.085345 10062 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
W20260709 12:11:41.849776  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.041105  4950 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:42.085415 10042 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.085994  9867 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.079474  9918 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.087440  9867 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.088449  5599 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:11:42.088837  5599 pending_rounds.cc:85] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 10
I20260709 12:11:42.089066  5599 pending_rounds.cc:107] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:42.089363  5599 raft_consensus.cc:2889] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:42.041208 10044 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.091089  9962 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.042182  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:42.091270 10044 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:42.091885 10044 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:42.092310  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 50315us
I20260709 12:11:42.041684 10060 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.042832 10057 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.094635 10060 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.044759 10056 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.045420  4942 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:42.038853 10045 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.011866 10049 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.045574 10061 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.045182 10054 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.047430  4943 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:42.035436  4869 rpcz_store.cc:276] 0709 12:11:38.057187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.059072 (+  1885us) service_pool.cc:224] Handling call
0709 12:11:38.059326 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.212453 (+153127us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:38.299170 (+ 86717us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.490974 (+191804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:38.491022 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:38.491062 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.811351 (+3320289us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54003363d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:41.811414 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.811705 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128654,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2025,"raft.queue_time_us":2026,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":35627,"spinlock_wait_cycles":305578368,"thread_start_us":227804,"threads_started":2,"wal-append.queue_time_us":282362,"wal-append.run_cpu_time_us":910,"wal-append.run_wall_time_us":1044846}
I20260709 12:11:42.047868  9741 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.046047 10064 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.051745  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.098526 10044 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.054942 10058 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:42.099814 10057 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.095880 10045 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.055333 10065 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.056128  9936 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:42.101603  9936 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.100421 10057 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:42.102674  9936 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.096958  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:42.099959 10064 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.104360 10057 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.017103 10048 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:42.063189  5017 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.529s	user 0.052s	sys 0.080s
W20260709 12:11:42.042268  4839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.66:43473 timed out after 2.221s (SENT) [suppressed 26 similar messages]
I20260709 12:11:42.106411 10045 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.097502 10061 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.106945 10045 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:42.107908  5570 connection.cc:256] RPC call timeout handler was delayed by -2.9905880420001267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:11:42.107779 10045 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:42.108419  5570 connection.cc:256] RPC call timeout handler was delayed by -2.8033880420000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 12:11:42.056841  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:42.108880  5570 connection.cc:256] RPC call timeout handler was delayed by -2.6782880420000765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 12:11:42.109314  5600 raft_consensus.cc:2393] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 6: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:42.064611  9928 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.110064 10070 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.112457 10070 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.066787 10021 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:42.112993  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.114255 10045 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.114826 10045 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:42.068041 10071 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.064368  9818 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.071134  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:42.073559  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.996429  9815 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.016474 10051 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.131613 10051 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.132113  9815 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.134166  9815 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.085151 10053 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.135998 10053 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.033490 10055 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.117092 10020 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.137429 10020 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.137852 10055 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.040784 10063 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.138698  9950 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.139467 10020 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.139695 10063 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.086771 10042 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.099546 10058 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.101989  9741 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.051363 10066 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.105449 10054 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.100397  9911 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.119390  9499 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:42.142798  9911 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.143775 10066 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.118368  9898 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.055276 10059 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:42.116339 10011 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:42.145828 10058 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.145109  9898 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.147087  9944 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:42.147584  9944 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.148257  9898 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.145156 10059 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.149422  9944 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.149894  9944 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.112550  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:42.150496  9944 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.151554 10059 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.115397 10045 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.129570  9960 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.152822  9960 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.145830 10011 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.129912  9930 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.155514 10043 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.155287  9930 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.156011 10043 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.140674  9950 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.157439  9930 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.158066 10043 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.119164 10065 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.119545 10060 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.159301 10060 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.161237 10060 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.161783 10047 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.162045 10045 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.147862  9911 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.152168 10059 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.106884  4871 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:42.118315  9918 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.096850 10062 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.141753 10042 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.116796 10061 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.116871  9615 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.178087  9615 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.165638 10066 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.181348 10066 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.183350 10066 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.165460 10063 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.184002 10063 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.185940 10063 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.166923  9962 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:11:42.154923  9960 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.188323  9741 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.141840 10071 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:42.167639  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 203942us
I20260709 12:11:42.170063  9928 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.170465 10055 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.171141  9933 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.994488  4769 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 10 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:42.173516  4917 connection.cc:256] RPC call timeout handler was delayed by -2.4472849619999124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
I20260709 12:11:42.129129 10044 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.180792  9615 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.115898 10057 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.195304  9933 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.195564 10057 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.152199  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:42.197643  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45553.5us
I20260709 12:11:42.198065  9933 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.198545  4840 leader_election.cc:400] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 20. Current term is 21.
I20260709 12:11:42.198781  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.201098 10020 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.201552 10047 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:42.202739  4871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57560 (request call id 1099) took 4126 ms (client timeout 1708 ms). Trace:
I20260709 12:11:42.203565 10047 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.206720 10057 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:42.189729  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 78452.6us
W20260709 12:11:42.193470  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 151233us
I20260709 12:11:42.155300 10011 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.205150  9867 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:11:42.203146  4871 rpcz_store.cc:269] 0709 12:11:38.075908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.077135 (+  1227us) service_pool.cc:224] Handling call
0709 12:11:42.202509 (+4125374us) spinlock_profiling.cc:243] Waited 3.93 s on lock 0x7b54002c2ed4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:42.202646 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9047612288}
I20260709 12:11:42.205058 10054 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.222008  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.222622 10055 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.223115  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 2561) took 3728 ms. Trace:
I20260709 12:11:42.207134  9741 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.222827  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.224231  9898 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.174737 10060 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:42.215926  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.168730 10045 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:42.152683  9944 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.222362  5601 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:42.221813 10054 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.224999  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:42.226140  4769 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 9 to 10, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.224826  9898 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.237498 10057 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:42.237129  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.227239  9887 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.228029 10045 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.241668  9887 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.242049 10045 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.225072 10052 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:42.243443 10052 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.244091  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:42.244328  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 43510.9us
I20260709 12:11:42.244769  5598 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:42.245527  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.225275 10060 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.246258 10052 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.246678  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.247099  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.246711  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.248072  9867 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.225705  9913 raft_consensus.cc:3055] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:42.249013  9913 raft_consensus.cc:740] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:42.249146  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.245606  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.249773  5604 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:42.247231  5597 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:42.232471  9928 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:42.250753  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:42.252396  9928 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.238866  9741 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.254685  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.219987 10061 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.257604 10074 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:42.234500 10044 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.259382 10011 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:42.259820 10011 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:42.260190 10011 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.249217  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.261046  5601 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:42.261775 10020 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:42.256719  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.256868  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.223495  5017 rpcz_store.cc:276] 0709 12:11:38.494815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.495565 (+   750us) service_pool.cc:224] Handling call
0709 12:11:38.495802 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.495985 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:42.105365 (+3609380us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.222670 (+117305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.222746 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:42.222817 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.222909 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.223048 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30789,"prepare.queue_time_us":198521,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":32066,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"thread_start_us":3656701,"threads_started":2}
I20260709 12:11:42.254850  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.262404 10020 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:42.250310  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.262532  5606 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 6.
I20260709 12:11:42.265336  5603 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:42.271123  5605 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:42.271765  4988 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:42.260160 10044 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.272183 10041 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.272651 10041 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:42.275799  4991 connection.cc:256] RPC call timeout handler was delayed by -1.756231525000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2279s for a response
I20260709 12:11:42.276966 10071 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.277595 10071 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:42.278216  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.279582 10071 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.277611  9741 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:42.268932  4841 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.280714  9741 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.282024  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.238945  9898 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.224754 10055 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.249907  9913 consensus_queue.cc:260] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.286134  9913 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.289023 10062 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:42.289497  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 47097.2us
I20260709 12:11:42.289746 10075 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:42.290043  9933 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.290549  9933 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.247777 10060 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.271710  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.289345  9867 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.292790  4841 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.294265  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.254474 10054 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.293851  9867 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.297183  9867 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.297789  4840 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:42.299422  9741 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.300333  9887 raft_consensus.cc:2764] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Leader election decision vote started in defunct term 8: won
I20260709 12:11:42.301115 10077 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.301625 10077 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.302742  4871 raft_consensus.cc:1240] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:42.303759 10077 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.304782  4869 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:42.305768  4917 connection.cc:256] RPC call timeout handler was delayed by -2.2749472009998044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 12:11:42.306496 10041 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:42.306874  4917 connection.cc:256] RPC call timeout handler was delayed by -2.2259296069998982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 12:11:42.307271  4917 connection.cc:256] RPC call timeout handler was delayed by -2.2212977139997747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 12:11:42.306214 10055 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.301542  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.258225 10061 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:42.308036  4917 connection.cc:256] RPC call timeout handler was delayed by -2.0530849619999572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 12:11:42.301074  9887 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:42.310281  4917 connection.cc:256] RPC call timeout handler was delayed by -2.0125513410000622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:11:42.310623  4917 connection.cc:256] RPC call timeout handler was delayed by -1.6349968389999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260709 12:11:42.311298 10055 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.313325 10055 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.313810  9887 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.314188  9887 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:42.307519  9933 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:42.316867  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 165735us
I20260709 12:11:42.317396  4867 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:42.317700 10077 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.318066 10077 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.318403 10077 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.318861  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.319649  4867 raft_consensus.cc:2410] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:11:42.294992 10045 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:42.320968  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.321499  4867 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:42.321883  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.322434  5603 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 16.
I20260709 12:11:42.323287  4871 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:42.323653  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.324249  5603 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:42.322471  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.322729  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.324961  9741 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:42.325414 10062 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.325636  9741 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.325779 10054 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:42.326246  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.325987 10062 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.325762  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.325063  5602 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:42.326999 10075 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.327688  9741 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.326056 10076 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.328027 10075 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.326999  5601 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:42.326843 10054 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.328800 10062 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.334002  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.336663  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.337852  4769 catalog_manager.cc:5697] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 8 to 9, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 9 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.338526 10075 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.336035  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.330770 10054 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:42.340256  9867 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.346799  9887 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.328680 10076 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:42.346833  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.341199  4769 catalog_manager.cc:5697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 8 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:42.355993  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 74025.9us
I20260709 12:11:42.353916  4916 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.354614  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.380573  4916 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.378935  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.386201  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.401219  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:11:42.426425  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 95918.9us
I20260709 12:11:42.385912  4916 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.418541  4871 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
W20260709 12:11:42.437311  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.374794 10062 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.437372  4769 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 8 to 9, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 9 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:42.437984  5017 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:42.397863  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.440605  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.441200  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:42.470513  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 84642us
I20260709 12:11:42.470964  5603 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:42.440480  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.442507  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.441392  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.401531 10045 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.388986  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.444118  9887 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.445366  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:42.445518  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.477865  5606 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:42.478021  5601 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:42.442996  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.388967 10081 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.447069  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.475220  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.480090  4872 raft_consensus.cc:2368] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:42.441393  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:42.452622 10078 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.063s	user 0.005s	sys 0.000s
W20260709 12:11:42.453222  4915 connection.cc:256] RPC call timeout handler was delayed by -1.4249874209999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.328s for a response
W20260709 12:11:42.481279  4915 connection.cc:256] RPC call timeout handler was delayed by -1.3566684929999155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2988s for a response
W20260709 12:11:42.454798 10083 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.057s	user 0.001s	sys 0.002s
I20260709 12:11:42.442093 10011 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:42.461481  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.461846  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.462211  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.463035  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.482828  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.463322  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.483891  4769 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:42.463630  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.485025  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.387360 10076 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.469439  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.473239  5021 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:11:42.474462  5020 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:42.480230  4943 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:42.483675  4876 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:42.472162  9933 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.488008  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.484468  4951 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:42.486405  4875 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:42.488139  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.483830  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.488940  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.489588  4871 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:42.489141  4874 raft_consensus.cc:2368] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 6. Current term is 7.
I20260709 12:11:42.490906  9867 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.491174  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.486980  4873 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:42.486481  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.491466  5024 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:42.477840 10045 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:42.481792 10081 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.488665  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.496170  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.496899  5019 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:42.493629  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.492990  4868 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:42.498157  4869 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:42.496170  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.500190  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.501268  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.500788  4943 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:42.501806  5021 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:42.503583  5601 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:42.515127  4942 raft_consensus.cc:2393] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:42.514168  4870 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:42.514550  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.493220  4769 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 11 to 12, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:42.497920 10045 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.516746  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.517168  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:42.517768  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.489140  9933 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:42.519771  5599 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.518895  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.519487  4874 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:42.522701  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.498991 10081 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.524448  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.526577  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.487958 10062 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.530005  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.530514  4990 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:42.531078  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:42.532197  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.534356  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.535781  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.534974  5021 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 20.
I20260709 12:11:42.536582  4875 raft_consensus.cc:2410] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:42.537410 10011 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:42.538554  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.539201  4876 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:42.539891  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.540504  5597 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:42.535554  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.542670 10062 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.543253  5016 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:42.516820 10077 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.549665  4944 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:42.550451 10077 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.553337  4990 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:42.554148  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:42.554884  4990 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:42.555167  4867 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:42.555588 10071 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.555994 10054 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.561836  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:42.562328  4872 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:11:42.562661 10076 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:42.562919  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.569060  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.534832  4942 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:42.522357  9933 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:42.579326  5046 debug-util.cc:398] Leaking SignalData structure 0x7b0800329b40 after lost signal to thread 3728
W20260709 12:11:42.727854  5046 debug-util.cc:398] Leaking SignalData structure 0x7b080030fec0 after lost signal to thread 4808
W20260709 12:11:42.687021  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.568985  9741 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:42.706992  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:42.706225  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 121626us
I20260709 12:11:42.733750  4990 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:42.713481  5606 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:42.713776  5599 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:42.734630  4990 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:42.745622  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.733151 10076 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.748240  4870 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:42.748572 10076 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.745400 10075 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:42.749198 10075 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.749536 10075 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.752244 10062 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:42.752537  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 190802us
I20260709 12:11:42.752866  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.753468  4942 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:42.713245 10071 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.753994 10071 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.754323 10055 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:42.755147  5046 debug-util.cc:398] Leaking SignalData structure 0x7b0800284be0 after lost signal to thread 4900
W20260709 12:11:42.755458  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08001b09a0 after lost signal to thread 4901
I20260709 12:11:42.732864 10054 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.756358 10076 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.733057  9741 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:42.756412  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca840 after lost signal to thread 4975
I20260709 12:11:42.758143  4950 raft_consensus.cc:2410] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 12:11:42.758504  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08002e52e0 after lost signal to thread 5049
W20260709 12:11:42.758796  5046 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6420 after lost signal to thread 5050
I20260709 12:11:42.759444  5020 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:42.758450 10076 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.756824 10054 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:42.756906 10062 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.761040 10062 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.760545  5019 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 20. Current term is 21. Ops: []
I20260709 12:11:42.764371  4841 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.753417  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:42.765328  9947 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:42.765826  9947 raft_consensus.cc:697] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:42.766240  9809 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:42.766760  9947 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.767608  9898 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:42.759802  5046 debug-util.cc:398] Leaking SignalData structure 0x7b0800355be0 after lost signal to thread 5630
W20260709 12:11:42.782740  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.757375  9741 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.787699  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.787969  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.783876  4841 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.788586  5024 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:42.790719  5018 raft_consensus.cc:2410] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:11:42.792491  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:42.793044  5606 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:42.793926  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.794986  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.795102  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:42.795699  5025 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.796411  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.796840  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.796419  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:42.795491  5022 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:42.799710  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.800770  5020 raft_consensus.cc:2410] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:11:42.799955  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.797377  5601 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:42.798529  4950 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 7.
I20260709 12:11:42.809163  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.809741  5024 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:42.810331  9933 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.811095  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:42.811599  5018 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.812453  9933 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.813578  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.732546 10081 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.814270  5021 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:42.817512  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:42.818068  5020 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.798954  9867 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:42.829327  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.733031 10045 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.835803  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.843500  4951 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:42.842494  5025 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:42.844210  5606 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:42.855656  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.858642  5021 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:42.865255  4947 raft_consensus.cc:2393] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:42.859269  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.867574  4868 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:42.868819  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.837761  9867 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:42.882089  4873 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:42.883219  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.867535  9887 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.886747  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.887231  4874 raft_consensus.cc:2393] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:42.889912  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.890692  4873 raft_consensus.cc:2410] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:11:42.893396  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.891145  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.897595  9887 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.899235  9741 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.899690  9887 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.901774 10075 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:42.902573  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:42.903144  4868 raft_consensus.cc:2376] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13. Re-sending same reply.
I20260709 12:11:42.903735 10075 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.903921  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.904146 10077 consensus_queue.cc:1059] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:42.904531  4868 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:42.908669  5018 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:42.913003  4876 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:42.907727  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.919014  5020 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:42.909595  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:42.920064  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.920763  5601 raft_consensus.cc:3060] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.920923  5018 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:42.906759  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.907388  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.922878  5606 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:42.909199  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:42.923919  4874 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:42.926468  4841 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:42.932040  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.934128  4875 raft_consensus.cc:2410] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:11:42.959118  5018 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:42.960923  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:42.961391  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:42.965561  4868 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:11:42.961521  4875 raft_consensus.cc:2376] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13. Re-sending same reply.
I20260709 12:11:42.967947  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:42.909991  9933 consensus_queue.cc:1059] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:11:42.973186  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:42.960927 10061 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:42.908955 10055 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:11:42.976866  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:42.982378  4867 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:42.984894  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.973338  9741 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.976161 10061 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.009155  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:43.022658  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 116418us
I20260709 12:11:43.024627  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:43.025301  5016 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:43.026315  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:42.993243 10061 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.041843  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:43.035166  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:43.043114  5605 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.036058  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:43.036610  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:43.043998  5600 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 17: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:43.042418  5603 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:43.050256  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:42.994462 10081 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:42.973122  9867 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:43.043861  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:43.008527 10045 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:43.061650  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:43.062390  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:43.063244  4868 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 12:11:43.065860  4868 pending_rounds.cc:85] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 11
I20260709 12:11:43.066102  4868 pending_rounds.cc:107] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:11:43.066315  4868 raft_consensus.cc:2889] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.063875  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:43.075109  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:43.076457  5606 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:43.074332  4875 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:43.080308  4917 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:43.089246  4917 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:42.997256 10062 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:43.078007  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:43.077637  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:43.094105  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:43.091071  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:43.097050  4876 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:43.096488  4949 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:43.087736 10077 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:43.129453  5020 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 15: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:43.129841  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:43.155721  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 66632.2us
I20260709 12:11:43.156245  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:43.157511  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:43.123657 10045 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:43.095733 10081 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:43.159101  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:43.161134  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:43.126459 10055 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:43.161161  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:43.163836  4946 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
W20260709 12:11:43.165470  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 166241us
I20260709 12:11:43.166121  5567 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:43.171646  4876 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 20.
I20260709 12:11:43.173262  5567 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:43.174039 10104 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:11:43.170192  9913 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.170173 10054 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:43.183424 10094 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:11:43.193246  5605 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:43.191794  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:43.162035 10045 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:44.652930 10045 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:43.205737 10105 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 12:11:43.162400 10081 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:44.659035 10081 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.250511 10132 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.661000 10132 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:44.661363 10132 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:43.252521 10121 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:43.294657  9809 raft_consensus.cc:3055] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.193766  9913 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:43.761119  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:43.821880  4942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.006s	sys 0.010s
I20260709 12:11:44.665096  9809 raft_consensus.cc:740] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:44.665552  4942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.539s	user 0.007s	sys 0.010s
I20260709 12:11:44.666229  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 1102) took 1826 ms. Trace:
I20260709 12:11:44.666059  9809 consensus_queue.cc:260] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:43.846861  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1108) took 1027 ms. Trace:
I20260709 12:11:44.667464 10060 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:43.929422 10071 consensus_meta.cc:287] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 1.175s	user 0.012s	sys 0.007s
I20260709 12:11:44.033444 10054 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:44.667752  9809 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.666579  4942 rpcz_store.cc:276] 0709 12:11:42.851890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.858306 (+  6416us) service_pool.cc:224] Handling call
0709 12:11:42.882659 (+ 24353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.885232 (+  2573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.885258 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.897731 (+ 12473us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.006472 (+108741us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:43.126370 (+119898us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.665922 (+1539552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.666007 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.666046 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:44.666058 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.666159 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204188,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":30,"raft.queue_time_us":65659,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":15981,"thread_start_us":1729733,"threads_started":3,"wal-append.queue_time_us":142768,"wal-append.run_cpu_time_us":3984,"wal-append.run_wall_time_us":1174509}
W20260709 12:11:44.208314  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003341a0 after lost signal to thread 3728
W20260709 12:11:44.299714  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 235427us
I20260709 12:11:44.418159  5025 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:44.669420  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 1272) took 1604 ms. Trace:
I20260709 12:11:44.669720  5025 rpcz_store.cc:276] 0709 12:11:43.065435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.169281 (+103846us) service_pool.cc:224] Handling call
0709 12:11:44.669346 (+1500065us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:44.485353  5567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.295s	user 0.000s	sys 0.030s
W20260709 12:11:44.672422  5567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.482s	user 0.000s	sys 0.030s
I20260709 12:11:44.666926  4869 rpcz_store.cc:276] 0709 12:11:42.819604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.819713 (+   109us) service_pool.cc:224] Handling call
0709 12:11:42.828974 (+  9261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.838608 (+  9634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.838639 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.858849 (+ 20210us) log.cc:844] Serialized 26 byte log entry
0709 12:11:42.983400 (+124551us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:42.983447 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.983505 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.846582 (+863077us) raft_consensus.cc:1685] finished
0709 12:11:43.846602 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.846773 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17018,"raft.queue_time_us":1553,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":17564,"thread_start_us":95751,"threads_started":1,"wal-append.queue_time_us":324852,"wal-append.run_cpu_time_us":1687,"wal-append.run_wall_time_us":1001723}
I20260709 12:11:44.507128  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2705) took 1712 ms. Trace:
I20260709 12:11:44.674868  5017 rpcz_store.cc:276] 0709 12:11:42.794478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.881151 (+ 86673us) service_pool.cc:224] Handling call
0709 12:11:42.886547 (+  5396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.918155 (+ 31608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.918185 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.933277 (+ 15092us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.155635 (+222358us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:43.166333 (+ 10698us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.170685 (+  4352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.170763 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.506834 (+1336071us) raft_consensus.cc:1685] finished
0709 12:11:44.506855 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.507037 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3990,"prepare.queue_time_us":11134,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":30,"raft.queue_time_us":77151,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":24866,"thread_start_us":183989,"threads_started":1,"wal-append.queue_time_us":251643,"wal-append.run_cpu_time_us":7588,"wal-append.run_wall_time_us":1031685}
I20260709 12:11:44.586735  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:44.601208  4950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.575s	user 0.014s	sys 0.033s
W20260709 12:11:44.677059  4950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.651s	user 0.014s	sys 0.033s
I20260709 12:11:44.678038 10071 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.680032 10071 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:44.682715  4868 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
W20260709 12:11:44.683218  4868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 3593) took 1516 ms (client timeout 1790 ms). Trace:
W20260709 12:11:44.683538  4868 rpcz_store.cc:269] 0709 12:11:43.167989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.170623 (+  2634us) service_pool.cc:224] Handling call
0709 12:11:44.683143 (+1512520us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:44.693400  4951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43248 (request call id 1094) took 2177 ms (client timeout 2149 ms). Trace:
W20260709 12:11:44.693789  4951 rpcz_store.cc:269] 0709 12:11:42.516231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.516349 (+   118us) service_pool.cc:224] Handling call
0709 12:11:44.693173 (+2176824us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400256054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:44.693295 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709149440}
I20260709 12:11:44.665004 10121 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.694886 10121 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:44.700592  4915 leader_election.cc:336] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.610s (SENT)
I20260709 12:11:44.701073  4915 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:44.701481  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.538s	user 0.006s	sys 0.016s
I20260709 12:11:44.701740  9809 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:44.618678 10138 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:44.620492 10141 consensus_queue.cc:1059] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:44.615406 10139 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:44.705900  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 1101) took 1888 ms. Trace:
I20260709 12:11:44.665647  5016 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:44.711459 10141 raft_consensus.cc:3055] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:44.710559  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1110) took 1890 ms. Trace:
I20260709 12:11:44.665903  9913 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.712466 10141 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:44.713742 10141 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.714936 10141 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:44.716670  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.672709  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 1.49967e+06us
I20260709 12:11:44.709569  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:44.717409  5567 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:44.717547  4871 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 20.
I20260709 12:11:44.712330 10060 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:44.718142  4871 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 2443) took 2180 ms (client timeout 2192 ms). Trace:
I20260709 12:11:44.702445 10138 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:44.718528  4871 rpcz_store.cc:269] 0709 12:11:42.537841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.585964 (+ 48123us) service_pool.cc:224] Handling call
0709 12:11:44.709448 (+2123484us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b5800002a98. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a577c5b71 00007f2a577c5eee 000000000036eb39 00007f2a5f8391e0 00007f2a5f9020c4 00007f2a5f902131 00007f2a5f8b00a0 00007f2a5f8af984 00007f2a58e2a6d4 00007f2a58e2a662
0709 12:11:44.718090 (+  8642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5177856}
W20260709 12:11:44.622488  5600 consensus_meta.cc:287] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 1.500s	user 0.014s	sys 0.018s
I20260709 12:11:44.632581  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1265) took 1748 ms. Trace:
I20260709 12:11:44.632617 10143 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:44.720446 10138 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:44.712543  4872 rpcz_store.cc:276] 0709 12:11:42.820568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.820678 (+   110us) service_pool.cc:224] Handling call
0709 12:11:42.828400 (+  7722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.970473 (+142073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.970501 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.976974 (+  6473us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.127618 (+150644us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:43.127691 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.127810 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.710329 (+1582519us) raft_consensus.cc:1685] finished
0709 12:11:44.710349 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.710477 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6237,"raft.queue_time_us":33042,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":11123,"thread_start_us":225474,"threads_started":2,"wal-append.queue_time_us":174471,"wal-append.run_cpu_time_us":5661,"wal-append.run_wall_time_us":1047986}
W20260709 12:11:44.637197  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.637166  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1259) took 1864 ms. Trace:
I20260709 12:11:44.643685  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1266) took 1753 ms. Trace:
I20260709 12:11:44.649122 10076 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.722679  5018 rpcz_store.cc:276] 0709 12:11:42.890225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.642894 (+1752669us) service_pool.cc:224] Handling call
0709 12:11:44.643181 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.643340 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.643363 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:44.643427 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:44.643470 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.643520 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.643618 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:44.649592  5602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.465s	user 0.011s	sys 0.028s
I20260709 12:11:44.650517 10145 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:44.701889  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.538s	user 0.006s	sys 0.016s
W20260709 12:11:44.722299  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.636714 10144 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:44.720183 10143 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.711256  4950 rpcz_store.cc:276] 0709 12:11:42.818000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.825277 (+  7277us) service_pool.cc:224] Handling call
0709 12:11:42.851098 (+ 25821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.858420 (+  7322us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:43.026048 (+167628us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.677639 (+1651591us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.705564 (+ 27925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:44.705617 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:44.705673 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.705739 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.705846 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":317185,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":17676,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":169,"thread_start_us":1810007,"threads_started":3,"wal-append.queue_time_us":224016,"wal-append.run_cpu_time_us":1012,"wal-append.run_wall_time_us":1001043}
I20260709 12:11:44.735239 10143 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.735754 10143 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.736173 10143 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.737092 10144 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.738173  9913 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.739148 10144 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:44.712003  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 1274) took 1544 ms. Trace:
I20260709 12:11:44.719806  5600 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
W20260709 12:11:44.724690  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 1.56553e+06us
I20260709 12:11:44.725080  5567 leader_election.cc:403] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:44.623405 10142 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:44.732174  5602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.547s	user 0.011s	sys 0.029s
I20260709 12:11:44.712635 10139 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.741909  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57006 (request call id 1176) took 1742 ms. Trace:
I20260709 12:11:44.722127  5019 rpcz_store.cc:276] 0709 12:11:42.772492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.776212 (+  3720us) service_pool.cc:224] Handling call
0709 12:11:42.792482 (+ 16270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.799381 (+  6899us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:42.925952 (+126571us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.635104 (+1709152us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b18002153e0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a5a4924bc 00007f2a577e048b 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a23a
0709 12:11:44.635273 (+   169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:44.635321 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:44.635376 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.635441 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.637018 (+  1577us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5400342e50. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:44.637120 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183939,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":23790,"raft.queue_time_us":32958,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"spinlock_wait_cycles":12829696,"thread_start_us":190632,"threads_started":2,"wal-append.queue_time_us":241786,"wal-append.run_cpu_time_us":1106,"wal-append.run_wall_time_us":1001132}
I20260709 12:11:44.742628  5567 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:44.743408 10139 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.732522 10145 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.732982 10060 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:44.733222 10076 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.745811  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:44.719872  5024 rpcz_store.cc:276] 0709 12:11:42.884660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.585798 (+1701138us) service_pool.cc:224] Handling call
0709 12:11:44.586187 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.586635 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.586662 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.587183 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.629466 (+ 42283us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:44.629503 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.629569 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.632381 (+  2812us) raft_consensus.cc:1685] finished
0709 12:11:44.632398 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.632526 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33678,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":41927,"threads_started":1,"wal-append.queue_time_us":42232}
W20260709 12:11:44.735296  4915 leader_election.cc:336] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.707s (SENT)
I20260709 12:11:44.739899  5016 rpcz_store.cc:276] 0709 12:11:43.167126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.760842 (+593716us) service_pool.cc:224] Handling call
0709 12:11:44.711912 (+951070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:44.743660  5567 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:44.748926  9809 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.749316  9809 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:44.749661  9809 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.749995 10060 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:44.745287  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57006 (request call id 1178) took 1734 ms (client timeout 1604 ms). Trace:
W20260709 12:11:44.752930  5600 rpcz_store.cc:269] 0709 12:11:43.005836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.052460 (+ 46624us) service_pool.cc:224] Handling call
0709 12:11:44.740525 (+1688065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:44.754750  4990 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:44.755051  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.755594  4946 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:11:44.754683 10141 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.746268 10142 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:44.757234  4915 leader_election.cc:336] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.721s (SENT)
I20260709 12:11:44.756518  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.759073  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:44.759514 10076 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:44.759735  4915 leader_election.cc:336] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.944s (SENT)
I20260709 12:11:44.760131  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:44.760695  5597 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.761839  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.756107 10077 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.759650  5598 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.766508 10144 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.766896 10144 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:44.767232 10144 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.762404  4943 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 16.
I20260709 12:11:44.763918  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.763675 10141 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.764196  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.760106  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:44.768142  4950 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:44.768276  4944 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:44.764570  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.764822  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.765136  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.760860 10138 consensus_queue.cc:1059] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:11:44.765699  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.770718  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.771193  4947 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 6.
I20260709 12:11:44.771328  4944 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:44.771682 10062 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:44.771961  4949 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:11:44.772336  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080022a520 after lost signal to thread 4808
I20260709 12:11:44.769610  4951 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 20.
W20260709 12:11:44.770035  5601 consensus_meta.cc:287] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 1.846s	user 0.008s	sys 0.018s
I20260709 12:11:44.770560  4946 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:44.772823  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.773785  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.742254  5602 rpcz_store.cc:276] 0709 12:11:42.999262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.999561 (+   299us) service_pool.cc:224] Handling call
0709 12:11:43.041329 (+ 41768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:43.171341 (+130012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.171372 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.183832 (+ 12460us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.741572 (+1557740us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:44.741613 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.741681 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.741723 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:44.741734 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.741840 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79555,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5532,"thread_start_us":1686348,"threads_started":2,"wal-append.queue_time_us":65926,"wal-append.run_cpu_time_us":1531,"wal-append.run_wall_time_us":1001541}
I20260709 12:11:44.774230  5601 raft_consensus.cc:2468] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
W20260709 12:11:44.774963  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37900 (request call id 1498) took 1865 ms (client timeout 1790 ms). Trace:
I20260709 12:11:44.777922  4944 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:44.746723 10139 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
W20260709 12:11:44.775332  5601 rpcz_store.cc:269] 0709 12:11:42.909203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.909353 (+   150us) service_pool.cc:224] Handling call
0709 12:11:44.774901 (+1865548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:44.763849 10145 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:44.780603  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.779259  4990 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:44.781297  4951 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:44.780942 10121 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.785375 10149 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:44.785766 10149 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.786082 10149 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:44.786273  9913 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:44.786891 10061 consensus_meta.cc:287] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 1.727s	user 0.015s	sys 0.015s
I20260709 12:11:44.786834  9913 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:44.787429 10061 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.789507 10061 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:44.787492  9913 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.791404  9913 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.791831 10081 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:44.792971  4948 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:44.794526 10143 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.784561 10062 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:44.783182 10055 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:44.798988 10045 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:44.806591 10045 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.778002 10076 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.771646 10141 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:44.824136 10076 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.809043  4942 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:44.812351  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:44.813016  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.827116  4943 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:44.827873  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:44.813714  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.828624  4950 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:44.815042  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.829437  4945 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 5.
I20260709 12:11:44.817199  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.817268  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:44.820204  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080023b040 after lost signal to thread 4839
W20260709 12:11:44.831975  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003216c0 after lost signal to thread 4841
W20260709 12:11:44.832223  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800390f60 after lost signal to thread 4842
W20260709 12:11:44.832749  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003993e0 after lost signal to thread 4870
W20260709 12:11:44.833380  4805 debug-util.cc:398] Leaking SignalData structure 0x7b0800341d80 after lost signal to thread 4900
I20260709 12:11:44.821977  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 1267) took 1925 ms. Trace:
I20260709 12:11:44.796716 10132 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.822830  5597 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:44.823345  5598 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 16.
I20260709 12:11:44.824601  4990 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:44.834904  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.837008  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.786809 10121 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.833854  5020 rpcz_store.cc:276] 0709 12:11:42.896927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.920705 (+ 23778us) service_pool.cc:224] Handling call
0709 12:11:44.821803 (+1901098us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400162bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:44.821914 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452344064}
W20260709 12:11:44.835143  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003479c0 after lost signal to thread 4901
W20260709 12:11:44.839859  5570 leader_election.cc:336] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.500s (SENT)
W20260709 12:11:44.837785  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 70082.7us
I20260709 12:11:44.838315  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.836791  5021 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:44.840502  4943 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.842350  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.842450  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:44.840252  5570 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:44.840687  4951 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:44.844113  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:44.844854  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003568a0 after lost signal to thread 4975
W20260709 12:11:44.845173  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6ec0 after lost signal to thread 4976
I20260709 12:11:44.845281  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:44.845501  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 85771.7us
I20260709 12:11:44.844193  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:44.845799  5601 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.847409  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:44.846612  4944 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:44.829881 10076 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.846875  4990 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:44.846230  5598 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:44.848977  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:44.846210  4805 debug-util.cc:398] Leaking SignalData structure 0x7b080036cdc0 after lost signal to thread 5049
I20260709 12:11:44.849071  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:44.850947  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.866288  4944 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:44.846642 10075 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:44.852029 10132 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.852464  5600 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:44.852947  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:44.854569 10060 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.869768  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.874377  4990 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:44.873445  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.864629  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:44.875315  4944 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:44.875651  4948 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:44.855607  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.857122  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:44.857234  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 1.85914e+06us
W20260709 12:11:44.858021  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.876127  4950 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:44.861832  9809 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.857367  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:44.863714 10067 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.863881 10020 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:44.865921  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08002be380 after lost signal to thread 5050
W20260709 12:11:44.866719  4991 leader_election.cc:336] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.576s (SENT)
I20260709 12:11:44.858593 10077 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:44.876332  5602 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.843514 10143 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.906554 10101 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.909269  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:44.909135 10101 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.910145  4990 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:44.911021 10141 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:44.250046  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:44.899291  4917 leader_election.cc:336] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.514s (SENT)
I20260709 12:11:44.894173  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.893839  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.892940  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.891132  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.893496  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.893157  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.913962  5017 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:44.885166  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.894707  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.894544  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.914161  5022 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:44.883951  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:44.892498  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.914839  4917 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:44.915004  5025 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:44.890591  5016 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:11:44.913192  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac260 after lost signal to thread 5630
I20260709 12:11:44.913111  5603 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:44.870229  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:44.917105  4805 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab280 after lost signal to thread 5631
I20260709 12:11:44.888949  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:44.894707  5601 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:44.917047  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:44.909017 10020 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.915573  5021 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 6.
I20260709 12:11:44.921646  5602 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:44.922628  4872 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:44.899037  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:44.921676  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.931958  4949 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:44.912529 10077 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:44.928742  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 60084.6us
I20260709 12:11:44.929067  4942 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:44.929466  4944 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:44.930068  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:44.930581  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 60408.3us
I20260709 12:11:44.925290  4947 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:44.938987 10156 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.939424 10156 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.939774 10156 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.928478 10143 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.953105  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:44.953625  5597 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:44.953894  4873 raft_consensus.cc:2410] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:44.954190 10143 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.954852  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.955417  5022 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:44.955703  4949 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:44.956211  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:44.906021 10011 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.956743  5022 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:44.957080 10011 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.956492  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.960075  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:44.932662  5567 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:44.962049  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:44.964296 10121 raft_consensus.cc:2764] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:11:44.965066 10150 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.869550 10060 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.965441  5597 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.965852  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:44.966933 10060 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:44.888260 10054 raft_consensus.cc:2804] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:44.947464  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.947147 10077 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:44.873131 10075 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:44.948009  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.868088 10146 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.948627  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:44.907989  9887 raft_consensus.cc:476] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:44.952214  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:44.981643  4868 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:44.943277 10055 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:44.952464  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:44.945355  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 46089.2us
I20260709 12:11:44.982287 10055 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.982707 10055 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:44.983733  4917 leader_election.cc:336] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.625s (SENT)
I20260709 12:11:44.984126  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:44.933377 10071 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:44.899245  4770 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 11 to 13, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:44.985503  4917 leader_election.cc:336] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.689s (SENT)
I20260709 12:11:44.968613  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:44.968999  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 129162us
I20260709 12:11:44.969698  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:44.986409  4917 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:44.961145  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:44.987232  4872 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:44.934199  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:44.960737  4871 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:44.972533  4948 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7.
I20260709 12:11:44.982625  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:44.887533 10142 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:44.974009  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:44.946113  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:44.974278  4990 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:44.991291  4876 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:44.976161  4943 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:44.980350  5022 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:44.965478 10150 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.981248 10075 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:44.905730  9947 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:44.985510  4769 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 360) took 11512 ms (client timeout 15000 ms). Trace:
I20260709 12:11:44.988698  5605 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
W20260709 12:11:44.960765  4991 leader_election.cc:336] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.143s (SENT)
W20260709 12:11:44.986474  5570 leader_election.cc:336] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.550s (SENT)
I20260709 12:11:44.922199 10101 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:45.015612  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.959111 10011 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:45.018443  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 84299.2us
I20260709 12:11:45.019469  5597 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:45.057778  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:45.061511  4916 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:45.061583  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 115557us
I20260709 12:11:45.062335  5601 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:45.063586  4839 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.058190  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.065867  5570 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:45.065961  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.063426 10152 consensus_queue.cc:1059] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:44.973861 10144 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.062752  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.072144  4841 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:44.991848 10145 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:45.073611  4876 raft_consensus.cc:2393] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 10: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:45.020941 10138 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.076609 10011 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:44.983727 10081 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:45.017576 10062 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:44.934000 10149 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.018479 10060 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.076067  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.081244  4841 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.060098  9898 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:45.083272  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 97786.8us
I20260709 12:11:44.933718 10067 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.084116  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.072835 10057 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.064359 10161 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:45.070509 10141 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:45.107899  5603 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.106727  4916 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.118414  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:45.119155  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 144941us
I20260709 12:11:45.020756 10150 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.081559 10100 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:45.099471 10061 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.123692  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.124212  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:45.124524  4950 raft_consensus.cc:2410] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:45.028730 10102 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:11:45.120182  4990 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:45.102047 10132 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:45.132947  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 146499us
I20260709 12:11:45.115787 10101 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:45.120832  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.121456  4948 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:45.029009  4769 rpcz_store.cc:269] 0709 12:11:33.472983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.473106 (+   123us) service_pool.cc:224] Handling call
0709 12:11:44.985441 (+11512335us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:43.247748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:43.248357 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:43.248402 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:11:43.248425 (+    23us) tablet.cc:662] Decoding operations
0709 12:11:43.249236 (+   811us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:43.249311 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:43.249339 (+    28us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:43.253093 (+  3754us) tablet.cc:701] Row locks acquired
0709 12:11:43.253118 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:11:43.253276 (+   158us) write_op.cc:270] Start()
0709 12:11:43.253374 (+    98us) write_op.cc:276] Timestamp: P: 1783599103253215 usec, L: 0
0709 12:11:43.253401 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:11:43.253983 (+   582us) log.cc:844] Serialized 2829 byte log entry
0709 12:11:43.293794 (+ 39811us) op_driver.cc:464] REPLICATION: finished
0709 12:11:43.295029 (+  1235us) write_op.cc:301] APPLY: starting
0709 12:11:43.295106 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:43.299404 (+  4298us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:43.299519 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:43.303639 (+  4120us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:43.303880 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:11:43.303925 (+    45us) write_op.cc:312] APPLY: finished
0709 12:11:43.304247 (+   322us) log.cc:844] Serialized 73 byte log entry
0709 12:11:43.307380 (+  3133us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:43.307469 (+    89us) write_op.cc:454] Released schema lock
0709 12:11:43.307499 (+    30us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:43.309101 (+  1602us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:43.309126 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3583,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":1037,"apply.run_cpu_time_us":9416,"apply.run_wall_time_us":14034,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33373,"num_ops":7,"prepare.queue_time_us":69320,"prepare.run_cpu_time_us":4512,"prepare.run_wall_time_us":7625,"raft.queue_time_us":34962,"raft.run_cpu_time_us":1244,"raft.run_wall_time_us":1258,"replication_time_us":40263,"spinlock_wait_cycles":27392,"thread_start_us":73493,"threads_started":4,"wal-append.queue_time_us":1190,"wal-append.run_cpu_time_us":3412,"wal-append.run_wall_time_us":1052636}]]}
I20260709 12:11:45.123128  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.126487 10061 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.148542  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.125672  4876 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:45.079306  9947 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:45.149921  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.135902 10077 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.115414 10081 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.152024  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.109217 10071 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 16 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:45.114594 10096 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.117630 10057 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.134047  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:45.111203  4917 leader_election.cc:336] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.707s (SENT)
I20260709 12:11:45.120713  5567 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.143330  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.106091 10011 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.157742  4944 raft_consensus.cc:2368] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
W20260709 12:11:45.144918  5570 leader_election.cc:336] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.701s (SENT)
I20260709 12:11:45.158568  5570 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:45.145874  4947 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:45.155349  4945 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
W20260709 12:11:45.122856  4988 connection.cc:256] RPC call timeout handler was delayed by -1.2459585409999363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:11:45.100947  9887 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:45.124430 10100 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:45.150703  4868 raft_consensus.cc:2410] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:11:45.159534  4988 connection.cc:256] RPC call timeout handler was delayed by -1.241458540999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 12:11:45.154497  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.155755  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:45.160236  4949 raft_consensus.cc:2393] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:45.143810 10101 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:45.160495  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:45.162827  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:45.164017  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.161267  5568 leader_election.cc:304] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:45.192926  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 81754.2us
W20260709 12:11:45.193301  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 72662.3us
I20260709 12:11:45.193169  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.152395 10081 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.157615 10057 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.198323  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.199214 10152 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:45.150388 10061 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.155025 10096 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:45.201649  4917 leader_election.cc:336] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.721s (SENT)
W20260709 12:11:45.197781 10163 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:45.212184  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:45.212513  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 51320.7us
I20260709 12:11:45.203562  4948 raft_consensus.cc:2393] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:45.144505 10164 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:45.213779  5567 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.215232  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.215858  4873 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:45.183175 10160 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:45.217679  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.218319  4873 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:45.205250  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.208096  4872 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 21.
I20260709 12:11:45.209074  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:45.194103 10102 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.209794  9867 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:45.210793  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 129608us
I20260709 12:11:45.193943 10101 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.212793  4945 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.211876  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.153826 10054 raft_consensus.cc:697] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:45.213629  5568 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:45.229033  4917 leader_election.cc:336] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.932s (SENT)
I20260709 12:11:45.202265 10132 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.192920 10045 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:45.204562  4875 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.200410 10144 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:45.194362  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 233609us
I20260709 12:11:45.160917 10100 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.221349  4867 raft_consensus.cc:2393] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 10: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:45.221676 10162 raft_consensus.cc:3055] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:45.217626 10071 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:45.222043 10155 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:45.222275 10152 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:45.220702 10102 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.211871 10096 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:45.223183  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 85044.7us
I20260709 12:11:45.224233  9867 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:45.242583 10145 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.243310 10020 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:45.324429  4991 leader_election.cc:336] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.279s (SENT)
I20260709 12:11:45.157816 10062 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.246066  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.201830 10081 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.298367 10139 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.296931  4917 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:45.297031  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 83468.4us
I20260709 12:11:45.328830  5568 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:45.299535  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1107) took 2480 ms. Trace:
I20260709 12:11:45.301941  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.244553 10057 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.303360  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:45.303850  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 92172.3us
I20260709 12:11:45.228440  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.315936  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.333829 10166 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:45.334314 10166 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:45.334676 10166 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:45.334784  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.334978  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:45.335551  5601 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:45.324941  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.209052 10141 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:45.328660  5570 leader_election.cc:336] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.708s (SENT)
I20260709 12:11:45.300386 10161 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:45.325762  4874 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:45.218741 10164 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:45.330116  5568 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:45.329620  4873 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:45.298532 10132 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:45.335547  4867 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:45.350517 10132 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:45.333868  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 105501us
I20260709 12:11:45.352481  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:45.338687  4948 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:45.340039  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.356244  4988 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:45.343423  4875 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:45.302160 10162 raft_consensus.cc:740] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:45.359054  4839 connection.cc:256] RPC call timeout handler was delayed by -1.3824179310001909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 12:11:45.358819 10162 consensus_queue.cc:260] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:45.359431  4839 connection.cc:256] RPC call timeout handler was delayed by -1.0788835220000692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 12:11:45.315135 10102 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:45.359736  4839 connection.cc:256] RPC call timeout handler was delayed by -1.0280108930001006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
I20260709 12:11:45.346388  5567 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.364307 10132 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.366325 10132 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:45.366863 10132 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.302449 10171 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.315361  9947 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:45.367807  9947 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.368253  9947 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:45.329914  4870 rpcz_store.cc:276] 0709 12:11:42.818950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.819073 (+   123us) service_pool.cc:224] Handling call
0709 12:11:42.827249 (+  8176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.960212 (+132963us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:42.978446 (+ 18234us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.873704 (+1895258us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.928795 (+ 55091us) log.cc:844] Serialized 26 byte log entry
0709 12:11:45.079815 (+151020us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:45.079853 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.079917 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:45.245494 (+165577us) raft_consensus.cc:1685] finished
0709 12:11:45.245511 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:45.299478 (+ 53967us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1743124,"prepare.queue_time_us":12429,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":1757198,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":17877,"spinlock_wait_cycles":980736,"thread_start_us":404058,"threads_started":3,"wal-append.queue_time_us":452286,"wal-append.run_cpu_time_us":1241,"wal-append.run_wall_time_us":1027382}
I20260709 12:11:45.369944 10171 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:45.370396 10171 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:45.370796 10171 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.374992  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:45.375175  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:45.375584  5605 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:45.324936 10146 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.381568  5570 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:45.383879  4839 leader_election.cc:336] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Timed out: RequestConsensusVote RPC to 127.3.163.66:43473 timed out after 2.221s (SENT)
I20260709 12:11:45.384727  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:45.396471  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.386780  4948 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:45.315121 10067 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.388512  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.326711 10149 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:45.391006  4869 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:45.394455  4916 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.415388  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:45.416532  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.417356  4944 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:11:45.417850  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.331936  9898 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:45.407581  5567 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.415337  5017 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:45.397796  4946 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:45.417762  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:45.436393  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 45042.8us
W20260709 12:11:45.443509  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 214504us
W20260709 12:11:45.445181  4917 leader_election.cc:336] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.053s (SENT)
I20260709 12:11:45.445540  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.386600 10159 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:45.460894  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.466626  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.386754 10146 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.497634 10146 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:45.496030  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.494117  5567 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.388974 10045 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:45.501606  4948 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:45.505159 10146 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.397018 10132 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:45.499733  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 54213us
W20260709 12:11:45.512912  4917 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 2.159s (SENT)
I20260709 12:11:45.513381  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:45.518149  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 167541us
I20260709 12:11:45.519999  5568 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:45.437029 10174 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.491885 10145 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:45.541020  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.511559 10132 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.469677 10173 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:45.523414 10160 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:45.534266 10011 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.532768 10159 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.549770  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.550184 10159 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:45.550640  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.550944 10011 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:45.551278  4946 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.549917  9947 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:45.517783 10167 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.550567  4942 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 10: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:45.491798 10139 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:11:45.523726 10174 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.565143  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.596541  4947 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.566752  5603 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:45.567548  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.568136  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.598310  4872 raft_consensus.cc:2393] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:45.568745  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.569880  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.569262 10146 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:45.571389  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:45.573526  9947 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:45.573887  4840 connection.cc:256] RPC call timeout handler was delayed by -1.3396227769999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 12:11:45.592916  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 236729us
I20260709 12:11:45.607509  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:45.593804  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 226992us
I20260709 12:11:45.443300 10054 consensus_queue.cc:237] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.550621 10159 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:45.552886 10156 consensus_meta.cc:287] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.613s	user 0.006s	sys 0.004s
I20260709 12:11:45.467514  9867 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.597682  4871 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:45.604044  4869 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:45.541360 10020 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:11:45.613286  4841 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.651558  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:45.595654  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:45.607156  4840 connection.cc:256] RPC call timeout handler was delayed by -1.3189227769998979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 12:11:45.653401  4840 connection.cc:256] RPC call timeout handler was delayed by -1.2595227769998019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 12:11:45.653712  4840 connection.cc:256] RPC call timeout handler was delayed by -1.2289227769997524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 12:11:45.653982  4840 connection.cc:256] RPC call timeout handler was delayed by -1.203722776999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 12:11:45.655077  5603 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:45.607438  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 94549.3us
I20260709 12:11:45.549549 10160 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:45.682852  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 376970us
I20260709 12:11:45.553984 10173 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:45.598769  4870 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 20.
I20260709 12:11:45.533493 10189 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:45.680174  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:45.553313 10161 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.685802  4947 raft_consensus.cc:2468] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:45.657801  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:45.552762 10067 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:45.606804 10076 consensus_meta.cc:287] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.736s	user 0.006s	sys 0.003s
W20260709 12:11:45.606444 10055 consensus_meta.cc:287] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 12:11:45.704598  4840 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:45.704063  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 90853.9us
I20260709 12:11:45.603606 10174 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.707530  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:45.694116  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 86699.8us
I20260709 12:11:45.522532 10152 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.561422 10168 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 12:11:45.687589 10160 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.711803  4942 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:45.711120  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 327244us
I20260709 12:11:45.715517  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:45.692559  4946 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:45.721840  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.726094  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:45.694774 10182 raft_consensus.cc:2804] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:45.645336  9947 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.687767 10188 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.749876 10180 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:45.710912 10055 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.752136 10202 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.752530  4948 raft_consensus.cc:2393] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 8: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:45.711449 10178 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:11:45.689136 10173 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.711810 10149 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:45.700311 10145 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.728760 10175 raft_consensus.cc:3055] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.717170 10193 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.707656 10067 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.608965 10164 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.711057 10011 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:11:45.765259 10067 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.707141 10076 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.608736 10167 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:45.766719 10193 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.651889  9898 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.768780  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:45.767745  5016 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:45.728156  4947 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.737581  4840 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:45.772421  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.726825  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:45.732434  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.735944 10172 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:45.714592 10189 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:45.683071 10156 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.730230  9867 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.767130 10175 raft_consensus.cc:740] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:45.731491 10197 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:45.741987  5606 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:45.743125 10057 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.776201  4946 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:11:45.780404  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:45.784904 10075 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:45.763590  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:45.742092 10181 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:45.752206 10055 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.820923  5018 raft_consensus.cc:2368] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
W20260709 12:11:45.819283  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 299327us
I20260709 12:11:45.752565 10202 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:45.762082 10182 raft_consensus.cc:697] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:45.812438  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:45.761842 10180 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:45.813961  5598 raft_consensus.cc:2393] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 8: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:45.767416 10076 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.790161  5567 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.777657 10193 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.817417 10162 raft_consensus.cc:3060] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:45.823813  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 97030.1us
I20260709 12:11:45.805651 10197 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.819711 10075 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:45.848891  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 325923us
I20260709 12:11:45.803514 10011 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:11:45.849493  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 59407.2us
I20260709 12:11:45.861409  5567 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.861346  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.817790 10184 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:45.827230 10202 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.832834 10180 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:45.826031 10168 raft_consensus.cc:2764] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:11:45.827452 10143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.005s	sys 0.006s
I20260709 12:11:45.862130  4946 raft_consensus.cc:2376] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12. Re-sending same reply.
I20260709 12:11:45.846834 10057 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:45.906414 10057 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:45.906792 10057 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.907099  9809 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.908774  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:45.909296 10182 consensus_queue.cc:237] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.909345  4950 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:45.913166 10204 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:45.915050 10204 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.915377 10204 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:45.916141 10204 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:45.862505  4988 leader_election.cc:400] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
I20260709 12:11:45.866834  9947 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.868048 10201 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:45.870669  4947 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 16.
I20260709 12:11:45.871611  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:45.929883  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 58338.5us
I20260709 12:11:45.858379 10197 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.858074 10188 raft_consensus.cc:2804] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:45.861004 10075 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:45.902456  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 1287) took 1007 ms. Trace:
I20260709 12:11:45.933252  5016 rpcz_store.cc:276] 0709 12:11:44.894907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.929872 (+ 34965us) service_pool.cc:224] Handling call
0709 12:11:45.902275 (+972403us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400064854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:45.902401 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914838912}
W20260709 12:11:45.878970 10061 consensus_meta.cc:287] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.005s
I20260709 12:11:45.903782  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:45.935070  5601 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
W20260709 12:11:45.879405 10143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.005s	sys 0.006s
I20260709 12:11:45.901265 10199 consensus_queue.cc:1059] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:11:45.937434 10061 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.938194 10199 raft_consensus.cc:3055] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:45.938530 10199 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:45.939097 10077 consensus_meta.cc:287] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.784s	user 0.007s	sys 0.001s
I20260709 12:11:45.939225 10199 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:45.939523 10061 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.941097  4868 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:45.941735 10156 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.848253  4839 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:45.877148 10076 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:11:45.918668  4988 leader_election.cc:403] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:45.946732  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 98556.5us
I20260709 12:11:45.947605  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:45.933856 10100 consensus_meta.cc:287] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.007s
I20260709 12:11:45.878836 10180 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.923656  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.951586  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:11:45.919752  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 147392us
I20260709 12:11:45.930581  4991 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:45.927045  4945 consensus_meta.cc:287] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.004s
I20260709 12:11:45.939642  4951 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:45.949684 10188 raft_consensus.cc:697] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:45.939592 10096 consensus_meta.cc:287] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.616s	user 0.005s	sys 0.000s
W20260709 12:11:45.952183  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 97068us
W20260709 12:11:45.949247 10150 consensus_meta.cc:287] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.821s	user 0.005s	sys 0.004s
I20260709 12:11:45.953123  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 1296) took 1018 ms. Trace:
I20260709 12:11:45.954643  5606 raft_consensus.cc:1240] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:45.955411 10203 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:45.933079 10168 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:45.946907 10201 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:45.898439 10189 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.957613 10183 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10.
W20260709 12:11:45.960487 10081 consensus_meta.cc:287] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.004s
I20260709 12:11:45.960100 10160 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.001499 10185 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.001335 10188 consensus_queue.cc:237] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.002068 10185 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:46.002767 10160 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:45.954247 10061 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:46.002942 10185 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:45.961732  4944 raft_consensus.cc:2376] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14. Re-sending same reply.
I20260709 12:11:45.972676 10096 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.006628 10096 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:45.964201  4945 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
W20260709 12:11:45.946400 10102 consensus_meta.cc:287] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.000s
W20260709 12:11:46.008003  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.967967  5018 rpcz_store.cc:276] 0709 12:11:44.934655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.947238 (+ 12583us) service_pool.cc:224] Handling call
0709 12:11:45.952971 (+1005733us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54003ded54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:45.953075 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960924544}
I20260709 12:11:45.971704  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:45.969193  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:45.947198 10076 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.973321  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:11:45.954128 10171 consensus_meta.cc:287] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.000s
I20260709 12:11:45.965847  4839 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:45.961625 10204 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:45.980792  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.982081  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.983335 10167 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:45.984915  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.989627  4841 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:45.989944 10184 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:45.990559 10011 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:45.992116  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:45.998517  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 1278) took 1108 ms. Trace:
I20260709 12:11:46.027558  5020 rpcz_store.cc:276] 0709 12:11:44.889685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.893964 (+  4279us) service_pool.cc:224] Handling call
0709 12:11:45.998356 (+1104392us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54001603d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:45.998463 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270092672}
I20260709 12:11:45.989563  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.999155  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:45.963662 10100 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.937525 10174 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:45.955880 10197 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.004947  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.043932  4944 raft_consensus.cc:2376] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 7. Re-sending same reply.
W20260709 12:11:45.922610  5017 consensus_meta.cc:287] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.000s
W20260709 12:11:45.977588  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 293267us
I20260709 12:11:46.009419  5601 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.010470  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:46.013770  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 48010us
I20260709 12:11:45.972854 10168 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:46.022912  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:46.023185  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54082us
I20260709 12:11:46.047639  4840 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:46.024542  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 51295.5us
W20260709 12:11:46.024047 10166 consensus_meta.cc:287] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.000s
I20260709 12:11:46.028717  4947 raft_consensus.cc:2376] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14. Re-sending same reply.
I20260709 12:11:46.014561 10076 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:11:46.045372  5570 leader_election.cc:336] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Timed out: RequestConsensusVote RPC to 127.3.163.65:38799 timed out after 1.847s (SENT)
I20260709 12:11:45.973779 10150 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.049997  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.050196  5017 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:46.051783  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.025043 10141 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:46.052886 10168 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.055763  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.056074 10167 consensus_queue.cc:1059] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:46.026459 10061 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.057776 10061 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.058152 10061 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.059336  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.053370  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.060972 10139 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:46.063642  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.063902 10201 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.058082 10100 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.066172 10100 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:46.066792 10100 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.068159  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.069480  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:46.026207 10195 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.077941  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.078922  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.029769  9947 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.083137  4947 raft_consensus.cc:1240] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:46.084877  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.081215  4942 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:46.090948  5602 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 16: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:46.067155 10100 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:46.093338  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.095465  5601 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:46.020364 10171 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.097421  4945 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:46.019620 10081 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.080775 10195 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.099560 10165 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.101827 10197 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.101984 10061 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.013556 10102 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.103904 10205 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:46.105309  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.097489  4946 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:46.095245 10060 consensus_meta.cc:287] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.000s
I20260709 12:11:46.106603  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.098830  5570 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:46.113039 10208 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 12:11:46.114524  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.125671 10061 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:46.131731 10132 consensus_meta.cc:287] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.000s
I20260709 12:11:46.132123 10132 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.133801  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1508) took 1168 ms. Trace:
I20260709 12:11:46.134039 10150 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:46.135053  5597 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:46.117070  5025 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:46.119145 10173 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.120059  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.142941  5018 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:46.120641  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.120465 10139 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:46.120009 10102 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.113757 10195 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.094945 10100 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.135337  5602 rpcz_store.cc:276] 0709 12:11:44.965553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.965656 (+   103us) service_pool.cc:224] Handling call
0709 12:11:46.133621 (+1167965us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540050bc54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:46.133749 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2586085760}
I20260709 12:11:46.093616  4840 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:46.141973  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.143216  4949 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:46.121182  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.071050 10166 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.158314  5568 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.159988  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.160730  5018 raft_consensus.cc:2393] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.151183  5600 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:46.115633 10165 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:46.122764 10101 consensus_meta.cc:287] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.827s	user 0.009s	sys 0.000s
I20260709 12:11:46.152457  4948 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.135586 10060 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.157037  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.123157 10143 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.165444  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.164155  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.159466  5568 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:46.151711  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 124792us
I20260709 12:11:46.187230  4915 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.187891  5568 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.190335  5568 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.171658  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.171895  5605 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:46.171797  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 78250.1us
I20260709 12:11:46.191470  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.173513  4942 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.177794 10075 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.174304  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.194121  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.146215 10174 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.200932  5020 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:46.202242  5568 leader_election.cc:400] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:46.202567  5568 leader_election.cc:403] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.197916  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.205107  5018 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.207841  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.208629  4867 raft_consensus.cc:2393] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:46.210219  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.211640  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.212359  4915 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.213061  9933 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:46.214278  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.214740  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.215256  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.215585  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.215934  4867 raft_consensus.cc:2368] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11.
I20260709 12:11:46.216274  4874 raft_consensus.cc:2393] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.216790  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.217135  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.217433  4870 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.218256 10176 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:46.217948  4867 raft_consensus.cc:2368] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16.
I20260709 12:11:46.185848 10101 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.220562  4875 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.221434 10101 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.201442 10055 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:46.223304  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.224363  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.224895  5025 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:46.225075  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.225718  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.226146  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.226686  5019 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:46.227509  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.231859  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.232582  4869 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.234144  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.082404 10175 consensus_queue.cc:260] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.173007 10165 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.246798  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.247188  5022 raft_consensus.cc:2393] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.248174  4915 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.238673  4942 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:46.239452  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.248999  4871 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.143487 10180 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.240012 10223 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.240639 10206 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.242820  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54512 (request call id 1295) took 1346 ms. Trace:
I20260709 12:11:46.252786  5024 rpcz_store.cc:276] 0709 12:11:44.918235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.930032 (+ 11797us) service_pool.cc:224] Handling call
0709 12:11:46.242643 (+1312611us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001991d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:46.242770 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543372032}
I20260709 12:11:46.243443  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.253798  4869 raft_consensus.cc:2368] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16.
I20260709 12:11:46.243854  5025 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:46.233357  9947 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:46.245325  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.258641  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.259958  4915 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:46.256430  4948 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:46.262061  4942 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:46.201076 10161 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:46.201241 10139 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:46.237754 10159 consensus_meta.cc:287] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.000s
I20260709 12:11:46.265132  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.265921  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.200078  9809 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.205435 10205 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.202145 10182 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.270838  5568 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.271224  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.244352 10202 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.272182  4873 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.272490  4874 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.304433 10168 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.306541 10168 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:46.264611 10174 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:46.273242  4872 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.273329  4869 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.275626  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.308331  4868 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:46.233481  9867 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:46.277616 10166 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.278420 10180 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:46.279341 10222 log.cc:927] Time spent T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:46.269043  9947 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:46.267792 10175 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.327549 10221 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:46.276530 10159 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.327934 10221 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:46.268138 10223 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:46.328680 10221 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.329833 10221 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.329466 10223 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.330641  4869 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:46.267675 10060 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.282894 10057 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.284106 10081 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.284413 10076 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:46.285049  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.285859  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:46.287600 10201 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.288414 10165 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.290814  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:46.292384 10173 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.295487  4871 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:46.297628  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.299489 10193 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.281778 10075 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.303072  4915 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:46.309294  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.313247  4870 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
W20260709 12:11:46.316079  4951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52392 (request call id 3524) took 1186 ms (client timeout 1559 ms). Trace:
I20260709 12:11:46.319023  4876 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:46.321774  4917 leader_election.cc:400] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16.
I20260709 12:11:46.322649  5604 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.276140 10182 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:46.312557  9809 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.333221 10060 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.329409  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.346505  4868 raft_consensus.cc:2368] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
W20260709 12:11:46.331054  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.347535  5570 leader_election.cc:400] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 12. Current term is 13.
I20260709 12:11:46.331885  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.332135  4872 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:46.349117  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.334551  5024 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:11:46.334885  5602 raft_consensus.cc:2368] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:11:46.338697  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:46.341027  4951 rpcz_store.cc:269] 0709 12:11:45.126205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.126326 (+   121us) service_pool.cc:224] Handling call
0709 12:11:46.312626 (+1186300us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400209ed4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:46.312696 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817454464}
I20260709 12:11:46.342164  5023 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.342183  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.344139  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.282095  5016 raft_consensus.cc:2468] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:46.349048  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.364986  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.363761  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.367306  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.367688  4988 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:46.368746  4917 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.368956  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:46.345008 10182 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.342610 10166 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:46.371491  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.363391  5598 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:46.346508 10081 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.372334  4917 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.373824  4990 leader_election.cc:400] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:11:46.375419  4990 leader_election.cc:403] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.350324 10060 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.374544  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.376555  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.372687 10209 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.378054  5024 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:46.380988  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.381134  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.348076  9947 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.380645  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:46.382380  4868 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.374418 10184 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.382292  5604 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.364537 10075 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:46.385154  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.385365  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.379402  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.372135  9898 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:46.395357 10057 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.381690 10077 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:46.396271 10077 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:46.397140 10077 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.373438  9809 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.372785 10162 raft_consensus.cc:2764] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:46.405191 10204 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.383122 10081 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:46.401257 10166 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:46.407462  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.370561 10054 consensus_queue.cc:1059] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:11:46.409550 10054 raft_consensus.cc:3055] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.409868  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.410477 10159 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:46.411015 10159 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.409870 10054 raft_consensus.cc:740] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:46.412093 10202 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.412469 10054 consensus_queue.cc:260] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.413614 10054 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.414826 10195 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.417675 10193 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.418700  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.419293  5020 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:46.420078  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.408550  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.422374  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.423357  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.417696  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.425110  4874 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.382790 10183 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.421669  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.382196 10209 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:46.385638 10173 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:46.380574 10055 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.436128  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.475469  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.475600  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.484846  4948 raft_consensus.cc:2368] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:11:46.479956  5603 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:46.495222 10076 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:46.391299  9898 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:46.505578  5602 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:46.496313  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.505708  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.506795  5570 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.509622  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:46.476428 10230 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 12:11:46.530277  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:46.545581  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.477164 10209 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.569597  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.406451 10081 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.581248  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:46.617894  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.584695  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.587728 10100 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.472448 10183 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:46.508962  9898 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:46.427397 10195 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.509223 10201 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.472672  9809 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:46.495340 10205 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.576627  4873 raft_consensus.cc:2468] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:46.581763 10175 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:46.624832 10183 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.630970 10178 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:46.620332  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 198021us
I20260709 12:11:46.623389  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.391402 10184 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.626258  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.652169  4950 raft_consensus.cc:3060] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.629925  5024 raft_consensus.cc:2468] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
W20260709 12:11:46.633689  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.652180  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.651595  4868 raft_consensus.cc:2376] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15. Re-sending same reply.
I20260709 12:11:46.618655  5022 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:46.653626  5568 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:46.649065  5605 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:46.656339  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.657590  4948 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:11:46.663755  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.646723 10174 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:46.664674  5022 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 21: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.665293  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.667593  5024 raft_consensus.cc:2368] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:46.667938  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.668531  4948 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:46.674579  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.675005 10184 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.675350 10076 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.675725  4991 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.677069 10075 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.659344 10166 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:11:46.683918  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.684505  5024 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.660548 10173 raft_consensus.cc:2804] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:46.663599 10168 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.688928  4950 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:46.665671 10162 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:46.715046  4950 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:11:46.732510  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 58551us
I20260709 12:11:46.732652  4950 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:46.688309 10168 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:46.681839 10174 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.692947 10162 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:46.693601 10173 raft_consensus.cc:697] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:46.741114  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.685998 10060 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.735922 10168 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:46.748026  4915 leader_election.cc:336] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.625s (SENT)
I20260709 12:11:46.748385  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.740058 10162 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.752336  4948 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 21.
I20260709 12:11:46.737871  5024 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:46.755980  4840 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:46.692600  9809 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.763262  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.757855  9947 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.760998 10077 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.767534  5604 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
W20260709 12:11:46.765522 10235 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:46.763892 10100 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.782562 10183 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.783691 10055 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.783710  5020 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.785300 10183 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.799650  4874 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:46.793107  9947 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:46.794404 10144 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.806309 10165 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.810189 10174 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.812264  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.816250  4870 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:46.811522 10144 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.819693 10182 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.820411 10144 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.823352  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.771638 10173 consensus_queue.cc:237] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.824782  5016 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.827520  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.827491  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.828085  5016 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:46.828779  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.831138  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.831632  4874 raft_consensus.cc:2393] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:46.835412  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.834314 10209 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.839965 10182 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.840687  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.841468  4874 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.842133  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.842378 10209 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:46.844740  4874 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:11:46.845502  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.830660  9947 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.845989  4874 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:11:46.848510 10060 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.852170  4874 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 21.
I20260709 12:11:46.852438  4841 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:46.852967  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.853614  4874 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 16: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:11:46.858839  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.862258  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.862452  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.863202  4874 raft_consensus.cc:2368] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:46.863895  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.864145  4871 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 16: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.864539  4874 raft_consensus.cc:2393] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.865052  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.865298  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.865969  4874 raft_consensus.cc:2393] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.866153  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.866649  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.867302  4874 raft_consensus.cc:2368] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:46.868120  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.868607  4874 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 21.
I20260709 12:11:46.869331  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.869910  4874 raft_consensus.cc:2368] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:11:46.867239  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.870514  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.871161  4871 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 21: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.872493  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1515) took 1500 ms. Trace:
I20260709 12:11:46.871609 10224 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.874107 10224 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:46.874943 10224 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.875440  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52376 (request call id 3013) took 1096 ms. Trace:
I20260709 12:11:46.876116 10132 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.872751  5597 rpcz_store.cc:276] 0709 12:11:45.371959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.373573 (+  1614us) service_pool.cc:224] Handling call
0709 12:11:45.373899 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.135771 (+761872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.872348 (+736577us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54006a0c54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:46.872452 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750065920}
I20260709 12:11:46.875806  4949 rpcz_store.cc:276] 0709 12:11:45.779272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.984637 (+205365us) service_pool.cc:224] Handling call
0709 12:11:46.875289 (+890652us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540007a154. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:46.875390 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280965888}
I20260709 12:11:46.878425  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.879396  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.880285  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.882164  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.883373  4876 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:46.885466  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.886540  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.887487  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.887944  5025 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.876754  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.889643  4872 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
W20260709 12:11:46.890058  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 782050us
I20260709 12:11:46.875463  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:46.892314  4869 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:46.893888  4870 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:46.895181  4870 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.891973  4839 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:46.888309 10168 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:46.903115  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.904913  4839 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:46.905715  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:46.909279 10223 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:46.910868  9898 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:46.912925 10178 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.913664  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.914331  5023 raft_consensus.cc:2393] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.914430 10168 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:46.915086  5025 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:46.920923  4873 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:46.924611  5024 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:46.926628  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.927424  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.930549  4874 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:46.943049  5016 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:46.944162  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.944872  5016 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:46.947052  4873 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:46.924916  9898 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.949697  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.950809  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.951421  4950 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:46.954437  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:46.954984  4950 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:46.955691  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.956966  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.961341  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:46.962594  5016 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.962898  5568 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:46.963161  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.963657  5016 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:46.967357  4915 leader_election.cc:400] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:46.967692  4915 leader_election.cc:403] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.968842  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:46.969734  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.972604  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.974601  5570 leader_election.cc:400] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15.
I20260709 12:11:46.940958 10223 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:46.976562  5570 leader_election.cc:400] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:46.980935  4945 raft_consensus.cc:1240] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:46.984630  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.985631  4916 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:46.937187 10221 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:46.992472 10178 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:46.993290 10161 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:46.993745  4917 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:46.994314  5602 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:46.994997 10182 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.995486 10182 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.996330  5603 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:46.997512 10182 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:46.997891  4988 leader_election.cc:400] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 7 election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 7. Current term is 8.
I20260709 12:11:46.998646 10164 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.999073 10209 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:46.999477  5598 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:46.999907  4951 raft_consensus.cc:1240] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.000376  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:46.976764  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:46.986289  4947 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:47.001080  5023 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 17.
I20260709 12:11:47.000919 10209 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:11:46.989508  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:47.002169  5023 raft_consensus.cc:1240] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:47.002274  5604 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.002997  4875 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.003969  5020 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.004174  4875 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:46.989840 10223 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:46.991513  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:47.008769  4943 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.976898  5570 leader_election.cc:403] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:46.992049  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:46.999317 10164 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.005049  4874 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:47.005999  5019 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:11:47.006421  5601 raft_consensus.cc:2393] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:46.978353  4991 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:47.018350  4991 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:47.007592  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:47.007814  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1525) took 1250 ms. Trace:
I20260709 12:11:47.019150  5600 rpcz_store.cc:276] 0709 12:11:45.757062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.757176 (+   114us) service_pool.cc:224] Handling call
0709 12:11:47.007638 (+1250462us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400a9b854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:47.007758 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761173376}
I20260709 12:11:47.009939  4949 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:47.010070  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:47.010456  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:47.006201  4988 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.019624  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.013252  5016 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:47.012708  5604 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:46.977371  4841 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.021802  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:47.022138  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 44862.3us
I20260709 12:11:47.008246  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:47.011371  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:47.024183  5603 raft_consensus.cc:2393] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:47.024713  4946 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:47.025350  5570 leader_election.cc:400] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:11:47.026916  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:47.028705  5604 raft_consensus.cc:1275] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:46.993981 10161 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:47.029126  5019 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:47.037186  5570 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:47.041319  5604 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:11:47.041566  9898 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:11:47.042076 10141 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:47.041352 10171 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:47.043718 10176 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:47.044600 10171 raft_consensus.cc:2804] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:47.037992  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:47.045439  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:47.046200  4949 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:47.041607  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.048601  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:46.995265 10199 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.055013  4943 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:47.055806  4947 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:47.057695  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:46.999336 10182 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:47.059536  5019 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 12:11:47.064508  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 58378.8us
I20260709 12:11:47.066190  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:47.066869  5603 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.007709 10221 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:47.015290 10168 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.067867  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:47.069574  5601 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:47.023857 10132 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11.
I20260709 12:11:47.071362  4946 raft_consensus.cc:2393] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:47.072132  4943 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:47.044708 10176 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:47.030364 10071 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:11:47.038738 10077 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:47.064042  9867 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.097025  4951 raft_consensus.cc:1275] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:11:46.986371 10076 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:11:47.040102 10183 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:47.128959  4915 leader_election.cc:336] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Timed out: RequestConsensusVote RPC to 127.3.163.67:40575 timed out after 1.912s (SENT)
I20260709 12:11:47.070152 10186 raft_consensus.cc:2804] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:47.069772 10020 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:47.046554 10207 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:11:47.040395 10161 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:47.104686  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:47.046720 10165 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.107329  4839 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:47.024029  9947 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:11:47.064746 10171 raft_consensus.cc:697] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:47.064232 10081 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.111817  4949 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:47.079553  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:47.121282  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:47.121454  4944 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:11:47.126492  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 52145.3us
W20260709 12:11:47.127526  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 102208us
I20260709 12:11:47.127929  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:47.155937  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 48705.2us
I20260709 12:11:47.073623 10180 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.164162 10180 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.164575 10180 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.167238  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:47.168392  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:47.135308  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:47.169209  5604 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:47.135839  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:47.170009 10144 consensus_queue.cc:1059] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.170877 10144 raft_consensus.cc:3055] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:47.171178 10144 raft_consensus.cc:740] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:47.172087  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.171984 10144 consensus_queue.cc:260] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.130770 10175 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.122865 10071 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 21 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:47.139585  4990 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.101738 10176 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:47.140566  5567 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:47.190413  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 49922.7us
I20260709 12:11:47.064513  9809 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 12:11:47.067015  9898 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:11:47.103590 10182 raft_consensus.cc:697] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:47.155301  4943 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:47.160166  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:47.074353 10141 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
W20260709 12:11:47.137871  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.175462  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.157507  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:47.175588  5025 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.102770 10054 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:47.108367 10195 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:11:47.039264  5017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:47.230327  5017 raft_consensus.cc:606] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.130012 10077 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:47.136977 10207 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:47.139215 10193 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.140419 10161 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:47.207456  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:47.149673 10186 raft_consensus.cc:697] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:47.131716 10162 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:47.202023  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 153488us
I20260709 12:11:47.175400 10020 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:47.232753  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 57361.9us
W20260709 12:11:47.232086  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 92557.9us
I20260709 12:11:47.250006  4873 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:47.149326 10121 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 12:11:47.249631  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 76383.3us
I20260709 12:11:47.250823  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1304) took 1076 ms. Trace:
W20260709 12:11:47.251983  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 49139.2us
W20260709 12:11:47.295977  4901 heartbeater.cc:646] Failed to heartbeat to 127.3.163.126:34023 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.163.126:34023 timed out after 15.000s (SENT)
I20260709 12:11:47.205591 10224 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:47.299067 10168 consensus_queue.cc:1048] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:47.300402 10251 log.cc:927] Time spent T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
W20260709 12:11:47.301479 10257 log.cc:927] Time spent T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:11:47.302588  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1153) took 1005 ms. Trace:
I20260709 12:11:47.294706  5020 rpcz_store.cc:276] 0709 12:11:46.174004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.005414 (+831410us) service_pool.cc:224] Handling call
0709 12:11:47.005652 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.005818 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:47.119719 (+113901us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.250483 (+130764us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.250539 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:47.250591 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.250657 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.250766 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53783,"prepare.queue_time_us":237967,"raft.queue_time_us":55207,"raft.run_wall_time_us":6381,"spinlock_wait_cycles":78149760,"thread_start_us":151376,"threads_started":2,"wal-append.queue_time_us":118459}
I20260709 12:11:47.303889  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:47.305958 10162 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:47.306517 10162 raft_consensus.cc:993] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: : Instructing follower ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:11:47.296288 10121 consensus_queue.cc:1059] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:11:47.300494 10168 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:11:47.306905 10162 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:47.173362 10171 consensus_queue.cc:237] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.308153 10168 raft_consensus.cc:1081] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Signalling peer ab9da67236874634be59ebfd05b18255 to start an election
I20260709 12:11:47.309321 10071 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:47.308774  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:47.311122  5020 raft_consensus.cc:2393] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:47.311893  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:47.254884 10142 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:47.178722 10060 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:11:47.238870 10144 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.259843  5025 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:47.253378 10262 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.241554 10207 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:11:47.251562 10193 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.290839  4868 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.292438  5021 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:47.189076 10205 consensus_queue.cc:1059] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:11:47.256249  4840 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:47.316525  5020 raft_consensus.cc:2368] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:11:47.302927  4871 rpcz_store.cc:276] 0709 12:11:46.296997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.892160 (+595163us) service_pool.cc:224] Handling call
0709 12:11:46.905558 (+ 13398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.930948 (+ 25390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.930975 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.941734 (+ 10759us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.035980 (+ 94246us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:47.036018 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.036085 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.302402 (+266317us) raft_consensus.cc:1685] finished
0709 12:11:47.302420 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.302535 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25060,"raft.queue_time_us":31143,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":11520,"thread_start_us":21345,"threads_started":1,"wal-append.queue_time_us":97510}
W20260709 12:11:47.296228 10249 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:11:47.322547  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:47.323486  5568 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:47.442013  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:47.231567 10239 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:11:47.437839  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1152) took 1141 ms. Trace:
W20260709 12:11:47.438026  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 140249us
I20260709 12:11:47.443609  5025 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:47.444921  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:47.450133  5017 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.459798  5025 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:47.460008  5017 raft_consensus.cc:3055] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:47.460389  5017 raft_consensus.cc:740] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:47.451607  5020 raft_consensus.cc:1275] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:47.460753  5025 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:47.461751  5025 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.461213  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1308) took 1059 ms. Trace:
I20260709 12:11:47.469285  5020 rpcz_store.cc:276] 0709 12:11:46.401374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.451073 (+1049699us) service_pool.cc:224] Handling call
0709 12:11:47.451332 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.461006 (+  9674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.461165 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:47.452263  4872 rpcz_store.cc:276] 0709 12:11:46.296766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.890164 (+593398us) service_pool.cc:224] Handling call
0709 12:11:46.890419 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:46.890590 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:46.890831 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.437512 (+546681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:47.437566 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:47.437608 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.437676 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.437783 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25965,"prepare.queue_time_us":790,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":48237,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":31220,"thread_start_us":520343,"threads_started":2,"wal-append.queue_time_us":147235}
I20260709 12:11:47.287683 10265 consensus_queue.cc:1059] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.188s
I20260709 12:11:47.410073  9809 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.485196  4990 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.461153  5017 consensus_queue.cc:260] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.490903  5017 raft_consensus.cc:3060] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.483973 10141 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 12:11:47.501804 10253 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:11:47.503088  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3628) took 1180 ms. Trace:
I20260709 12:11:47.503432  4869 rpcz_store.cc:276] 0709 12:11:46.322314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.893305 (+570991us) service_pool.cc:224] Handling call
0709 12:11:46.893600 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.904267 (+ 10667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.904296 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.925229 (+ 20933us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.121053 (+195824us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:47.121102 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.121162 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.502881 (+381719us) raft_consensus.cc:1685] finished
0709 12:11:47.502902 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.503022 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32525,"raft.queue_time_us":10771,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":3261,"thread_start_us":155961,"threads_started":1,"wal-append.queue_time_us":268585}
W20260709 12:11:47.509316 10263 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:11:47.509473  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1301) took 1336 ms. Trace:
I20260709 12:11:47.509853  5021 rpcz_store.cc:276] 0709 12:11:46.173240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.002249 (+829009us) service_pool.cc:224] Handling call
0709 12:11:47.002511 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.438788 (+436277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.509245 (+ 70457us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400342e54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:47.509419 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666322176}
I20260709 12:11:47.494489 10142 raft_consensus.cc:3055] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:47.513531 10142 raft_consensus.cc:740] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:47.514338 10142 consensus_queue.cc:260] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.515832 10265 raft_consensus.cc:3055] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:47.516220 10265 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:47.517035 10265 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:47.208627 10221 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.519280 10184 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:47.520177 10184 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:47.520491 10184 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:47.516975  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1302) took 1343 ms. Trace:
I20260709 12:11:47.523293  5603 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:47.536221  5017 raft_consensus.cc:1275] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:11:47.538671  5017 pending_rounds.cc:85] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 11
I20260709 12:11:47.539323  5017 pending_rounds.cc:107] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:11:47.539875  5017 raft_consensus.cc:2889] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:47.294880 10077 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:47.544520  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 387035us
I20260709 12:11:47.411000 10055 consensus_queue.cc:1059] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 12:11:47.545948  4876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1150) took 1249 ms. Trace:
I20260709 12:11:47.523130  5023 rpcz_store.cc:276] 0709 12:11:46.173559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.002839 (+829280us) service_pool.cc:224] Handling call
0709 12:11:47.003114 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.003395 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.003421 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.003833 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.516419 (+512586us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b1800478180. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a5a4924bc 00007f2a577e048b 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a0d1
0709 12:11:47.516568 (+   149us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:47.516605 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.516669 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.516709 (+    40us) raft_consensus.cc:1685] finished
0709 12:11:47.516719 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.516919 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3916,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":13009,"spinlock_wait_cycles":16462592,"thread_start_us":29148,"threads_started":1,"wal-append.queue_time_us":104935}
W20260709 12:11:47.552137  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 107319us
I20260709 12:11:47.516996 10076 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.546294  4876 rpcz_store.cc:276] 0709 12:11:46.296332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.883947 (+587615us) service_pool.cc:224] Handling call
0709 12:11:46.884199 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.884531 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.884558 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.904653 (+ 20095us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.057266 (+152613us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:47.253162 (+195896us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.545637 (+292475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.545717 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.545759 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:47.545773 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.545883 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293565,"prepare.queue_time_us":55263,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":24,"raft.queue_time_us":16368,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":751,"thread_start_us":306246,"threads_started":2,"wal-append.queue_time_us":280349}
I20260709 12:11:47.564258  5603 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:47.564993  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 308799us
I20260709 12:11:47.565881  4840 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:47.547267 10175 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:47.441717 10182 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.553527 10276 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.574429  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:47.521438 10275 consensus_queue.cc:1059] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 12:11:47.581166  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 257737us
I20260709 12:11:47.570843  5606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:37900
I20260709 12:11:47.585260  5606 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:47.585654  5606 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:47.492988 10186 consensus_queue.cc:237] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.565673 10281 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.574267 10060 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:11:47.593524  5016 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:47.574502 10273 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:11:47.635399  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 444359us
W20260709 12:11:47.622835  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 48111.9us
I20260709 12:11:47.636245  5567 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:47.636368  4915 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:47.578663 10280 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:47.644410  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 56241.4us
W20260709 12:11:47.644878  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.645514  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:47.646567  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:47.647383  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.575675 10164 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:47.650616  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:47.643741  5606 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.646071  4876 raft_consensus.cc:2376] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15. Re-sending same reply.
I20260709 12:11:47.673432  4876 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:47.673854  4867 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:47.673306  4871 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.674660  5606 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:47.569573 10184 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.676743  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:47.677333  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:47.641739 10202 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.681332  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:47.682677 10054 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:47.663686 10075 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.640314 10175 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:47.673848  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:47.661545 10262 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:47.580170 10276 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:47.691951  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.694149  4841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.68:44297 timed out after 1.501s (SENT) [suppressed 89 similar messages]
I20260709 12:11:47.674042 10280 raft_consensus.cc:697] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:11:47.697503  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 61347.8us
I20260709 12:11:47.698500  4871 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:47.699753  4875 raft_consensus.cc:1240] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:47.683310 10281 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.679319 10081 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:47.686113 10193 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:47.687543 10278 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.697651 10184 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:47.799584  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.801148  4947 raft_consensus.cc:1240] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.810272  5568 leader_election.cc:400] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:11:47.810654  5568 leader_election.cc:403] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:47.814499  4873 raft_consensus.cc:1240] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.700430 10164 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:47.815974  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 117656us
I20260709 12:11:47.817410  5567 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:47.824693  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 2716) took 1510 ms. Trace:
I20260709 12:11:47.825074  5024 rpcz_store.cc:276] 0709 12:11:46.314763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.757579 (+442816us) service_pool.cc:224] Handling call
0709 12:11:47.824539 (+1066960us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001608d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:47.824637 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347722112}
I20260709 12:11:47.796293 10081 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.834295 10081 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:47.836135  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.840356  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 146190us
I20260709 12:11:47.697805 10060 consensus_queue.cc:1059] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 12:11:47.853799  5023 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:47.866035  5017 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:47.819710 10193 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:47.841624 10180 consensus_meta.cc:287] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.677s	user 0.008s	sys 0.001s
I20260709 12:11:47.819962 10164 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:47.876101  5606 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:47.843327 10281 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:47.889941  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 72735.8us
I20260709 12:11:47.818471 10100 consensus_queue.cc:1059] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 12:11:47.871341 10253 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:47.851065 10275 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12.
I20260709 12:11:47.898900  5022 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:47.809712 10278 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:47.872231 10291 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.888434 10261 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:47.897538 10279 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
W20260709 12:11:47.899425 10266 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
W20260709 12:11:47.925668 10282 log.cc:927] Time spent T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 12:11:47.925951 10174 raft_consensus.cc:3055] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:47.926345 10174 raft_consensus.cc:740] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:47.927119 10174 consensus_queue.cc:260] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:47.927361 10291 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:47.928258 10174 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.928902  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:47.929489 10291 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:47.931635 10258 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
W20260709 12:11:47.932246 10161 consensus_meta.cc:287] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.677s	user 0.005s	sys 0.002s
I20260709 12:11:47.933007  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3631) took 1601 ms. Trace:
I20260709 12:11:47.932667 10161 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.926265  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2724) took 1555 ms. Trace:
I20260709 12:11:47.933367  4870 rpcz_store.cc:276] 0709 12:11:46.331851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.895902 (+564051us) service_pool.cc:224] Handling call
0709 12:11:46.896175 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:46.930870 (+ 34695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:46.930902 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:46.931369 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.119481 (+188112us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:47.142147 (+ 22666us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.154094 (+ 11947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.154168 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.518957 (+364789us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b180035f4a0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a57777c0a 00007f2a60eb7219 00007f2a5e7be58f 00007f2a577fd571 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd
0709 12:11:47.931008 (+412051us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:47.932792 (+  1784us) raft_consensus.cc:1685] finished
0709 12:11:47.932834 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.932949 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60137,"prepare.queue_time_us":55532,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":10725,"raft.queue_time_us":46745,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":14753,"spinlock_wait_cycles":122701952,"thread_start_us":100971,"threads_started":1,"wal-append.queue_time_us":586120}
I20260709 12:11:47.934752  5024 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:47.935384  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:47.935575 10278 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:47.935894  4870 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:47.936342 10285 consensus_queue.cc:1059] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:11:47.938263 10297 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:47.938500 10193 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:11:47.940133 10259 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.644s	user 0.002s	sys 0.000s
I20260709 12:11:47.943727  4874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1156) took 1208 ms. Trace:
I20260709 12:11:47.946163  4870 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:47.919726 10204 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.921150 10275 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:47.921267 10284 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:11:47.921777 10164 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:47.886951 10175 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:47.900050 10144 consensus_meta.cc:287] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.569s	user 0.003s	sys 0.005s
I20260709 12:11:47.924265 10261 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.870375 10293 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
W20260709 12:11:47.951980  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.956164 10075 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:47.929502  4872 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:47.969209  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1162) took 1180 ms. Trace:
I20260709 12:11:47.974283 10287 raft_consensus.cc:3055] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:47.940871  5019 rpcz_store.cc:276] 0709 12:11:46.370802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.087328 (+716526us) service_pool.cc:224] Handling call
0709 12:11:47.087594 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.094203 (+  6609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.094233 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.094662 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.102355 (+  7693us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:47.315085 (+212730us) log.cc:844] Serialized 14 byte log entry
0709 12:11:47.315296 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.315363 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:47.832842 (+517479us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b48001c0158. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5f813aa1 00007f2a5f80ab37 00007f2a5f80a9ca 00007f2a5f90226f 00007f2a5f901f37 00007f2a5f91655c 00007f2a5f916508 00007f2a5f916488 00007f2a5f916443 00007f2a5f9156ec 00007f2a5e83fa96
0709 12:11:47.925990 (+ 93148us) raft_consensus.cc:1685] finished
0709 12:11:47.926089 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.926208 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5226,"prepare.queue_time_us":395494,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":43660,"raft.run_cpu_time_us":51094,"raft.run_wall_time_us":704179,"spinlock_wait_cycles":12714240,"thread_start_us":205927,"threads_started":3,"wal-append.queue_time_us":374338}
I20260709 12:11:47.894199 10180 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:47.944080  4874 rpcz_store.cc:276] 0709 12:11:46.735184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.946548 (+211364us) service_pool.cc:224] Handling call
0709 12:11:47.004886 (+ 58338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.023834 (+ 18948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.943539 (+919705us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b54003e35d0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:47.943670 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133545728}
I20260709 12:11:47.901160 10273 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:47.907119 10054 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.978762  4870 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:48.029775  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 353088us
I20260709 12:11:48.025835  4875 rpcz_store.cc:276] 0709 12:11:46.788971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.007024 (+218053us) service_pool.cc:224] Handling call
0709 12:11:47.036494 (+ 29470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.700149 (+663655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.969001 (+268852us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54002b66d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:47.969156 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524950400}
W20260709 12:11:48.035547  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 141833us
I20260709 12:11:47.978256 10285 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:48.060323  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:48.025265 10075 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:48.027035 10287 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:48.069453  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:48.073525 10308 consensus_queue.cc:1048] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:48.060746 10295 consensus_queue.cc:1059] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:11:48.063167 10288 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.184s
I20260709 12:11:48.082346 10273 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.086585 10161 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.087517 10075 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.088914 10075 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:48.090641  4875 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4be803cbf3854da89561de85968acd64"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "ab9da67236874634be59ebfd05b18255"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:48.091192  4875 raft_consensus.cc:606] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Received request to transfer leadership to TS ab9da67236874634be59ebfd05b18255
I20260709 12:11:48.091493  4875 raft_consensus.cc:614] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:48.059386 10054 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.094637 10054 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:48.057649 10285 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:47.913707 10280 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.059384 10081 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 12:11:48.080682 10199 consensus_meta.cc:287] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 1.015s	user 0.009s	sys 0.001s
I20260709 12:11:48.030022 10294 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:11:48.057803 10275 consensus_queue.cc:1048] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:11:48.059165 10055 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:11:48.115540 10283 consensus_queue.cc:1048] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:11:48.106235 10161 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.076746 10308 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:48.124155  5018 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
W20260709 12:11:48.179956  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 110568us
I20260709 12:11:48.181039 10144 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:48.181646 10149 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.182075 10144 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.182531 10144 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:48.182188 10149 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.183331 10144 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.184495 10144 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.184566 10149 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:48.173039  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 112780us
I20260709 12:11:48.176790 10307 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:48.172140 10308 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:48.192047  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 372095us
I20260709 12:11:48.172281 10183 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.172502 10276 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.125121 10161 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.203784  5601 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:48.204864  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:48.193145 10307 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.195715 10183 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.205821 10276 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.206017 10302 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:48.206391 10276 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.206558 10302 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:48.217600  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 375441us
W20260709 12:11:48.240514  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.209684 10295 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:48.173126 10287 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.249121 10161 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.249069  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:48.251709  5600 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 14: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:48.244866 10180 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.179349 10285 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.290337 10161 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.265085 10292 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.284972 10308 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.239526 10060 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:48.296201 10306 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:11:48.297696 10302 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:48.298642 10224 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:48.299096 10224 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.295794 10292 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.301851  5606 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:48.292520  9809 consensus_meta.cc:287] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.796s	user 0.008s	sys 0.001s
W20260709 12:11:48.295558 10207 consensus_meta.cc:287] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.853s	user 0.003s	sys 0.007s
I20260709 12:11:48.293552 10077 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.242671 10182 consensus_queue.cc:1059] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:48.306912 10060 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:48.309283 10305 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:11:48.316515 10292 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:48.317921 10277 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.318287 10277 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:48.318974 10277 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.320096 10277 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.310838  9809 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.325023  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2714) took 2014 ms. Trace:
I20260709 12:11:48.325389  5016 rpcz_store.cc:276] 0709 12:11:46.310796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.024083 (+713287us) service_pool.cc:224] Handling call
0709 12:11:47.024311 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.628976 (+604665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.323179 (+694203us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54003cc154. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:48.324967 (+  1788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298231552}
W20260709 12:11:48.344974  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.347077 10060 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.314730 10077 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.349885 10077 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:48.303478 10161 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.367805 10311 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.368669 10161 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.313263 10207 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.370241  5602 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 21. Current term is 22. Ops: []
I20260709 12:11:48.368389 10311 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.371168 10292 raft_consensus.cc:3055] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:48.379571 10292 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:48.380045 10207 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 22 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:48.383033 10311 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:48.384521 10327 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:48.388095 10224 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.397135 10224 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.380350 10292 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.397985 10292 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:48.409482  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.411891 10254 log.cc:927] Time spent T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.852s	user 0.000s	sys 0.002s
W20260709 12:11:48.418568  5018 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55722 (request call id 2609) took 2334 ms (client timeout 1912 ms). Trace:
I20260709 12:11:48.418784  5025 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:48.418972  5018 rpcz_store.cc:269] 0709 12:11:46.084290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:46.233900 (+149610us) service_pool.cc:224] Handling call
0709 12:11:48.418356 (+2184456us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b5400260054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:48.418468 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4345202944}
I20260709 12:11:48.421231 10274 raft_consensus.cc:3055] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.421602 10274 raft_consensus.cc:740] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:48.422379 10274 consensus_queue.cc:260] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.423494 10274 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.434589 10077 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.433022  9809 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:48.435333 10077 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.435484  9809 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.437516  9809 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.438477 10077 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.440294  4949 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:48.442551  4942 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:48.439216 10060 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.444664 10060 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.446580 10060 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.447366  4951 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:48.433982 10161 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:48.448729 10161 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.449947  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:48.450625 10161 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.441486  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:48.451735  4949 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:48.433388 10277 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.454083  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:48.463961 10268 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.905s	user 0.004s	sys 0.000s
I20260709 12:11:48.465095  5598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1535) took 1445 ms. Trace:
I20260709 12:11:48.465438  5598 rpcz_store.cc:276] 0709 12:11:47.019637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.019762 (+   125us) service_pool.cc:224] Handling call
0709 12:11:47.020043 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.020374 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.020401 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.028794 (+  8393us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.291246 (+262452us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:47.291286 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.291352 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.463436 (+1172084us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:48.464798 (+  1362us) raft_consensus.cc:1685] finished
0709 12:11:48.464838 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.465041 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7890,"raft.queue_time_us":3786,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":16221,"spinlock_wait_cycles":8238976,"thread_start_us":162442,"threads_started":1,"wal-append.queue_time_us":419924}
I20260709 12:11:48.471529  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3643) took 1455 ms. Trace:
I20260709 12:11:48.471866  4868 rpcz_store.cc:276] 0709 12:11:47.016275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.203337 (+187062us) service_pool.cc:224] Handling call
0709 12:11:47.205558 (+  2221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:47.410811 (+205253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.471326 (+1060515us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54004083d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:48.471476 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195735424}
I20260709 12:11:48.476357 10164 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.478605 10242 raft_consensus.cc:3055] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:48.478973 10242 raft_consensus.cc:740] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:48.479674 10242 consensus_queue.cc:260] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.482203  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 2624) took 1319 ms. Trace:
I20260709 12:11:48.482563  5025 rpcz_store.cc:276] 0709 12:11:47.162417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.462745 (+300328us) service_pool.cc:224] Handling call
0709 12:11:48.418472 (+955727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.419332 (+   860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.482006 (+ 62674us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b5400260050. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:48.482141 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197389184}
I20260709 12:11:48.483268  4943 raft_consensus.cc:1240] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:48.480589 10242 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.453739 10277 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.484853 10161 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:48.505075  5567 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:48.527017 10308 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:48.527580 10308 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.499877 10300 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:48.512122 10199 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:48.512037 10165 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:48.503515 10161 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.519186 10160 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:48.525727 10121 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:48.511911 10274 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:11:48.543316 10183 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:48.535691 10121 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.546248 10121 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.535498 10165 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.550673 10165 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.536554 10160 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.535169 10193 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:48.553030 10193 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:48.553256 10160 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.554147 10193 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.555498 10193 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:48.557114  5602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 1534) took 1443 ms. Trace:
I20260709 12:11:48.557454  5602 rpcz_store.cc:276] 0709 12:11:47.113255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.113428 (+   173us) service_pool.cc:224] Handling call
0709 12:11:47.113680 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:48.370646 (+1256966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.556908 (+186262us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400483854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:48.557061 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889435904}
W20260709 12:11:48.565908 10299 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.502s	user 0.004s	sys 0.000s
I20260709 12:11:48.566185 10308 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:48.567102  5605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 1537) took 1003 ms. Trace:
I20260709 12:11:48.567448  5605 rpcz_store.cc:276] 0709 12:11:47.563948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.564491 (+   543us) service_pool.cc:224] Handling call
0709 12:11:47.567511 (+  3020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.583463 (+ 15952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.583493 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.622120 (+ 38627us) log.cc:844] Serialized 26 byte log entry
0709 12:11:47.837870 (+215750us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:47.837915 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:47.837980 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.565386 (+727406us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:48.566857 (+  1471us) raft_consensus.cc:1685] finished
0709 12:11:48.566876 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.567047 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5133,"raft.queue_time_us":127256,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":99996,"spinlock_wait_cycles":3099904,"thread_start_us":165734,"threads_started":1,"wal-append.queue_time_us":283618}
I20260709 12:11:48.538669 10274 consensus_queue.cc:1243] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer 8de40fe2bb814adcbe13958669063dc9 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:48.534629 10199 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.581404  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:48.585197 10247 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 1.476s	user 0.006s	sys 0.008s
I20260709 12:11:48.596563  4948 raft_consensus.cc:3060] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:48.599004 10276 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.603742 10277 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:48.605912  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 756260us
I20260709 12:11:48.606485 10096 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.607023 10161 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:48.613232 10176 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.614382 10176 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:48.615224 10310 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.326s	user 0.003s	sys 0.000s
I20260709 12:11:48.617031 10298 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:48.617846 10199 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.618256 10298 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:48.619477 10298 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:48.606958 10096 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.622458 10096 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:48.607790  9947 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:11:48.623224  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 1542) took 1051 ms. Trace:
I20260709 12:11:48.623553  5597 rpcz_store.cc:276] 0709 12:11:47.571462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:47.571634 (+   172us) service_pool.cc:224] Handling call
0709 12:11:47.582623 (+ 10989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:47.674424 (+ 91801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:47.674454 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:47.679673 (+  5219us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.200055 (+520382us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:48.200101 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.201393 (+  1292us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:48.614970 (+413577us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b24002e60b8. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a576839c4 00007f2a57681acb 00007f2a5783cdc9 00007f2a5783ca55 00007f2a5783c09d 00007f2a5a46e10e 00007f2a5a48588c 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221
0709 12:11:48.622958 (+  7988us) raft_consensus.cc:1685] finished
0709 12:11:48.622979 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:48.623170 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10568,"raft.queue_time_us":215147,"spinlock_wait_cycles":27686656,"thread_start_us":486557,"threads_started":2,"wal-append.queue_time_us":546416}
I20260709 12:11:48.625196 10223 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.625572 10223 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:48.626298 10223 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.627126 10265 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:48.627358 10223 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.628641  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:48.629058  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.630200  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.630790 10295 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:48.631242 10295 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:48.631914 10202 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:48.632362 10280 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.632884 10280 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.633493  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:48.633998  4867 raft_consensus.cc:606] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:48.620613 10298 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:11:48.634721 10280 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:48.635188 10280 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:48.635629 10280 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.636234 10298 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:48.636631  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:48.632436 10202 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.637880 10224 raft_consensus.cc:993] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: : Instructing follower 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:48.638302 10224 raft_consensus.cc:1081] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Signalling peer 8de40fe2bb814adcbe13958669063dc9 to start an election
I20260709 12:11:48.623883  9947 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:11:48.640681 10287 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:48.641247  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:48.641906 10293 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.642082  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:48.645265  4867 raft_consensus.cc:606] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:48.645591  4867 raft_consensus.cc:614] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:48.646217 10323 log.cc:927] Time spent T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 12:11:48.647945  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:48.648443  4867 raft_consensus.cc:606] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:48.649578  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:48.651350  4948 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:48.649434  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:48.651970  5025 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.654960 10184 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:48.655458 10184 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.656312  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:48.660719  5024 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:48.657724  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:48.658661  4943 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:48.671401  4948 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.684593  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.616317 10121 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.689407  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:48.693288  5606 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:11:48.693833  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.644959 10202 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.694870  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.695477  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.692180  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.697237  4943 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:11:48.698971  5570 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:48.694536  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.702831  4869 raft_consensus.cc:1240] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:11:48.703020  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:48.623459 10142 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:48.765554  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.636953 10221 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:11:48.708382  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:48.740471  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.818778  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:48.722160  4948 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:48.699074  4840 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:48.657603 10319 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:48.635636 10100 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.822688  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 123680us
I20260709 12:11:48.819659  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.819332  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.822371  5597 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.822050  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:48.819110  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:48.836238  4875 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:48.706166 10293 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.843741  4875 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 18.
I20260709 12:11:48.733116  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:48.825454  5023 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 17.
I20260709 12:11:48.730399  5025 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:48.829087  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:48.845561  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 214001us
I20260709 12:11:48.660996 10283 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:48.819396  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:48.822281  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.657464 10071 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.832157  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.846794  4840 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:48.645047 10307 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.821044 10096 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.728678  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.656343 10164 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.185s
I20260709 12:11:48.881263  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:48.877456  5598 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
W20260709 12:11:48.870956  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.873422  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.883201  5600 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:48.840236 10293 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:48.705685 10195 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:48.883332  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.693296 10289 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:48.688972 10186 consensus_queue.cc:1059] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.179s
I20260709 12:11:48.877831  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.820281 10173 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.878159  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:48.704310 10193 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:48.819846 10272 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:48.909165 10272 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.911095 10272 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:48.880523  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.724529  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 18.
I20260709 12:11:48.911588 10296 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:48.882339  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.912225 10296 raft_consensus.cc:697] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:48.702001 10309 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.176s
I20260709 12:11:48.913143 10296 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.918387  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.880481  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:48.875435  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 248051us
I20260709 12:11:48.926262  4873 raft_consensus.cc:2393] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:48.694497 10075 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.889544  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:48.946521  4948 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
W20260709 12:11:48.946825  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 54475.9us
W20260709 12:11:48.947633  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.891022  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.949266  4916 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:48.891781  4839 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:48.892509 10221 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:48.693001 10239 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.183s
I20260709 12:11:48.693997 10149 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:48.864319 10283 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.897848  4949 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 18: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:48.905071  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.885511  9867 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:48.929409  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.726698  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.930025  5597 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:48.818729 10261 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:48.950311  4916 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:48.866556 10100 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:48.956670  4872 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:48.902583 10285 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:48.883864 10319 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:48.963608  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.963600  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:48.956000  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 246004us
I20260709 12:11:48.967710  4943 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:48.968019  4949 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:48.969048  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:48.970726  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.974164  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:48.970934  4841 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:48.878476 10071 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.008065  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:49.010231  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:48.883738 10096 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.893128  9947 consensus_queue.cc:1059] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:11:49.012428  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.015522  4944 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 18: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:49.029821  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:49.023059  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.022957  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.030524  5597 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 18: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:49.030884  4872 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:48.909094 10193 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:48.970592 10057 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.958847 10307 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:49.031723  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.040855  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.041275  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.903016 10195 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.028288  4949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60"
dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:52376
I20260709 12:11:49.045557  4949 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.954779 10075 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.035511  4868 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 18: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:49.006767 10224 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.007495 10276 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:49.055656  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:48.959260 10283 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.042513  4951 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:49.008065 10176 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.045899  4949 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.034950  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:49.051952  5597 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:48.958559 10149 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.064245  4875 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:48.925585 10289 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.066210  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.054826  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:49.004125  9867 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.012897 10183 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:11:49.040195 10307 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:49.071244  5605 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:49.072575  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.055374 10276 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.064028 10272 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.083132  5603 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 7.
I20260709 12:11:49.061642 10224 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.085117 10171 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:49.085427 10195 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.045300 10294 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:49.086853  4874 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:49.093259 10096 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.093822 10096 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:49.094129 10096 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:49.094739 10345 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.094977 10096 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.095203 10171 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.069223 10176 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.097927 10165 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.098444 10176 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:49.099840 10149 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:49.101118  5606 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:49.101749  4876 raft_consensus.cc:1275] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:49.102746  4876 raft_consensus.cc:3055] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:49.103011  4876 raft_consensus.cc:740] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:49.103622  4876 consensus_queue.cc:260] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.105640  4876 raft_consensus.cc:3060] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.106266 10193 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.078846 10307 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:49.094167 10348 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.108580 10348 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.110401 10348 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:49.111485 10184 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.111790  9867 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.112746 10100 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.113220 10171 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.114449 10224 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.098388 10165 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.122670 10165 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:49.123173  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.125253  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:49.125808  4942 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.126703  4876 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:49.127930 10298 raft_consensus.cc:3055] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.128398 10298 raft_consensus.cc:740] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:49.128798  4772 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 13, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 13 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:49.130640  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.131222  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:49.131070  4772 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:49.131959  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:49.071316 10341 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.134442  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:49.129228 10298 consensus_queue.cc:260] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.081777 10020 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.089421 10276 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.141868  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:49.128038  4770 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 393) took 16970 ms (client timeout 15000 ms). Trace:
I20260709 12:11:49.141806  4942 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:49.148496  4876 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:11:49.117426  4949 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.096136 10096 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:49.154553  4871 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:49.131771  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:49.158696  4875 raft_consensus.cc:1240] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:49.148449  4772 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 9, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 9 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:49.158782  4868 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 17. Current term is 18. Ops: []
W20260709 12:11:49.173135  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 281407us
I20260709 12:11:49.108080 10121 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.119095 10272 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:49.180970  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:49.181057  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:49.168758  5567 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:49.176378  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:49.068405 10319 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.182794  4947 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:49.176905  4772 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 11 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:49.179265  4949 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.101151 10057 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:49.181583  5605 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:49.159157 10270 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:11:49.184146  4772 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:49.108075 10345 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.287595  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:49.297976  4950 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
W20260709 12:11:49.279232 10295 consensus_meta.cc:287] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 12:11:49.288923  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:49.289736  4772 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:49.293643  5017 raft_consensus.cc:1275] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:49.294746  5025 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.278419 10294 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:49.337725  5020 raft_consensus.cc:1240] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:49.166074 10020 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.305619  4772 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:49.309712  5017 raft_consensus.cc:1240] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.278769 10298 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.338739  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:49.279626 10348 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:11:49.345659  5020 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:49.278475  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.279253 10341 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.340420  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:49.347370  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:49.347929  5025 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:49.348652  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:49.349172  5025 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:49.349932  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:49.343204  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:49.350446  5025 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:49.352574  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:49.339437 10295 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.351557  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:49.294852 10057 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:49.167876  4770 rpcz_store.cc:269] 0709 12:11:32.157247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.157388 (+   141us) service_pool.cc:224] Handling call
0709 12:11:49.127961 (+16970573us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:45.327783 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:45.550828 (+223045us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:45.550862 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:11:45.550879 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:45.551201 (+   322us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:45.551269 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:45.551298 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:45.551473 (+   175us) tablet.cc:701] Row locks acquired
0709 12:11:45.551490 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:11:45.551627 (+   137us) write_op.cc:270] Start()
0709 12:11:45.551749 (+   122us) write_op.cc:276] Timestamp: P: 1783599105551587 usec, L: 0
0709 12:11:45.551770 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:45.552361 (+   591us) log.cc:844] Serialized 533 byte log entry
0709 12:11:46.091134 (+538773us) op_driver.cc:464] REPLICATION: finished
0709 12:11:46.167372 (+ 76238us) write_op.cc:301] APPLY: starting
0709 12:11:46.167491 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:46.168633 (+  1142us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:46.168736 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:46.169814 (+  1078us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:46.170013 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:11:46.170059 (+    46us) write_op.cc:312] APPLY: finished
0709 12:11:46.170246 (+   187us) log.cc:844] Serialized 25 byte log entry
0709 12:11:46.170412 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:46.170492 (+    80us) write_op.cc:454] Released schema lock
0709 12:11:46.170531 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:46.170935 (+   404us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:46.170961 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35891,"reported_tablets":24,"spinlock_wait_cycles":82176,"child_traces":[["op",{"apply.queue_time_us":72200,"apply.run_cpu_time_us":3178,"apply.run_wall_time_us":3513,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":156985,"prepare.run_cpu_time_us":3680,"prepare.run_wall_time_us":259404,"raft.queue_time_us":172049,"raft.run_cpu_time_us":13916,"raft.run_wall_time_us":109944,"replication_time_us":523371,"thread_start_us":182542,"threads_started":4,"wal-append.queue_time_us":315997,"wal-append.run_cpu_time_us":17829,"wal-append.run_wall_time_us":1308683}]]}
I20260709 12:11:49.294783 10149 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:49.338554 10071 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.277905 10283 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.339996  9867 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.374017  5018 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:49.372306 10075 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:49.345870 10164 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:49.372503 10160 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:11:49.383216  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 411297us
W20260709 12:11:49.359907 10335 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:49.378803 10149 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.384955  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:49.392148  5606 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:49.351437 10294 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:49.337726 10175 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:49.338848 10296 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:11:49.380901 10350 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.393015  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:49.368064 10176 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.351531 10348 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:49.387853  5020 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
W20260709 12:11:49.405055 10342 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 12:11:49.393425 10160 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.406349 10345 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.406785  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:49.409857  5018 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:49.370146  5605 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:49.421682  5600 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 12:11:49.423246 10356 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:11:49.393198 10164 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.359398 10341 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.421656 10121 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:49.423113 10075 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:49.442421  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.391175  9867 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:49.467370 10341 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.425438 10350 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.467923  9867 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:49.431819 10289 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.383070 10272 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:49.407948 10204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.013s	sys 0.052s
I20260709 12:11:49.434075 10020 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.426647 10176 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.471508 10352 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.446265 10121 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:49.493623 10204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.013s	sys 0.052s
W20260709 12:11:49.618139  4867 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.011s
W20260709 12:11:49.619681  4867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.011s	sys 0.011s
W20260709 12:11:49.431185  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 423469us
W20260709 12:11:49.620045  4842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.004s	sys 0.020s
W20260709 12:11:49.623021  4842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.004s	sys 0.020s
I20260709 12:11:49.455884 10075 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:49.657744  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.657743  4840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.012s	sys 0.035s
I20260709 12:11:49.445454 10348 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.659298  4841 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:49.668996  4840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.013s	sys 0.035s
I20260709 12:11:49.669395 10348 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:11:49.669800  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.677304  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 362120us
I20260709 12:11:49.687135 10261 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.687734 10261 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.688151 10261 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.690074 10261 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.690308 10359 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:49.686589  4841 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:49.696979 10224 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.697600 10224 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:49.700531 10359 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:49.701047 10359 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.703117 10359 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.703542 10359 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.703938 10359 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.705833 10359 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.708348  4868 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:11:49.708992  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.713008  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.713558  4875 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:49.715298  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.716037  4875 raft_consensus.cc:2410] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:11:49.622617 10357 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.748152 10319 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.749953  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 62501.3us
I20260709 12:11:49.677034 10175 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.613379 10307 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.676909 10341 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:49.767970  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.685322 10295 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.498682 10294 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.618836 10352 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.743414 10160 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.744405 10071 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:49.803154  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:49.732437 10348 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.809963  4945 raft_consensus.cc:1240] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:49.762790 10164 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.821171 10164 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:49.821619 10164 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:49.822431 10285 consensus_meta.cc:287] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.818s	user 0.006s	sys 0.002s
I20260709 12:11:49.748680 10319 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.829440 10164 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.829918 10164 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.829998 10307 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.830331 10164 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.832243 10164 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:49.833997 10142 consensus_meta.cc:287] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 1.004s	user 0.007s	sys 0.001s
I20260709 12:11:49.835242 10121 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.816339 10149 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.817646 10075 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:49.817791 10265 consensus_meta.cc:287] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 1.190s	user 0.010s	sys 0.000s
I20260709 12:11:49.778252 10341 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:49.772698 10175 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:49.844480  4841 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297): Timed out: RequestConsensusVote RPC to 127.3.163.68:44297 timed out after 1.501s (SENT)
I20260709 12:11:49.862149  5601 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:49.776939 10283 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:49.969256  4990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.009s	sys 0.026s
I20260709 12:11:49.832648 10164 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:49.983112  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:49.966503  4772 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.000s	sys 0.056s
W20260709 12:11:49.984248  4772 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.056s
W20260709 12:11:49.948890  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 104447us
W20260709 12:11:49.982965  4990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.027s
I20260709 12:11:49.830376 10319 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:49.862717 10171 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.859910 10348 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.760943 10357 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:49.841456 10374 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.973115 10366 log.cc:927] Time spent T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.458s	user 0.000s	sys 0.002s
W20260709 12:11:49.947815 10380 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.121s	user 0.005s	sys 0.000s
W20260709 12:11:50.000545  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 407985us
I20260709 12:11:49.983477 10193 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.007277  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.008090  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:49.989157 10346 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.038560  4869 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:49.864382 10071 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.040360  5606 raft_consensus.cc:1275] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:50.069850  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.072862  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:49.998618 10075 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:50.038941 10057 consensus_meta.cc:287] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.000s
I20260709 12:11:50.083766  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:50.071045  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.086149  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:50.072551 10186 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.002s	sys 0.020s
I20260709 12:11:50.036267 10265 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:50.090673  4914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.026s	sys 0.029s
W20260709 12:11:50.091658  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.990803 10164 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.053066 10345 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.109817 10175 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:49.997393 10171 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:50.054382 10354 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.003s	sys 0.021s
I20260709 12:11:50.132577  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.073292 10360 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:50.098496  4914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.026s	sys 0.029s
I20260709 12:11:50.133312  5606 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
W20260709 12:11:50.112876  5603 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57006 (request call id 1205) took 1270 ms (client timeout 1663 ms). Trace:
I20260709 12:11:50.134747  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:50.001228 10378 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.100s
I20260709 12:11:50.144878  4869 raft_consensus.cc:3055] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:50.153861  4869 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:11:50.145236  5603 rpcz_store.cc:269] 0709 12:11:48.842200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.880330 (+ 38130us) service_pool.cc:224] Handling call
0709 12:11:50.112721 (+1232391us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54006130d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:50.112826 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394108672}
W20260709 12:11:50.148371  4916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.000s	sys 0.014s
W20260709 12:11:50.155009  4916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.001s	sys 0.014s
I20260709 12:11:50.157133  5606 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:50.157601  4990 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:50.137499  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
W20260709 12:11:50.192523  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 55083.1us
I20260709 12:11:50.072392 10346 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.111959 10171 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:50.054280 10193 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:50.112257 10362 log.cc:927] Time spent T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
W20260709 12:11:50.233383  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 431984us
I20260709 12:11:50.039285 10374 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.093955 10283 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:50.132531 10354 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.004s	sys 0.024s
I20260709 12:11:50.154683  4869 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.248131  4869 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:50.136693 10276 consensus_meta.cc:287] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.957s	user 0.009s	sys 0.000s
W20260709 12:11:50.236642  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 79093.6us
I20260709 12:11:50.153472 10176 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:50.111217 10164 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.106990 10265 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.095404 10057 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:50.257927  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.006s	sys 0.013s
I20260709 12:11:50.109740 10345 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:50.235234 10311 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.003s	sys 0.013s
W20260709 12:11:50.236817  5016 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.031s	sys 0.003s
I20260709 12:11:50.235960 10367 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:50.243207 10353 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:50.259449  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.006s	sys 0.014s
W20260709 12:11:50.315095  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 54565.5us
I20260709 12:11:50.255577  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:50.265112  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 211901us
W20260709 12:11:50.273947  5016 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.031s	sys 0.003s
W20260709 12:11:50.283037  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 227566us
W20260709 12:11:50.258762 10096 consensus_meta.cc:287] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 1.080s	user 0.009s	sys 0.001s
W20260709 12:11:50.273018 10311 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.003s	sys 0.013s
W20260709 12:11:50.328337  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 72824.6us
I20260709 12:11:50.329373  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:50.278038 10164 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:50.315734 10367 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:50.334412 10375 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 12:11:50.357632  4990 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:50.334717  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 3053) took 1159 ms. Trace:
I20260709 12:11:50.363646  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.363891  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:50.334975 10372 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 12:11:50.340312 10166 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.341336 10352 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.313947 10390 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.361541  4945 rpcz_store.cc:276] 0709 12:11:49.175132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.175235 (+   103us) service_pool.cc:224] Handling call
0709 12:11:49.175473 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.830544 (+655071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.334476 (+503932us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54000f0854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:50.334647 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458792704}
W20260709 12:11:50.323953 10223 consensus_meta.cc:287] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 1.696s	user 0.013s	sys 0.005s
I20260709 12:11:50.342821 10265 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.321118 10353 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.344293 10057 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:50.344646 10379 log.cc:927] Time spent T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:11:50.254143 10283 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.345335 10348 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:50.345845 10368 log.cc:927] Time spent T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 12:11:50.402573  5022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2741) took 1753 ms. Trace:
I20260709 12:11:50.402902  5022 rpcz_store.cc:276] 0709 12:11:48.649011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.651310 (+  2299us) service_pool.cc:224] Handling call
0709 12:11:48.693182 (+ 41872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.034006 (+340824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.034039 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.038654 (+  4615us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.434485 (+395831us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.434518 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.434576 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.402390 (+967814us) raft_consensus.cc:1685] finished
0709 12:11:50.402407 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.402521 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15682,"raft.queue_time_us":203791,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":48691,"thread_start_us":699127,"threads_started":2,"wal-append.queue_time_us":712632}
I20260709 12:11:50.405505  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1173) took 1714 ms. Trace:
I20260709 12:11:50.405893  4867 rpcz_store.cc:276] 0709 12:11:48.691405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.099050 (+407645us) service_pool.cc:224] Handling call
0709 12:11:49.099315 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.111889 (+ 12574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.111916 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.112321 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.620117 (+507796us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:49.620158 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.620225 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.405283 (+785058us) raft_consensus.cc:1685] finished
0709 12:11:50.405306 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.405445 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12258,"raft.queue_time_us":12438,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":507430,"threads_started":1,"wal-append.queue_time_us":873631}
I20260709 12:11:50.407624  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:50.323738 10239 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:50.408601  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:11:50.349390 10377 log.cc:927] Time spent T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:11:50.349834 10341 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:50.166886 10360 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.254040 10276 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:50.333837 10384 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:11:50.356350  4869 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:50.364876  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:50.422535  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.366827  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.423554  5604 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:50.367451  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.424917  5603 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 7.
I20260709 12:11:50.362746  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.341737 10357 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.378664 10166 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:50.382810  4875 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:50.376183 10382 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.361092 10367 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:50.368052 10164 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.434607  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1331) took 1120 ms. Trace:
I20260709 12:11:50.377398 10351 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:11:50.386288  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 2495) took 1698 ms. Trace:
I20260709 12:11:50.386528 10353 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.388382 10346 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:50.390138 10396 consensus_queue.cc:1048] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:50.390761 10280 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:50.393982  4874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39318 (request call id 2489) took 1707 ms (client timeout 1684 ms). Trace:
W20260709 12:11:50.451968  4874 rpcz_store.cc:269] 0709 12:11:48.686239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.686334 (+    95us) service_pool.cc:224] Handling call
0709 12:11:50.393814 (+1707480us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54002b5cd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:50.393920 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510675200}
I20260709 12:11:50.398398  4917 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:50.452339  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:50.453305  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 54988.9us
I20260709 12:11:50.397257  5570 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:50.456195  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 59020.7us
I20260709 12:11:50.348153 10374 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:50.404691  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.455634  4917 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:50.459298  5022 raft_consensus.cc:2393] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 11: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:50.410248  4867 raft_consensus.cc:2376] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 18. Re-sending same reply.
I20260709 12:11:50.425806  5606 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:50.429523  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.461134  5020 raft_consensus.cc:2393] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:50.428083 10166 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.430467 10382 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:50.409484 10239 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.430171 10402 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:50.428601 10175 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.432276  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:50.467082  4876 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:50.433413  4942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 3051) took 1258 ms. Trace:
I20260709 12:11:50.434960  5025 rpcz_store.cc:276] 0709 12:11:49.313749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.383818 (+ 70069us) service_pool.cc:224] Handling call
0709 12:11:49.384082 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.393754 (+  9672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.393787 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.394224 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.749035 (+354811us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:49.749071 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.750893 (+  1822us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.434419 (+683526us) raft_consensus.cc:1685] finished
0709 12:11:50.434437 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.434551 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4515,"raft.queue_time_us":62098,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":17935,"thread_start_us":343031,"threads_started":1,"wal-append.queue_time_us":634139}
I20260709 12:11:50.469534  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.470080  5025 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:50.470809  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.441951  4943 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:50.442816  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1321) took 1139 ms. Trace:
I20260709 12:11:50.463737  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:50.471890  5023 rpcz_store.cc:276] 0709 12:11:49.303603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.304001 (+   398us) service_pool.cc:224] Handling call
0709 12:11:49.304289 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.366189 (+ 61900us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:49.366223 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.373527 (+  7304us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.738350 (+364823us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:49.738391 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.738457 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.442633 (+704176us) raft_consensus.cc:1685] finished
0709 12:11:50.442651 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.442767 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46719,"raft.queue_time_us":84736,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":16419,"thread_start_us":364520,"threads_started":1,"wal-append.queue_time_us":623493}
I20260709 12:11:50.473385  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.464764  5570 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:50.473733  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.474694  5023 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:50.475519  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.443635  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:50.440207  4872 rpcz_store.cc:276] 0709 12:11:48.687644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.062611 (+374967us) service_pool.cc:224] Handling call
0709 12:11:49.062878 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.075156 (+ 12278us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:49.440100 (+364944us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.055028 (+614928us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.074599 (+ 19571us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.074746 (+   147us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:50.074778 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.074838 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.386070 (+311232us) raft_consensus.cc:1685] finished
0709 12:11:50.386090 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.386230 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64132,"prepare.queue_time_us":723465,"prepare.run_cpu_time_us":5769,"prepare.run_wall_time_us":70416,"raft.queue_time_us":123603,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":17782,"thread_start_us":832618,"threads_started":2,"wal-append.queue_time_us":771536}
I20260709 12:11:50.477000  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:50.462805 10173 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.477733 10173 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.478101 10173 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.478619 10164 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:50.479127 10164 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.479389 10201 consensus_queue.cc:1059] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:50.480070 10201 consensus_queue.cc:1243] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer 4f3bf546572147c3abe4522189e86ce6 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:50.480468 10201 raft_consensus.cc:3055] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:50.446561  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.480767 10201 raft_consensus.cc:740] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:50.448014  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.481218  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.449271  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:50.481608 10201 consensus_queue.cc:260] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.482429  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.483135  5022 raft_consensus.cc:2393] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 7: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:50.477572  4872 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:50.421208 10242 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.482726 10201 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.478271 10402 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:50.446125  5599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.017s	sys 0.009s
I20260709 12:11:50.467760  4942 rpcz_store.cc:276] 0709 12:11:49.174546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.174651 (+   105us) service_pool.cc:224] Handling call
0709 12:11:49.174932 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.175246 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.175272 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.188155 (+ 12883us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.785788 (+597633us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:49.785825 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.785890 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.433208 (+647318us) raft_consensus.cc:1685] finished
0709 12:11:50.433227 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.433352 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2445,"raft.queue_time_us":392,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6463,"thread_start_us":440794,"threads_started":1,"wal-append.queue_time_us":813362}
I20260709 12:11:50.482121  5604 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:50.483848  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.486160  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:50.485318  5599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.017s	sys 0.009s
I20260709 12:11:50.487159  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.487340  5599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 1553) took 1100 ms. Trace:
I20260709 12:11:50.489732  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:50.490878  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.491482  4869 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:50.491644  5022 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:50.492702  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:50.490937  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:50.493276  4869 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:50.493938  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:50.495504  4872 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:50.497260  5604 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:50.493062  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.409773 10390 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.499037  5023 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:50.502617 10171 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:50.480723 10164 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:50.502856 10395 consensus_queue.cc:1048] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:11:50.485646 10176 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:11:50.503492 10283 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:50.504390 10360 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.490200 10294 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:11:50.465776 10374 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.506165  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:50.521147  4874 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 16.
I20260709 12:11:50.513942  5022 raft_consensus.cc:2393] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 10: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:50.465703 10382 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.518513  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.506903 10276 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.508448 10308 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.525043  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.532630  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.485448 10175 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.540870  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:50.541332  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.498472  9947 consensus_queue.cc:1059] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:11:50.498668 10242 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.544924  5023 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:50.546044 10400 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:50.549088  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.549867  5023 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:50.551589 10400 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.553432  4870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 2488) took 1867 ms. Trace:
I20260709 12:11:50.554603 10360 raft_consensus.cc:3055] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:50.555193 10360 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:50.553813  4870 rpcz_store.cc:276] 0709 12:11:48.685978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.701970 (+ 15992us) service_pool.cc:224] Handling call
0709 12:11:48.702240 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.433124 (+730884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.433151 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.445853 (+ 12702us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.995097 (+549244us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:49.995149 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.553109 (+557960us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540031bad4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:50.553152 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.553195 (+    43us) raft_consensus.cc:1685] finished
0709 12:11:50.553207 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.553379 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85528,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":743752448,"thread_start_us":886752,"threads_started":2,"wal-append.queue_time_us":777437}
I20260709 12:11:50.555914 10360 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.531421 10308 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.530499 10164 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:50.530454 10276 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.554606 10294 consensus_queue.cc:1048] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:50.558887  5568 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:50.655228  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 96405.6us
I20260709 12:11:50.655958  5568 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:50.560389 10400 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.561631  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:50.549453 10298 consensus_meta.cc:287] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 1.195s	user 0.007s	sys 0.003s
W20260709 12:11:50.596083  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.672230  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:50.599454  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.613476  4915 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:50.619418  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:50.673614  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54259.6us
W20260709 12:11:50.673933  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 60526.1us
I20260709 12:11:50.676144  4915 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:50.545585 10345 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:50.658492  5568 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:50.661572  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57006 (request call id 1209) took 1818 ms. Trace:
I20260709 12:11:50.686131  5600 rpcz_store.cc:276] 0709 12:11:48.843115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.063392 (+220277us) service_pool.cc:224] Handling call
0709 12:11:49.070982 (+  7590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.428904 (+357922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.661325 (+1232421us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540044b454. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:50.661514 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799969152}
I20260709 12:11:50.667201  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 2497) took 1979 ms. Trace:
I20260709 12:11:50.687403  4871 rpcz_store.cc:276] 0709 12:11:48.688067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.067456 (+379389us) service_pool.cc:224] Handling call
0709 12:11:49.087856 (+ 20400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.169166 (+ 81310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.666977 (+1497811us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b54003e30d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:50.667146 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152674688}
I20260709 12:11:50.689551  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:50.563601 10308 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.618954 10239 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:50.523481 10374 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:50.668329  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.681209  9947 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:50.682243 10242 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.683007 10400 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.672019 10319 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.690816 10176 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:50.695621  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.700608  5567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.666630  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.703455  5601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1544) took 2488 ms (client timeout 1501 ms). Trace:
I20260709 12:11:50.702076 10201 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:50.718909  5601 rpcz_store.cc:269] 0709 12:11:48.203340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.204637 (+  1297us) service_pool.cc:224] Handling call
0709 12:11:50.692027 (+2487390us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400560254. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:50.692126 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3747787008}
I20260709 12:11:50.721016  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.705865  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.694003 10164 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.690594 10309 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.691642 10395 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:50.703101 10360 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:50.668076 10276 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.712445 10171 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:11:50.712550  9947 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.729458  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.711393 10239 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:50.714562 10400 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.722968 10242 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:50.734642  9947 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.727185 10201 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.722549 10402 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:50.736694  5601 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:50.712355 10283 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:50.723981 10309 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:50.747484  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3649) took 2059 ms. Trace:
I20260709 12:11:50.750308  5604 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:50.751593  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.751754  5601 raft_consensus.cc:1240] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:50.721827  5022 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:50.765282  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:50.762343  4873 rpcz_store.cc:276] 0709 12:11:48.688531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.073846 (+385315us) service_pool.cc:224] Handling call
0709 12:11:50.394365 (+1320519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.394543 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.394568 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:50.394607 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:50.394641 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.394690 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.747313 (+352623us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002b5cd0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:50.747425 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3009431936}
I20260709 12:11:50.736552 10400 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.772645  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.740679 10242 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:50.724383 10176 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.774380  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.777734  5601 raft_consensus.cc:2376] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14. Re-sending same reply.
I20260709 12:11:50.777159  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.754834 10221 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.760594 10309 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.760327 10402 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:50.782048  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:50.786934  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:50.787629  5022 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.773695 10370 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:50.738250 10239 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.792196  5600 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 18: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:11:50.779306 10363 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.570s	user 0.002s	sys 0.006s
I20260709 12:11:50.778059 10242 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.802047  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:50.803308  5602 raft_consensus.cc:2376] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11. Re-sending same reply.
W20260709 12:11:50.806542  4914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.005s	sys 0.055s
W20260709 12:11:50.806933  4914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.006s	sys 0.055s
I20260709 12:11:50.807964 10402 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:50.799952 10370 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.783711 10221 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.811512 10402 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.816282  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:50.818775  5601 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:50.823974  5602 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
W20260709 12:11:50.825083  4868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.038s	sys 0.040s
W20260709 12:11:50.825377  4868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.038s	sys 0.040s
I20260709 12:11:50.830919  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3664) took 1072 ms. Trace:
I20260709 12:11:50.831275  4868 rpcz_store.cc:276] 0709 12:11:49.758447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.758558 (+   111us) service_pool.cc:224] Handling call
0709 12:11:49.784562 (+ 26004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.784746 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:50.240280 (+455534us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.830589 (+590309us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:50.830637 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:50.830683 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.830756 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.830865 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25284,"prepare.queue_time_us":268978,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":4230,"raft.queue_time_us":4504,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":994774,"threads_started":2}
W20260709 12:11:50.845230  4991 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.002s	sys 0.024s
W20260709 12:11:50.845582  4991 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.002s	sys 0.024s
I20260709 12:11:50.850109  5022 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:50.851868  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:50.815660 10370 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:50.854928  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:50.859638  5016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.019s	sys 0.004s
W20260709 12:11:50.859979  5016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.019s	sys 0.004s
I20260709 12:11:50.864336 10357 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:50.866988  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2742) took 2169 ms. Trace:
I20260709 12:11:50.867164  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2738) took 2219 ms. Trace:
I20260709 12:11:50.848371 10411 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:50.853217 10374 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:50.867412  5024 rpcz_store.cc:276] 0709 12:11:48.697324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.697448 (+   124us) service_pool.cc:224] Handling call
0709 12:11:48.697706 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.970589 (+272883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.970620 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.007798 (+ 37178us) log.cc:844] Serialized 26 byte log entry
0709 12:11:49.445734 (+437936us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:49.445772 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.445838 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.560643 (+1114805us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:50.864142 (+303499us) raft_consensus.cc:1685] finished
0709 12:11:50.864163 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.866929 (+  2766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5249,"raft.queue_time_us":257586,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":45109,"spinlock_wait_cycles":8174976,"thread_start_us":656103,"threads_started":2,"wal-append.queue_time_us":737226}
I20260709 12:11:50.870571 10357 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.871253 10411 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.873296 10193 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:50.876926 10350 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.868212  5016 rpcz_store.cc:276] 0709 12:11:48.648202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.656746 (+  8544us) service_pool.cc:224] Handling call
0709 12:11:48.657037 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:48.960318 (+303281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.960552 (+   234us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:48.971817 (+ 11265us) log.cc:844] Serialized 52 byte log entry
0709 12:11:49.415083 (+443266us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:50.319151 (+904068us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.563450 (+244299us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b48001c0158. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5f813aa1 00007f2a5f80ab37 00007f2a5f80a9ca 00007f2a5f90226f 00007f2a5f901f37 00007f2a5f91655c 00007f2a5f916508 00007f2a5f916488 00007f2a5f916443 00007f2a5f9156ec 00007f2a5e83fa96
0709 12:11:50.864206 (+300756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.864398 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:50.864442 (+    44us) raft_consensus.cc:1685] finished
0709 12:11:50.866963 (+  2521us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.867109 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59239,"prepare.queue_time_us":675860,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":245611,"raft.run_cpu_time_us":28963,"raft.run_wall_time_us":1720186,"spinlock_wait_cycles":102440832,"thread_start_us":2046918,"threads_started":4,"wal-append.queue_time_us":710185}
I20260709 12:11:50.900713 10276 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.878880  4991 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:50.881990 10390 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:50.883363 10344 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:50.883534 10166 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:50.886103  4875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39324 (request call id 3663) took 1169 ms. Trace:
I20260709 12:11:51.018617  4875 rpcz_store.cc:276] 0709 12:11:49.716777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.767720 (+ 50943us) service_pool.cc:224] Handling call
0709 12:11:50.885954 (+1118234us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b540031b0d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:50.886051 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412455296}
I20260709 12:11:50.888998 10382 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.894305  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:50.849764 10289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.018s	sys 0.019s
I20260709 12:11:50.894953  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.023813  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.868584 10071 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:50.880537 10353 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:50.930452  5019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.011s	sys 0.012s
W20260709 12:11:51.026754  5019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.016s	sys 0.013s
I20260709 12:11:51.001466 10319 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.993353  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:51.028929  5018 raft_consensus.cc:2393] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:51.001873  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:50.880227 10201 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:50.996696  4840 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:51.031533  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 100528us
I20260709 12:11:51.033200  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.033763  4867 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:51.034785  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.035368  4875 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:51.038765  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.039875  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.040453  4875 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
W20260709 12:11:50.967036 10272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.002s	sys 0.025s
W20260709 12:11:51.021620  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 142805us
I20260709 12:11:51.043880  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:51.025209  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:50.858419 10354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.040s
I20260709 12:11:51.027473  5601 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:50.997958 10144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.031s	sys 0.002s
W20260709 12:11:50.998021 10167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.003s	sys 0.023s
I20260709 12:11:51.023355 10350 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:51.019256 10020 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.016s	sys 0.054s
W20260709 12:11:51.023013 10289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.019s	sys 0.019s
I20260709 12:11:51.044740  5022 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
W20260709 12:11:51.045508  5021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.022s	sys 0.025s
I20260709 12:11:51.045887  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.017081 10344 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:51.049587  5604 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:51.053356  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.051110  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:51.017975 10381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.019s	sys 0.021s
I20260709 12:11:51.073312  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.020543  9947 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:50.997380  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:51.047045 10272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.002s	sys 0.025s
W20260709 12:11:51.045481 10354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.005s	sys 0.040s
W20260709 12:11:51.047631 10144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.032s	sys 0.002s
W20260709 12:11:51.027383 10311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.005s	sys 0.027s
W20260709 12:11:51.077167 10381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.019s	sys 0.021s
W20260709 12:11:51.086438 10311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.005s	sys 0.027s
I20260709 12:11:51.050601 10071 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.087101  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.073164  4868 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
W20260709 12:11:51.092876  5017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.003s	sys 0.039s
W20260709 12:11:51.093178  5017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.003s	sys 0.039s
I20260709 12:11:51.093976  4943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 3047) took 2083 ms. Trace:
I20260709 12:11:51.098011  4991 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:50.487851  5599 rpcz_store.cc:276] 0709 12:11:49.387095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.427965 (+ 40870us) service_pool.cc:224] Handling call
0709 12:11:49.428237 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.428423 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:49.861110 (+432687us) log.cc:844] Serialized 14 byte log entry
0709 12:11:50.487051 (+625941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:50.487098 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:50.487144 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.487200 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:50.487293 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3925,"prepare.queue_time_us":729633,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":1820,"thread_start_us":1042259,"threads_started":2}
I20260709 12:11:51.098619  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:51.106823  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:51.107403  4869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.020s	sys 0.027s
W20260709 12:11:51.074684  5021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.022s	sys 0.026s
W20260709 12:11:51.049629 10167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.003s	sys 0.024s
I20260709 12:11:51.042207 10270 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:51.077778  5024 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 9.
I20260709 12:11:51.115964  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.080099 10175 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.082543 10309 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.072230  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.117179  5022 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:51.082943 10344 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.077587  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.117962  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.118510  5022 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 8.
I20260709 12:11:51.118637  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:51.118856  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.119278  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.119493  5016 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:51.119853  5022 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:51.120551  5016 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.084331 10075 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:51.122536 10075 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:51.122947 10075 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.127385 10344 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.130220  5568 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.109503  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1327) took 1799 ms. Trace:
W20260709 12:11:51.109870  4869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.020s	sys 0.028s
W20260709 12:11:51.087893 10020 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.249s	user 0.016s	sys 0.055s
W20260709 12:11:51.073174  4945 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.007s	sys 0.026s
I20260709 12:11:51.120849  5022 raft_consensus.cc:1240] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.094362  4943 rpcz_store.cc:276] 0709 12:11:49.010852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.010965 (+   113us) service_pool.cc:224] Handling call
0709 12:11:49.011241 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.475974 (+1464733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.093752 (+617778us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400376754. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:51.093916 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3273940352}
I20260709 12:11:51.136631  5017 rpcz_store.cc:276] 0709 12:11:49.310448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.368402 (+ 57954us) service_pool.cc:224] Handling call
0709 12:11:49.368678 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.368880 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:49.912770 (+543890us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.109195 (+1196425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.109251 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:51.109296 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.109357 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.109454 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74165,"prepare.queue_time_us":704064,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":20157,"thread_start_us":1594817,"threads_started":2}
I20260709 12:11:51.137861  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.139511  5024 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:51.144399  4915 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:51.148221  5025 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:51.046700 10319 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.148160  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.114656  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:51.148837  4945 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.007s	sys 0.026s
I20260709 12:11:51.049805 10239 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:51.113319 10341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.010s	sys 0.028s
I20260709 12:11:51.163983  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:51.178179  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.181921 10276 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.175004  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.114163 10165 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:51.170814  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:51.188341  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.157758  4991 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.158514  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.181273  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:51.189462  5019 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:51.176841  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.195551  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.106253 10204 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 12:11:51.136561 10096 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:51.151834 10311 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:51.207654  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.165330 10345 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.108902 10396 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.198755  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.215839  5018 raft_consensus.cc:2376] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9. Re-sending same reply.
W20260709 12:11:51.185770 10341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.011s	sys 0.028s
W20260709 12:11:51.165549 10413 log.cc:927] Time spent T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:51.137527 10402 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:51.166250 10173 consensus_meta.cc:287] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.688s	user 0.008s	sys 0.001s
I20260709 12:11:51.198558 10265 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:51.195223 10360 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:51.203697 10409 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.113s	user 0.002s	sys 0.001s
I20260709 12:11:51.204928  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.205165 10166 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:51.196177  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.242622  5606 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:51.243870  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47765.4us
W20260709 12:11:51.206597  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.147529 10199 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.153669 10176 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:51.246471  5597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.049s	sys 0.046s
W20260709 12:11:51.246865  5597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.050s	sys 0.046s
I20260709 12:11:51.246364  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:51.192173  4991 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.165861 10167 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:51.175709 10411 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.178015 10309 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.210319  5023 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 10: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:51.167019 10270 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:51.177353 10382 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.153474 10412 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:51.211297  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:51.212147  4916 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.009s	sys 0.023s
I20260709 12:11:51.212580  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:51.211452  5570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.012s	sys 0.033s
I20260709 12:11:51.178606  9947 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.159633 10390 consensus_queue.cc:1059] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:11:51.152469  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.216699  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.288849  5018 raft_consensus.cc:1240] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.288992  5568 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:51.210242 10308 consensus_meta.cc:287] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.004s
I20260709 12:11:51.219589  5603 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:51.242759 10201 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:51.290791  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:51.246105 10199 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.247882 10298 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.209198 10311 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.214377 10345 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.217929 10396 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.168201 10075 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.229990  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:51.196343 10276 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:51.248335  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 56235.5us
I20260709 12:11:51.305249  5598 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:51.281534 10180 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:51.246908  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:51.316731  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 69900.3us
I20260709 12:11:51.261076  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:51.228439 10360 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.223515 10265 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.301079 10345 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.325531 10265 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:51.325814 10415 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:11:51.326939 10075 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.280903  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.327454 10272 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.327596  5023 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:51.327939 10272 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.328348 10272 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:51.283998  4916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.009s	sys 0.023s
W20260709 12:11:51.284308  5570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.012s	sys 0.033s
I20260709 12:11:51.283720  5025 raft_consensus.cc:2410] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:51.220638  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.291917  5603 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:51.329385  4915 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:51.293783 10199 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:51.298480 10298 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.257977 10167 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:51.229115 10173 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.249442 10353 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.307045  4991 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:51.247606  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 1562) took 1158 ms. Trace:
I20260709 12:11:51.342334  5597 rpcz_store.cc:276] 0709 12:11:50.089643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.093090 (+  3447us) service_pool.cc:224] Handling call
0709 12:11:50.093352 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.093542 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:11:50.517998 (+424456us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.247277 (+729279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.247332 (+    55us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:11:51.247383 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.247447 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.247555 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221124,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2724,"raft.queue_time_us":106,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":13566,"thread_start_us":1129027,"threads_started":2}
W20260709 12:11:51.319697 10367 consensus_meta.cc:287] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.000s
I20260709 12:11:51.344349  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.345252  4991 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:51.347229  4991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.283181 10412 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:51.293567 10309 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.258209 10341 consensus_queue.cc:1059] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:51.329088  4869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39318 (request call id 2499) took 1489 ms. Trace:
I20260709 12:11:51.355136  4869 rpcz_store.cc:276] 0709 12:11:49.839909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.493861 (+653952us) service_pool.cc:224] Handling call
0709 12:11:50.494134 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.494449 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.494475 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.494872 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.136883 (+642011us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:51.136928 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.136986 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.328898 (+191912us) raft_consensus.cc:1685] finished
0709 12:11:51.328917 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.329035 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":641580,"threads_started":1,"wal-append.queue_time_us":807280}
I20260709 12:11:51.262146 10166 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:51.329296  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 827775us
I20260709 12:11:51.329375 10360 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.332266  5023 raft_consensus.cc:1240] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:51.247979 10402 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.334156 10239 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:51.336897 10390 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:51.332296  9947 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:51.338183  5024 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:51.340050  5025 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:51.304378 10396 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.296562 10311 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.349220  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:51.349462  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:51.350158  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:51.377858  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:51.293136 10308 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.331517  4916 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:51.366561  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.368155  5602 raft_consensus.cc:2368] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12.
I20260709 12:11:51.282656 10400 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.370584  4871 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:11:51.370843  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:51.341848 10298 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:51.383620 10430 log.cc:927] Time spent T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:11:51.381659  4873 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.382105 10270 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.381719  9947 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.385712 10400 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.303184 10201 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.341145 10167 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:51.354501 10367 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:51.379305  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 47873.5us
I20260709 12:11:51.379540  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.353430 10075 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.329560 10180 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.387758  4916 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.388613  4870 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:51.389344  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.390952 10221 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.392596  4916 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.393324 10402 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.394354  4916 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.394547  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.395174  4876 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
I20260709 12:11:51.395669  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.396051 10402 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:51.399554 10422 log.cc:927] Time spent T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:11:51.380571 10411 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.363186 10382 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.354710 10412 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:51.363345 10204 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.381556 10390 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.401087  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:51.402007  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:51.369637 10166 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.370884 10239 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.418817  4916 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:51.415747  5604 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 15: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:51.415740  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.414780 10204 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:51.422318  4917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.015s	sys 0.019s
W20260709 12:11:51.422634  4917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.016s	sys 0.019s
W20260709 12:11:51.422909  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 967267us
I20260709 12:11:51.428565  4917 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.430780 10221 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:51.431166 10221 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.431481 10221 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.434049 10390 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:51.434604  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.418360 10411 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:51.435659 10341 consensus_queue.cc:1059] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:51.436432 10341 consensus_queue.cc:1059] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:51.437296 10341 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:51.438493 10341 raft_consensus.cc:3055] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:51.438822 10341 raft_consensus.cc:740] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:11:51.438958 10370 consensus_meta.cc:287] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.000s
I20260709 12:11:51.439357 10370 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.443655 10319 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.444998 10319 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:51.446053  9947 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.405480 10382 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.446609 10382 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.421401 10402 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:11:51.420989 10239 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.449733 10367 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.450304  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.450911  4871 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:51.451761  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:51.452466 10418 log.cc:927] Time spent T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:11:51.453615  5021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1322) took 2149 ms. Trace:
I20260709 12:11:51.453940  5021 rpcz_store.cc:276] 0709 12:11:49.303863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.340458 (+ 36595us) service_pool.cc:224] Handling call
0709 12:11:49.359836 (+ 19378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.770991 (+411155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:49.771030 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.785474 (+ 14444us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.108729 (+1323255us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:51.108765 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.108861 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.453428 (+344567us) raft_consensus.cc:1685] finished
0709 12:11:51.453447 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.453563 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25891,"raft.queue_time_us":68518,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4632,"thread_start_us":1514876,"threads_started":2,"wal-append.queue_time_us":1348978}
I20260709 12:11:51.455696  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.434552 10390 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:11:51.457844 10276 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.458259 10390 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:51.458774 10390 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:51.459066 10424 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:11:51.460042 10357 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:51.459638 10390 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.446698 10204 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.465744 10180 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.418818 10166 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.466920 10341 consensus_queue.cc:260] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.470638  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.451572 10223 raft_consensus.cc:3055] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:51.472337  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.475535  4873 raft_consensus.cc:2468] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:51.459488 10201 leader_election.cc:290] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.419899  9867 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:51.483177 10412 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.485525 10412 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.486815 10166 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.447316 10173 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.491586  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:51.496353  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:51.476040 10223 raft_consensus.cc:740] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:51.488260 10239 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.506088  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.509334  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.510310  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.510814  4868 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:51.511503  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:51.498812 10164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.019s	sys 0.019s
I20260709 12:11:51.523753  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:51.524296  4868 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.517942  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.489627  9867 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:51.525740  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.498539 10341 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.527983  4991 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.532531  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.499784 10308 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:51.530927 10164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.020s	sys 0.019s
I20260709 12:11:51.549762  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:51.522720 10180 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.563025  4990 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.482136 10298 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.563205  5604 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:51.568549  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:51.569655  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:51.570160  5604 raft_consensus.cc:3060] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.566099  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:51.572997  5606 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 10: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:51.525346 10427 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.580586  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:51.582600  5598 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.533195  9867 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.540664 10344 raft_consensus.cc:2804] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:51.540757 10166 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.636957  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:51.642818 10242 consensus_meta.cc:287] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.834s	user 0.006s	sys 0.003s
I20260709 12:11:51.624486 10411 raft_consensus.cc:2764] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:51.652900  5604 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:51.641968 10075 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:51.659853 10075 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.660230 10075 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:51.644141 10370 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.663609 10242 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.665606 10242 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.666549 10204 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.668521 10204 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.574945 10167 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.669365 10221 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.670388 10167 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.671273 10221 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.658182 10265 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.659199 10096 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:51.623605 10180 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.646610 10344 raft_consensus.cc:697] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:51.567269 10223 consensus_queue.cc:260] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.640070 10427 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.673017 10360 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.711262 10382 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.711110 10396 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:51.731972 10439 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:11:51.741603 10427 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.742918 10360 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.743077 10382 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:51.746076 10396 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:51.779821  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.780759  4842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.781800  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.784121  4870 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:11:51.785033  4841 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.016s
W20260709 12:11:51.785331  4945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.004s	sys 0.006s
W20260709 12:11:51.785504  4841 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.016s
W20260709 12:11:51.785733  4945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.004s	sys 0.006s
W20260709 12:11:51.786106  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 586793us
I20260709 12:11:51.787236  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 1157) took 1342 ms. Trace:
I20260709 12:11:51.787706  4945 rpcz_store.cc:276] 0709 12:11:50.445066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.445188 (+   122us) service_pool.cc:224] Handling call
0709 12:11:50.445441 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.445628 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:51.184537 (+738909us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.786500 (+601963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.786625 (+   125us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:51.786732 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.786853 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.787090 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":771333,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":1327023,"threads_started":2,"wal-append.queue_time_us":548791}
I20260709 12:11:51.790401  4873 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
W20260709 12:11:51.791098  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 145306us
W20260709 12:11:51.793318  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 369737us
I20260709 12:11:51.796762  4990 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:51.800258  4990 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:51.802151  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 373494us
W20260709 12:11:51.804026  5016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.016s	sys 0.025s
W20260709 12:11:51.804503  5016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.016s	sys 0.025s
I20260709 12:11:51.806483  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.807847  5019 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 22.
I20260709 12:11:51.803419  4917 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.809557  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.810449  5019 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:51.811705  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.818043  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2757) took 1359 ms. Trace:
I20260709 12:11:51.818538  5022 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
I20260709 12:11:51.819873 10020 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:51.820854 10020 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.822154  5570 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:51.829545  5025 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:51.679059 10199 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.839210 10360 raft_consensus.cc:3055] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:51.839769 10360 raft_consensus.cc:740] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:51.840369  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:51.831845  5600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.004s	sys 0.008s
W20260709 12:11:51.841149  5600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.004s	sys 0.008s
I20260709 12:11:51.841313  5017 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:51.849340 10400 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:51.796784  4916 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.840554 10204 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:51.830619  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 428996us
I20260709 12:11:51.689536 10223 raft_consensus.cc:3060] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.853837 10298 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.855464 10239 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.856442 10276 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.856983 10276 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.857452 10276 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.855155 10311 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.839382  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:51.866685 10199 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.868021 10265 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:51.824800 10020 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.828251  5570 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.825824 10144 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:51.884594  5604 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 16: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:51.884830  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:51.888298  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 77251.2us
W20260709 12:11:51.890195  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 90190.4us
I20260709 12:11:51.893157 10204 raft_consensus.cc:2804] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:51.893651 10360 consensus_queue.cc:260] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.893824 10204 raft_consensus.cc:697] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:51.897369 10427 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:51.898115  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:51.897986  5019 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:51.901077 10144 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.709918 10345 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.923189 10144 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.923370 10345 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:51.923696  5605 raft_consensus.cc:2368] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11.
I20260709 12:11:51.924028  4915 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:51.925058  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.925765  5019 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.902701  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.928843  5025 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.709256 10344 consensus_queue.cc:237] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.904759 10180 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.859179 10450 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:51.906235 10350 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.937064  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:51.937690 10350 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.939416 10311 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.939981 10350 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.908164 10161 raft_consensus.cc:3055] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:51.912276 10020 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:51.915575 10272 consensus_meta.cc:287] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 12:11:51.916404 10460 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:51.917258  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:51.915128  9867 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:51.818516  5020 rpcz_store.cc:276] 0709 12:11:50.458216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.131306 (+673090us) service_pool.cc:224] Handling call
0709 12:11:51.131562 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.131755 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:51.498205 (+366450us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.817274 (+319069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.817386 (+   112us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:51.817498 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.817620 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.817845 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":539243,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":681982,"threads_started":2,"wal-append.queue_time_us":242999}
I20260709 12:11:51.920964 10427 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:51.893085 10201 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:51.940928  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 51177.6us
I20260709 12:11:51.957851  5019 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:51.941846 10161 raft_consensus.cc:740] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:51.953428 10460 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.954198 10201 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.952872 10427 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:51.974359  5018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2761) took 1457 ms. Trace:
I20260709 12:11:51.972429  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:51.976595  5604 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 18: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:51.977191  9867 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:51.977954  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:51.978140  4871 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.979393  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:51.980145  5020 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.967967 10311 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.965643 10460 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.986817 10020 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:51.989533 10020 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:51.968619 10201 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:51.990353  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 193886us
I20260709 12:11:51.991350  4916 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:51.994612  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:51.995327  5604 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.997005 10411 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.001873 10412 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:52.003424  5604 raft_consensus.cc:2468] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:52.005935  4916 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.007637  4916 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.008839 10390 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:52.009632 10390 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.010322 10390 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:52.010754  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.011548  4841 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.012149  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.012595 10411 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:52.012933  5022 raft_consensus.cc:3060] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:52.013303  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 185301us
I20260709 12:11:52.015442  5570 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:51.954074 10272 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.018616 10341 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.019027 10341 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:52.019248 10272 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:52.019395 10341 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.019709  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.019848  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:52.020279  4869 raft_consensus.cc:2368] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 14. Current term is 15.
I20260709 12:11:52.021171 10434 raft_consensus.cc:2764] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:52.001902 10459 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.022701 10459 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.024066 10193 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:52.024662  5016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 2642) took 1596 ms. Trace:
I20260709 12:11:51.985235  5568 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.025893 10205 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:52.025069  5016 rpcz_store.cc:276] 0709 12:11:50.428835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.122011 (+693176us) service_pool.cc:224] Handling call
0709 12:11:51.191968 (+ 69957us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:51.196509 (+  4541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.196538 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.196959 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.805244 (+608285us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:51.805343 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.805433 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.805505 (+    72us) raft_consensus.cc:1685] finished
0709 12:11:51.805518 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.024383 (+218865us) spinlock_profiling.cc:243] Waited 69.6 ms on lock 0x7b5400260050. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:52.024598 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4227,"raft.queue_time_us":14296,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":2769,"spinlock_wait_cycles":160172416,"thread_start_us":585282,"threads_started":1,"wal-append.queue_time_us":535611}
I20260709 12:11:52.021049 10450 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:52.026259 10205 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:52.003574  5600 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 22: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:52.031315  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:52.032269  5025 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:52.045840  5022 raft_consensus.cc:2468] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:52.050678  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.053087  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.053704 10276 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.055160  5598 raft_consensus.cc:2468] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:52.055835 10276 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:52.057067 10020 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.057255 10180 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:11:52.057816 10180 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:52.058307 10180 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:11:52.057073  4868 consensus_meta.cc:287] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.007s
I20260709 12:11:52.059392  4868 raft_consensus.cc:2468] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:52.059793  4841 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.060663  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.061203 10057 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:52.061738 10057 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:52.057833 10020 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.049472  9867 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:11:52.062871 10057 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.065378  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.065208 10201 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.066270  4871 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:52.067625 10201 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:52.068660  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.069434  4871 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.062104 10205 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.070964  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:52.071296  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.073894  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.074252 10427 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.074678  4868 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 17: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:52.076436 10427 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:52.076990  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 103546us
I20260709 12:11:52.077332 10193 raft_consensus.cc:2804] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:52.077667 10020 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.078337  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.078730  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.008322 10204 consensus_queue.cc:237] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.079458  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.080185  4870 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.979213 10161 consensus_queue.cc:260] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.081939 10411 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.082635  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:52.082805  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.083377  5024 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:52.084403  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.107064  4990 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.107791  5024 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.071305 10205 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.110668 10459 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.111750  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:52.112356  5023 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
W20260709 12:11:52.113075  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 105575us
I20260709 12:11:52.113260  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54512 (request call id 1341) took 1497 ms. Trace:
I20260709 12:11:52.113656  5017 rpcz_store.cc:276] 0709 12:11:50.615939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.290081 (+674142us) service_pool.cc:224] Handling call
0709 12:11:51.290318 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.869424 (+579106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.112989 (+243565us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b540011eed4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:52.113194 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266003200}
I20260709 12:11:52.107376 10075 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.081925  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.117883  5024 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
W20260709 12:11:52.127482  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 67821.9us
I20260709 12:11:52.127847  5021 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 15: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:52.128083  5016 raft_consensus.cc:2393] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 16: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:52.115016  4990 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:51.974903  5018 rpcz_store.cc:276] 0709 12:11:50.516566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.289496 (+772930us) service_pool.cc:224] Handling call
0709 12:11:51.289736 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.289912 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:51.805445 (+515533us) log.cc:844] Serialized 14 byte log entry
0709 12:11:51.973761 (+168316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.973835 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:51.973945 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.974039 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.974192 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3898,"prepare.queue_time_us":381309,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":9196,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":103,"thread_start_us":649096,"threads_started":2,"wal-append.queue_time_us":156048}
I20260709 12:11:52.084522  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:52.132105  5020 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:52.140707  5025 raft_consensus.cc:2368] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
W20260709 12:11:52.149026  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 147866us
I20260709 12:11:52.149943  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.157156  4916 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:52.162830 10344 raft_consensus.cc:2804] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.163784  5022 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:52.167883  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.168658  4872 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.170712  4867 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:52.171859  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.173022 10020 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:52.174576 10020 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:52.174808  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:52.177131 10344 raft_consensus.cc:697] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:52.177229 10096 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.178210 10344 consensus_queue.cc:237] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:52.179684  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 64842.5us
I20260709 12:11:52.180630 10441 raft_consensus.cc:2804] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.181288 10441 raft_consensus.cc:697] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:52.182292 10441 consensus_queue.cc:237] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.183830 10180 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.177153  4872 raft_consensus.cc:2410] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:11:52.189441  4871 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:52.172559  4867 raft_consensus.cc:3060] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.138178 10193 raft_consensus.cc:697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:52.186055  4873 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 22.
I20260709 12:11:52.156957 10201 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:52.190795  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.197615  5016 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:52.199016  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.200821  5025 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:11:52.205538  4874 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:52.197392 10201 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.216782  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:52.219683  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 90112.7us
I20260709 12:11:52.222223  5016 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 15: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:52.213604 10201 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:11:52.226464  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 78292.1us
I20260709 12:11:52.227236 10223 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:52.227826 10476 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.228492 10319 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.229009 10319 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.231475 10319 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:52.233590  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 60873.8us
I20260709 12:11:52.234396  4841 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:52.236905  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.243089  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.246176  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.246853  4875 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.232582  4872 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:52.249258  5605 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1571) took 1003 ms. Trace:
I20260709 12:11:52.249600  5605 rpcz_store.cc:276] 0709 12:11:51.245654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.245765 (+   111us) service_pool.cc:224] Handling call
0709 12:11:52.249034 (+1003269us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54008efdd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:52.249194 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542700288}
I20260709 12:11:52.251748 10221 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:52.252274 10221 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:52.252784  4867 raft_consensus.cc:2468] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:52.253750  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.254477  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.255151  4945 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:52.255705  4942 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:52.255936 10360 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.199801 10341 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.244565  4840 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.265436  5023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2767) took 1098 ms. Trace:
I20260709 12:11:52.266443  4872 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:52.268930  4915 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.272753  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.273514  4944 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 21.
I20260709 12:11:52.275322 10476 raft_consensus.cc:2804] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:52.252972 10390 consensus_queue.cc:1059] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:11:52.276981 10390 raft_consensus.cc:3055] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:52.277381 10390 raft_consensus.cc:740] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:52.278272 10390 consensus_queue.cc:260] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.279476 10390 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.280050 10193 consensus_queue.cc:237] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.224192 10239 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:52.281217 10239 raft_consensus.cc:697] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:52.282780 10239 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.275854 10476 raft_consensus.cc:697] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:52.288725 10476 consensus_queue.cc:237] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.293910 10221 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.303182  4868 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.304829  4870 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:52.265815  5023 rpcz_store.cc:276] 0709 12:11:51.159170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.112985 (+953815us) service_pool.cc:224] Handling call
0709 12:11:52.113390 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.113702 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:52.113983 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.257193 (+143210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.257236 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:52.257304 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.257359 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.257449 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1975,"prepare.queue_time_us":132,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":5101,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":63,"thread_start_us":107080,"threads_started":1}
W20260709 12:11:52.339417  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 70054.1us
I20260709 12:11:52.223671 10460 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.345634  5568 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:52.354689  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 87190.6us
I20260709 12:11:52.275671 10201 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.339186 10223 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:52.368245  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:52.371004  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.379773  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.364609 10180 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.394454  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.395195  4945 raft_consensus.cc:2368] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:11:52.391578  5568 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.392412  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.404580  4840 leader_election.cc:400] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
I20260709 12:11:52.405073  4840 leader_election.cc:403] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.398041 10434 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.427429  4944 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 15: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:52.434441  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.436028 10144 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:52.436671 10176 consensus_queue.cc:1059] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:11:52.436045  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.440866  4948 raft_consensus.cc:2410] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:11:52.444062 10161 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.445459  4943 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:52.430424  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:52.448662  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 90127.3us
I20260709 12:11:52.408367 10075 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.425938 10311 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:52.405709 10276 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:52.464007  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55722 (request call id 2661) took 1143 ms. Trace:
I20260709 12:11:52.429356 10434 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.453229 10311 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:52.464749  5605 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:52.432744 10459 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.465837  4991 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.476032  4875 raft_consensus.cc:2468] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
W20260709 12:11:52.481231  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 123334us
I20260709 12:11:52.454007 10298 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 9. Current term is 10.
I20260709 12:11:52.502951  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:52.506629  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 56702.2us
W20260709 12:11:52.510330  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 131890us
I20260709 12:11:52.506702  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.513029  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.513686  5019 raft_consensus.cc:2368] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8.
I20260709 12:11:52.512770  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.509393  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:52.512259  4991 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.511636  5022 raft_consensus.cc:1240] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:52.484018  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:52.518790  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.502702 10341 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.517634  5016 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:52.504608 10020 raft_consensus.cc:2764] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:11:52.501736 10434 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:52.551425  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 126340us
I20260709 12:11:52.552085  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:52.518961  4867 raft_consensus.cc:606] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:52.474869 10319 consensus_queue.cc:1059] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:11:52.522257  4945 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:52.556504  4867 raft_consensus.cc:614] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:52.555027  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 50763.4us
I20260709 12:11:52.559623  4944 raft_consensus.cc:2410] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:11:52.561509  5018 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:52.523816 10441 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:52.512749 10205 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:11:52.574155 10488 log.cc:927] Time spent T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:11:52.575132 10173 consensus_queue.cc:1059] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:11:52.577073 10265 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.577589 10265 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:52.578990  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:52.579134  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 57377.8us
W20260709 12:11:52.581245  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 59302.9us
I20260709 12:11:52.557150 10460 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.588340  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.588930  5018 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.579267 10459 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.554168 10223 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:52.597390  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.584789 10144 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.605157 10144 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.593403 10173 consensus_queue.cc:1243] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer baa50eb5ed704004b7f391934a59d010 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:52.607343 10144 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:52.607849 10460 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:52.588891 10311 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.611449  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:52.611996  4867 raft_consensus.cc:606] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:52.612294  4867 raft_consensus.cc:614] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:52.600766 10319 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:52.613343 10319 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:52.614302 10451 log.cc:927] Time spent T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:11:52.615157  4867 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:52.615723  4867 raft_consensus.cc:606] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:52.616050  4867 raft_consensus.cc:614] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:52.614326 10319 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.578510 10265 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.619316 10319 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:52.588351 10476 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:52.620079 10476 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.621234 10309 raft_consensus.cc:3055] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:52.621655 10309 raft_consensus.cc:740] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:52.622088 10476 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.622586 10309 consensus_queue.cc:260] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.600714  4915 leader_election.cc:400] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8.
I20260709 12:11:52.625041  4915 leader_election.cc:403] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.604537  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.627712  5605 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:52.592636 10459 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.621321  4841 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:52.602087 10205 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.635233  5018 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:52.632005  5025 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:52.641551  4990 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.644344 10390 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:11:52.644881 10476 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:52.645262 10491 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:52.649660  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.650249  4946 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:52.651345 10489 log.cc:927] Time spent T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:11:52.652125  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.648520  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.652872 10223 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.653743  4947 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:52.656025  5016 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 12:11:52.641139 10438 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:52.657823 10438 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.658886 10457 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:52.659878 10457 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:52.660269 10457 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:52.661232 10457 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.662070 10345 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:52.662405 10457 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.663069  4915 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.662742 10434 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:52.665992  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.665117  4945 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:52.664947 10075 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.663790 10161 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:52.668550 10075 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.669288 10161 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:52.670629 10075 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.670316 10161 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.659934 10438 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:52.675259 10434 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:52.655646 10205 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.650175  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.687733  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:52.689126  5018 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 22.
I20260709 12:11:52.628974 10459 raft_consensus.cc:3060] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.691774  4946 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:52.692106  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.662561 10345 raft_consensus.cc:697] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:52.703667  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 99216.3us
I20260709 12:11:52.704418  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.705089  4948 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:52.706099  4917 leader_election.cc:400] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 14. Current term is 15.
I20260709 12:11:52.706386  4917 leader_election.cc:403] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.707170 10390 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.707916 10390 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.709522  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.710068  4948 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:52.710860  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.711510  4942 raft_consensus.cc:2368] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:11:52.712201  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.713032  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.713233  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.713701  4949 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:52.714111  4946 raft_consensus.cc:2410] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:11:52.714581  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.714946  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.715569  4946 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 21.
I20260709 12:11:52.715653  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.660270 10270 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:52.653488  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.728250  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.728797 10205 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:52.729053  4988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.66:43473 timed out after 2.162s (SENT) [suppressed 40 similar messages]
I20260709 12:11:52.730196  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:52.730671  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 128932us
I20260709 12:11:52.731297  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.730615  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.737286  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.736250  4948 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:52.739096  4947 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 15: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:52.692277 10434 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:52.739771  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.741569  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.753424  5604 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 17: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:52.753710  4946 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:52.733398 10459 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.754323  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.755053  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.756201  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.754479  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:52.759830  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:52.759882  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:52.761895 10502 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.121s	user 0.000s	sys 0.004s
I20260709 12:11:52.763013 10205 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:11:52.763402 10205 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.763751 10205 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:11:52.764215  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.764936  5603 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 17: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:52.765810  5600 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:52.751457 10441 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:52.766637  5025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:52.739794 10311 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:52.768061  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.787608  5022 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.768589  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:52.767953  5602 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:11:52.793947  4949 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 17: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:52.809299  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.811000 10390 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 14. Current term is 15.
I20260709 12:11:52.480921  5017 rpcz_store.cc:276] 0709 12:11:51.320521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.114589 (+794068us) service_pool.cc:224] Handling call
0709 12:11:52.114987 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.139539 (+ 24552us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:52.185146 (+ 45607us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.463702 (+278556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:52.463745 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:52.463788 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.463844 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.463942 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55575,"prepare.queue_time_us":34763,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":2396,"raft.queue_time_us":8389,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":11307,"thread_start_us":271275,"threads_started":1}
I20260709 12:11:52.761917 10345 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.759647 10434 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.814582  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.815341  5604 raft_consensus.cc:2410] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:11:52.815806 10434 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:52.820140  4871 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:52.816211 10441 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.757078 10503 consensus_queue.cc:1059] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:11:52.822731  5598 raft_consensus.cc:3055] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:52.887781  5598 raft_consensus.cc:740] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:52.877013  5020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2770) took 1407 ms. Trace:
I20260709 12:11:52.852352  4942 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:52.877601  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:52.874131  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.854108  5022 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:52.840307  5603 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:52.891772  5018 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 22.
I20260709 12:11:52.841197  4876 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:52.894855 10199 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:52.895391 10199 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.898093 10199 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:52.857210  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.888736  5020 rpcz_store.cc:276] 0709 12:11:51.469592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.139830 (+670238us) service_pool.cc:224] Handling call
0709 12:11:52.193172 (+ 53342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:52.223313 (+ 30141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.223341 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:52.298322 (+ 74981us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.514237 (+215915us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:52.514273 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.514332 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.767358 (+253026us) raft_consensus.cc:1685] finished
0709 12:11:52.767377 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.876950 (+109573us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6915,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":159960,"threads_started":1,"wal-append.queue_time_us":300742}
I20260709 12:11:52.904280  4870 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
W20260709 12:11:52.907124  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 167649us
W20260709 12:11:52.877113 10515 log.cc:927] Time spent T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:11:52.904631  4870 pending_rounds.cc:85] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 9
I20260709 12:11:52.912482  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.913185  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:52.919121  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.908932  4870 pending_rounds.cc:107] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:11:52.919695  4876 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.919713  4870 raft_consensus.cc:2889] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:52.921335  5020 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:52.915894  5598 consensus_queue.cc:260] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.797531 10311 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.926743  5605 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.927645  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:52.928391  5603 raft_consensus.cc:2410] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:11:52.929226  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.932255  5603 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:52.931599 10311 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:52.929908  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:52.899825 10205 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.935079  5605 raft_consensus.cc:2410] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:52.936301  5598 raft_consensus.cc:3060] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:52.939946  5599 raft_consensus.cc:2368] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8.
I20260709 12:11:52.940258  4841 leader_election.cc:400] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11.
I20260709 12:11:52.940909  4841 leader_election.cc:403] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.942849  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.923132 10476 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8.
I20260709 12:11:52.944363  4949 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.944449  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.941663  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:52.947165  4870 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:52.946508  4869 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:52.954018  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:52.954165 10459 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:52.945262 10360 consensus_meta.cc:287] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.000s
I20260709 12:11:52.955180 10360 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:52.957314  4948 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:52.956414  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:52.958273  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.958886  4950 raft_consensus.cc:2468] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:52.958673 10020 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:52.959411 10020 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:52.959802 10020 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.959865  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:52.960713  4943 raft_consensus.cc:2410] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:52.960744  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:52.962719 10205 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 23 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:52.962577 10221 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:52.963966 10221 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:52.964473 10165 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:52.964854 10221 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.965329 10357 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:52.966668 10357 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:52.968017  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.968401  4839 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.969064  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.969184 10223 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.970328  5018 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:52.971022  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 47561.7us
I20260709 12:11:52.971786  5570 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:52.973173 10457 raft_consensus.cc:2804] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:52.973666 10457 raft_consensus.cc:697] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:52.974575  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.944821 10164 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.974475 10457 consensus_queue.cc:237] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.975171 10164 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:52.975986  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.976735  5599 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 15: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:52.969413  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:52.970265  4869 raft_consensus.cc:1240] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:52.977375  4839 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:52.973129  5570 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:52.935590 10161 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:52.983507  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:52.984125  4946 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:52.985489  5022 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:52.990561  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.991089  4876 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:52.991603  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:52.991957  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.992699  4876 raft_consensus.cc:2393] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 16: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:52.993039  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:52.993599  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:52.977303 10164 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:52.997483  4839 leader_election.cc:400] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:11:52.987963  4951 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:53.000366  4839 leader_election.cc:403] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.997418 10020 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.997953 10360 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.999665  4946 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:53.002333  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.003252  4945 raft_consensus.cc:2468] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 4.
I20260709 12:11:53.005007  4873 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:11:52.945055 10270 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11.
I20260709 12:11:53.007238 10360 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:52.998931 10319 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:53.007074  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:53.009567  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.011739  4870 raft_consensus.cc:1240] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:53.019136  4873 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:53.021639  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:52.998328 10501 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:53.000213 10223 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.029238  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.031860  5598 raft_consensus.cc:1275] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:53.023495 10501 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:53.033144 10501 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.037096  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.037680  4947 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:53.037815 10020 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:53.039021  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.033681  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.042351  4951 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
W20260709 12:11:53.045086  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 47717.7us
I20260709 12:11:53.047727  4949 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:53.048576  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:53.049808 10193 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:11:53.053695 10360 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:53.010802 10319 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.055931  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:53.056574  5598 raft_consensus.cc:2368] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 22. Current term is 23.
I20260709 12:11:53.017841 10270 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 12. Current term is 13.
I20260709 12:11:53.057772  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.055449  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:53.060922  4946 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:53.062067  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:53.062888  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.065212  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.065917  4949 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 17: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:53.067564  5598 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:53.068343  5025 raft_consensus.cc:606] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:53.058113 10319 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.070220  4944 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:53.073462  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.023351 10161 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:53.074081  5603 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:11:53.075698  4873 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:53.077605  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.031625 10223 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.159518 10223 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:53.162375 10512 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:11:53.164399  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.165239  4946 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:53.166033  4869 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 13: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:53.247258  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:53.247859  4871 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:53.265133 10501 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:53.246070  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:53.267120  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:53.267210 10501 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:53.267786  4874 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 17: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:53.264716  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.269104  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.269438  5603 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:53.269872  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.268730  4874 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:53.271492  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.272572  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.273109  4942 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:53.273810  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.274729  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:53.275099  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.277357  4947 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:53.278280  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.278677  4874 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:53.279316  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.280010  4947 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:53.282998  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.283806  4946 raft_consensus.cc:2410] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:11:53.262593  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.271051  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.280689  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.284745  4942 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:53.284552  4949 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:53.284791  4944 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:53.326397  4947 raft_consensus.cc:2393] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 9: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
W20260709 12:11:53.330224  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.330919  4871 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 19.
I20260709 12:11:53.358408  4873 raft_consensus.cc:1240] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:53.363479  4868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3689) took 1189 ms. Trace:
I20260709 12:11:53.371038  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.371889  4947 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:53.373436 10161 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:53.375335  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.363857  4868 rpcz_store.cc:276] 0709 12:11:52.138797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.138916 (+   119us) service_pool.cc:224] Handling call
0709 12:11:52.159857 (+ 20941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.303534 (+143677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.327859 (+1024325us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002fc454. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:53.328017 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329227648}
I20260709 12:11:53.389263  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.390096  4950 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 17: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:53.390801  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.391507  5604 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:53.392349  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:53.396178  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.399223  4950 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:53.403137  5604 raft_consensus.cc:2393] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 16: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:53.407195  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.416011  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.416999  5604 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 8.
I20260709 12:11:53.417572  4946 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:53.425077  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.425798  4946 raft_consensus.cc:2410] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:11:53.426484  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.427415  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.428364  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.429863  4839 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:53.430758  4839 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:53.432044  4839 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:11:53.432435  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.432996 10221 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.433416 10221 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:53.433780 10221 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.436180 10501 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.437340 10270 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:11:53.435740  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.435818  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:53.438639  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.438871 10501 raft_consensus.cc:2764] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:11:53.438102  4946 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:53.443076  4839 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.437726 10270 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:53.450889  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:53.441752  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.454486  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.455312  4947 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 13: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:53.439309 10450 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:53.462260 10201 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:53.462886  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.455684  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.464216  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.466073  4945 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:53.466209  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:53.468101  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.469089  4946 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:53.474327  5599 raft_consensus.cc:2410] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:11:53.474917  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.478408  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.480384  4947 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:53.455986 10270 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:11:53.474090 10223 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.498927  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.501797  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:53.479717 10501 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.503962  5599 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:53.502985 10180 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:11:53.521452  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:53.518319  4990 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:53.523011  4872 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 22.
I20260709 12:11:53.511049  5601 raft_consensus.cc:1240] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:53.476657 10450 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.521035  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:53.509837  4868 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4428def03fb45c99d3538acc2628494"
dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:34864
I20260709 12:11:53.509016  4839 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:53.548046  4868 raft_consensus.cc:606] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:53.549427  4868 raft_consensus.cc:614] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:53.551348  4950 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:53.551755  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.525353  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:53.560621  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.552448  4947 raft_consensus.cc:2376] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13. Re-sending same reply.
W20260709 12:11:53.560973  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 63670.9us
I20260709 12:11:53.561823  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.506191 10360 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:53.562352  4947 raft_consensus.cc:2376] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15. Re-sending same reply.
I20260709 12:11:53.523691 10173 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:53.547905 10441 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:53.552337  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.566720  4950 raft_consensus.cc:2393] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 15: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:53.564052  4916 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:53.505550 10223 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:53.518527 10199 consensus_queue.cc:1048] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:11:53.567585  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.572346  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.569871  4945 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:53.576745  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:53.568681 10265 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:53.577752 10265 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.578125 10265 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:53.578375 10527 log.cc:927] Time spent T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:53.580309  5606 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:11:53.580664  5606 pending_rounds.cc:85] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 9
I20260709 12:11:53.580915  5606 pending_rounds.cc:107] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:11:53.581147  5606 raft_consensus.cc:2889] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:53.582257 10433 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:53.582644 10525 log.cc:927] Time spent T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:53.585956 10265 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.590914 10265 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:53.582669 10433 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.592850 10433 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.593503  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:53.595170  4872 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:53.596256  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:53.596915 10501 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:11:53.597405 10501 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 22 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:53.581039  5597 raft_consensus.cc:1275] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:53.600885  4875 raft_consensus.cc:1275] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:53.598296 10501 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.602406  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:53.603086  4868 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 10: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:11:53.603873  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 48472.2us
I20260709 12:11:53.561985 10057 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.604583  4916 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.605062  5599 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.524103 10319 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.568888 10441 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:53.611230 10433 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.612052  5601 raft_consensus.cc:1275] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:53.619519  4916 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.621160  5605 raft_consensus.cc:2393] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:53.632551 10276 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.617568 10441 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.635111  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:53.617867 10161 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.634133 10272 raft_consensus.cc:3055] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:53.620221 10450 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:53.640259 10272 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:53.643914  4947 raft_consensus.cc:1240] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:11:53.656026 10270 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:53.658174 10221 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.660610 10221 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:53.664990 10272 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.666047 10309 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.666268 10270 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:53.665949 10272 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.680002  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:11:53.681658  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 59859.9us
W20260709 12:11:53.685599  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.686976  5568 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.688794 10390 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:53.689317  4950 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:53.697702  4916 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.713461  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:53.729302  4950 raft_consensus.cc:3055] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:53.729740  4950 raft_consensus.cc:740] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:53.736271  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:53.738679  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 221286us
I20260709 12:11:53.738794  4942 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:53.742283  5024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2768) took 2342 ms. Trace:
W20260709 12:11:53.744053  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 56691.8us
I20260709 12:11:53.727262 10199 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:53.742660  5024 rpcz_store.cc:276] 0709 12:11:51.393746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.129545 (+735799us) service_pool.cc:224] Handling call
0709 12:11:52.168288 (+ 38743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.168678 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:52.201099 (+ 32421us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.650746 (+449647us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:53.715634 (+1064888us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b18001dbfc0. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a5a4924bc 00007f2a577e048b 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a23a
0709 12:11:53.735607 (+ 19973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:53.735666 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:53.735715 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.735777 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:53.735889 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131757,"prepare.queue_time_us":47139,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"spinlock_wait_cycles":24938752,"thread_start_us":137974,"threads_started":1,"wal-append.queue_time_us":200130,"wal-append.run_cpu_time_us":3154,"wal-append.run_wall_time_us":1239991}
I20260709 12:11:53.734272 10164 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.739996  4950 consensus_queue.cc:260] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:53.753907  4950 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.765323  4916 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.747014  5567 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:53.744411 10450 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:53.772287  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 177971us
I20260709 12:11:53.745929 10223 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:53.753259 10319 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:53.779100  5567 leader_election.cc:304] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.773732 10276 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:53.773895 10311 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:53.796917 10276 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:53.788441 10265 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:53.767197 10199 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:53.798699  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 70506.7us
I20260709 12:11:53.792007 10223 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:53.838645  4950 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:11:53.853416  4950 pending_rounds.cc:85] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 7
I20260709 12:11:53.853732  4950 pending_rounds.cc:107] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:11:53.854173  4950 raft_consensus.cc:2889] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:53.854364  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 75296.7us
W20260709 12:11:53.798663  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 53988.8us
I20260709 12:11:53.787333 10221 consensus_queue.cc:1059] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:11:53.857373  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 80591.2us
I20260709 12:11:53.775483  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:53.803105 10311 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:53.857384  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 290538us
I20260709 12:11:53.856598  4916 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:11:53.841389 10534 log.cc:927] Time spent T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:11:53.803910 10433 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:53.865567  5567 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:53.804070 10319 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:53.805181 10276 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:53.878132  4948 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:53.803254 10057 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:53.886946  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:53.888125 10535 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:11:53.871662 10531 log.cc:927] Time spent T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:11:53.872232 10529 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:11:53.863171 10311 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:53.893415  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.853194 10265 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:53.899202  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:53.902254  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.873564 10201 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:53.889026 10530 log.cc:927] Time spent T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:11:53.880762 10164 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.869942 10319 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:53.907612  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:53.909055  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.904904 10532 log.cc:927] Time spent T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:11:53.901167 10221 consensus_queue.cc:1243] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer baa50eb5ed704004b7f391934a59d010 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:53.899273 10173 consensus_queue.cc:1059] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:53.934051 10309 raft_consensus.cc:3055] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:53.934532 10193 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.939587  4916 leader_election.cc:400] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 7 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 7. Current term is 8.
I20260709 12:11:53.913291 10319 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:53.940395  4916 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:53.946048  4869 raft_consensus.cc:3055] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:53.946417  4869 raft_consensus.cc:740] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:11:53.950632 10536 log.cc:927] Time spent T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 12:11:53.955430  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 68613.2us
I20260709 12:11:53.940376 10309 raft_consensus.cc:740] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:53.943740 10164 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:53.960927  4916 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:53.964756 10544 log.cc:927] Time spent T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:53.965159  4988 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:53.951828 10540 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.944413 10476 consensus_queue.cc:1059] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:11:53.956717  4869 consensus_queue.cc:260] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:53.949337 10433 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:53.970177  4869 raft_consensus.cc:3060] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:53.974632  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 110862us
I20260709 12:11:53.946488 10193 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:53.993098  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 99499us
I20260709 12:11:53.969717 10161 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:53.943742 10057 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:53.981092 10165 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:53.993785  5567 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:53.981361 10265 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:54.000201  5567 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
W20260709 12:11:54.002841  5570 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.012672  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 50917.6us
I20260709 12:11:53.998678 10161 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:53.981283 10441 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.010051 10450 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:54.017892  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 52823.6us
I20260709 12:11:54.016680 10548 consensus_queue.cc:1048] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:11:54.028406  4876 raft_consensus.cc:1240] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:54.028970  4774 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 8 to 9, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 9 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:54.030141  4772 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 345) took 11458 ms (client timeout 15000 ms). Trace:
I20260709 12:11:54.013130 10199 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.014192 10201 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:54.037170  5603 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 18. Current term is 19. Ops: []
I20260709 12:11:54.016865 10161 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.032186  5598 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:54.011577 10265 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:11:54.041770  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:54.042462  5602 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:54.033357 10450 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:54.014556 10309 consensus_queue.cc:260] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.047487  4839 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:54.050418  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 49049.4us
I20260709 12:11:54.002122 10549 consensus_queue.cc:1048] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:54.038405 10201 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:54.055634  5598 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:11:54.056025 10309 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:54.056592 10180 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.057281  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.090492  4874 raft_consensus.cc:1240] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:11:54.059092  4774 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 8 to 9, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 9 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.063510 10193 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.069079 10165 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:54.069887  4872 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 21. Current term is 22. Ops: []
I20260709 12:11:54.070464  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:54.071631  5570 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:54.071735  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.072142 10173 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:54.107537  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 50324.6us
I20260709 12:11:54.112170  4868 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:54.112547  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:54.113159  5022 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:54.073235  5024 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:54.077323 10553 raft_consensus.cc:3055] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:54.112097  5570 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.078107  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:54.079454  4876 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:54.080102  5598 pending_rounds.cc:85] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 11
I20260709 12:11:54.042428 10199 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.090080  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:54.097927  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:54.051731 10450 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.096959  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:54.107339  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:54.109279  5021 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:54.107589  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:54.077600  4988 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:54.121163  4841 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.121189  5598 pending_rounds.cc:107] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:11:54.127812  5598 raft_consensus.cc:2889] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.123239  5602 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.123827  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:54.081010 10201 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:54.132350  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.109211  4774 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.143818  5018 raft_consensus.cc:1240] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:54.144268  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 72589.2us
I20260709 12:11:54.149566  5016 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:11:54.125857 10547 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:11:54.155545  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 43510.8us
I20260709 12:11:54.157968  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:54.159361  4774 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 13 to 15, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 15 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:54.119180 10553 raft_consensus.cc:740] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:54.124475 10223 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.162618  4839 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:54.160590  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.164274  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:54.169724 10563 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.122028 10390 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.175980  4876 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:11:54.175307  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:54.179772  4870 raft_consensus.cc:1240] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:54.179774  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 58694.5us
W20260709 12:11:54.180502  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 102969us
I20260709 12:11:54.127085 10057 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.180868  4873 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:54.155902 10193 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:54.155377 10555 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:54.181422  4988 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:54.180347  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:54.186987  4841 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.174530  4774 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:54.175773  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:54.164531 10550 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:54.165258  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 65344.9us
I20260709 12:11:54.125089 10551 consensus_queue.cc:1059] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:11:54.178574  4872 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:54.166626 10542 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.190739  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:54.165611 10501 consensus_queue.cc:1059] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:11:54.187947  4868 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.196440  4774 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 11 to 13, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 13 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.184412 10565 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:54.201269  4988 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.157805 10270 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 12:11:54.035041  4772 rpcz_store.cc:269] 0709 12:11:42.533238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.543984 (+ 10746us) service_pool.cc:224] Handling call
0709 12:11:53.988870 (+11444886us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:50.250816 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:50.349939 (+ 99123us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:50.349974 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:11:50.349991 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:50.350826 (+   835us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:50.350880 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:50.350905 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:50.351444 (+   539us) tablet.cc:701] Row locks acquired
0709 12:11:50.351459 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:11:50.351600 (+   141us) write_op.cc:270] Start()
0709 12:11:50.351720 (+   120us) write_op.cc:276] Timestamp: P: 1783599110351553 usec, L: 0
0709 12:11:50.351739 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:11:50.352298 (+   559us) log.cc:844] Serialized 2819 byte log entry
0709 12:11:51.398665 (+1046367us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:51.740210 (+341545us) op_driver.cc:464] REPLICATION: finished
0709 12:11:51.747446 (+  7236us) write_op.cc:301] APPLY: starting
0709 12:11:51.747562 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:51.753507 (+  5945us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:51.753534 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:52.107495 (+353961us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:52.107793 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:11:52.107851 (+    58us) write_op.cc:312] APPLY: finished
0709 12:11:52.108346 (+   495us) log.cc:844] Serialized 73 byte log entry
0709 12:11:52.108541 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:52.108717 (+   176us) write_op.cc:454] Released schema lock
0709 12:11:52.108790 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:52.439047 (+330257us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b5400298a28. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a60ca69e1 00007f2a60ca564c 00007f2a5e3363fd 00007f2a5e322389 00007f2a5e321b53 00007f2a5e325d61 00007f2a5e325d19 00007f2a5e325ca9 00007f2a5e325c71 00007f2a5e324e9d 0000000000388634
0709 12:11:52.439630 (+   583us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:52.439663 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":879861,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":6976,"apply.run_cpu_time_us":15520,"apply.run_wall_time_us":692125,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33373,"num_ops":7,"prepare.queue_time_us":854878,"prepare.run_cpu_time_us":40892,"prepare.run_wall_time_us":848574,"raft.queue_time_us":339469,"raft.run_cpu_time_us":863,"raft.run_wall_time_us":10455,"replication_time_us":1388319,"spinlock_wait_cycles":20134784,"thread_start_us":1676563,"threads_started":4,"wal-append.queue_time_us":852590,"wal-append.run_cpu_time_us":22417,"wal-append.run_wall_time_us":2057465}]]}
I20260709 12:11:54.182734 10345 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.153476 10199 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.171005 10221 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:54.179687 10552 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.170249 10563 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.173345 10223 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.195647 10193 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:54.197747 10180 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.259778  4869 raft_consensus.cc:1275] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:11:54.204500 10433 raft_consensus.cc:476] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:54.268689  4869 pending_rounds.cc:85] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 11
I20260709 12:11:54.270258  4869 pending_rounds.cc:107] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:11:54.270502  4869 raft_consensus.cc:2889] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:54.270454  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 89368.4us
I20260709 12:11:54.272574  5017 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:54.273901  4841 leader_election.cc:400] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 22. Current term is 23.
I20260709 12:11:54.269302  4774 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 7 to 9, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:54.275244  4841 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:54.276924  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 104332us
W20260709 12:11:54.280915  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 95196.9us
I20260709 12:11:54.276523  4841 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:54.283442  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.284566  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.286532  4868 raft_consensus.cc:2468] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:54.281673  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.264850 10565 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:54.196172 10555 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.294006  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.294629  4945 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.294170  4774 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 12 to 13, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 13 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
W20260709 12:11:54.278333 10545 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:11:54.289954  4841 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:54.290690  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 87962us
I20260709 12:11:54.230346 10311 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.289574  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.295725  4917 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.242955 10276 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.297361  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.301895  4951 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.302453 10311 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:54.303009 10276 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.298645  4946 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:54.303028 10311 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:54.304721  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.306135  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.307440  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.308779  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:54.309103  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.310338  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.311017  4946 raft_consensus.cc:2393] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:54.312037  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.313318  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.314958  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.315636  4947 raft_consensus.cc:2393] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 17: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:54.315541  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.316583  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.317934  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.280145 10501 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.323403  4944 raft_consensus.cc:1275] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:11:54.323611  4945 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:54.323859  4944 pending_rounds.cc:85] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 13
I20260709 12:11:54.324594  4944 pending_rounds.cc:107] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:11:54.324930  4944 raft_consensus.cc:2889] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.325148  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:54.325582  4951 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 18.
I20260709 12:11:54.326797  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.267714 10569 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:11:54.288326 10476 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:54.330464  4949 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:54.297343 10542 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:54.327142  4774 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 15 to 17, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 17 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.296269 10566 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:54.259083 10553 consensus_queue.cc:260] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.366262  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.328225 10276 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.333328 10057 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:54.370064  5567 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.370666  4774 catalog_manager.cc:5697] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.372130  4950 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:54.322829 10560 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:11:54.342693 10433 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:11:54.403509  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 69693.3us
I20260709 12:11:54.405740  4841 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.409701  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:54.395792 10559 log.cc:927] Time spent T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:11:54.371878 10566 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.342852 10542 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.400342 10550 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.375511 10057 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.396147 10567 consensus_queue.cc:1059] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 12:11:54.439317 10571 log.cc:927] Time spent T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:11:54.440207 10573 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:54.440698 10270 raft_consensus.cc:3055] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:54.440853 10573 consensus_queue.cc:1059] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:11:54.441922 10573 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:54.442251 10573 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.442552 10573 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.445128 10574 consensus_queue.cc:1059] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:11:54.446141 10574 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.446573 10574 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.448958 10549 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:54.454348 10223 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.375065 10193 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.393224 10552 consensus_queue.cc:1059] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:11:54.407207 10161 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.406368 10565 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.374377 10570 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.393986  4774 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 8 to 10, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.368220 10476 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.442446 10390 raft_consensus.cc:3055] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:54.503453 10390 raft_consensus.cc:740] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:54.504546 10161 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.504623 10476 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.361188 10568 consensus_queue.cc:1059] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:11:54.480758 10270 raft_consensus.cc:740] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:11:54.436691  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 235482us
I20260709 12:11:54.414108 10433 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:11:54.505882  4988 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.462179 10566 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:54.463406  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.462492  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 56865.3us
I20260709 12:11:54.509187  4841 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.510445  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:54.512327  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.512934  4945 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 10.
I20260709 12:11:54.456525  5602 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 18.
I20260709 12:11:54.471231 10550 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.504254 10390 consensus_queue.cc:260] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.396588 10561 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.527034  4946 raft_consensus.cc:1240] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:54.523965  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 153957us
I20260709 12:11:54.448613 10574 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.462085 10579 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:54.435957 10542 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.437809 10553 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.468333 10057 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:54.466354 10199 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.469012 10572 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.538770  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.468147 10309 raft_consensus.cc:3055] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:54.469429 10563 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.465930 10555 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.550483 10591 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.543746 10574 raft_consensus.cc:3055] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:54.560420 10540 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.561686 10585 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.572929  5567 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.573246 10578 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
W20260709 12:11:54.575373  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.575922  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.530043 10180 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:11:54.577437 10575 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:11:54.582495 10543 log.cc:927] Time spent T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.663s	user 0.002s	sys 0.002s
I20260709 12:11:54.583283  5567 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:54.584339  5567 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:54.562208 10557 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:54.562588  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 241380us
I20260709 12:11:54.551196 10309 raft_consensus.cc:740] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
W20260709 12:11:54.569816  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 274130us
I20260709 12:11:54.505838 10270 consensus_queue.cc:260] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.582618 10563 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.556378 10390 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:11:54.613018  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 210077us
W20260709 12:11:54.620201  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 109826us
I20260709 12:11:54.557767 10501 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.620702  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.625988  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:54.567039 10574 raft_consensus.cc:740] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:54.619407 10165 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:11:54.605038 10545 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:54.514923 10570 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.618741 10555 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:11:54.631091 10576 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:54.631438 10319 consensus_meta.cc:287] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.001s
I20260709 12:11:54.633054 10552 consensus_queue.cc:1048] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:54.643888 10572 consensus_queue.cc:1048] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:11:54.605737 10540 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.644030 10545 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.662163 10545 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:54.661978 10603 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:54.663000 10540 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:54.663244 10603 consensus_queue.cc:1059] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:54.663771 10201 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.664165 10603 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:54.664690 10584 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:54.665334 10584 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.667831 10584 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.668922 10583 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.627693 10591 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.543601 10579 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.632916 10592 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:54.622100 10560 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.653394  4990 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.647182  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:54.655948 10574 consensus_queue.cc:260] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.659063 10577 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:54.645567 10582 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:11:54.634050  4917 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.623747  5570 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:54.675374  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.642169 10165 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:54.644136 10164 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:54.695031  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 47889us
I20260709 12:11:54.695753  5567 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:54.680722  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:54.626497 10578 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:54.610020 10585 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.669081 10309 consensus_queue.cc:260] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.669620 10570 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.702404  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:54.673076 10563 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.664948 10567 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 12:11:54.704617  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 51304.6us
I20260709 12:11:54.704452  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:54.712582  5603 raft_consensus.cc:1240] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:11:54.713801  5600 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:54.714040  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:54.717003  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 211200us
W20260709 12:11:54.719076  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 168285us
I20260709 12:11:54.719985  4841 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.714694  5597 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:54.695654 10566 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.695045 10583 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:54.699476 10552 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:54.730243  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.698558 10311 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:54.706107 10574 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.670173 10450 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.671767 10319 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.738622  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:54.733348  4990 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:54.742158  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.718842 10589 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.673691 10573 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.722543 10193 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.722815 10560 raft_consensus.cc:2804] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:54.775425  5599 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 19: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
W20260709 12:11:54.748330  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 124718us
I20260709 12:11:54.777000  5570 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:54.734917 10360 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.751816  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:54.753139  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:54.702127 10164 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.748941 10309 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.756959 10573 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.744599 10311 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.759243 10545 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.763337 10199 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:54.766309 10201 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.766589 10433 raft_consensus.cc:3055] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:54.767181 10476 raft_consensus.cc:3055] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:54.678110 10577 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.772228 10585 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.740125 10221 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.737341 10540 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:54.773746  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 52650.4us
I20260709 12:11:54.676206 10591 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.779982  5601 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:54.719300 10563 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:54.785089  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.744742  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 69443.4us
I20260709 12:11:54.740208 10566 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.751533 10165 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:54.781062 10576 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:54.896579  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 260750us
I20260709 12:11:54.774834 10570 consensus_queue.cc:1048] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.117s
I20260709 12:11:54.784206 10550 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:54.907650  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:54.899421  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 272475us
I20260709 12:11:54.891938 10555 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:54.906327  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.894826 10433 raft_consensus.cc:740] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:54.923628 10555 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:54.924201 10433 consensus_queue.cc:260] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.906982  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.896200 10476 raft_consensus.cc:740] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:54.925676 10555 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.909081  4990 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:54.926587  4990 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:54.926395 10476 consensus_queue.cc:260] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.927531 10476 raft_consensus.cc:3060] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.927908 10311 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.900051 10199 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 18 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:54.929059 10199 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.930011  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.930280 10584 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:54.930634 10584 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.930940 10584 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:54.932451 10562 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.526s	user 0.000s	sys 0.002s
I20260709 12:11:54.925187 10433 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.933876  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.934100  4947 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:54.934342 10601 raft_consensus.cc:3055] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:54.929940 10596 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:54.934715 10601 raft_consensus.cc:740] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:54.935043 10596 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.935508 10596 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.935695 10601 consensus_queue.cc:260] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.936924 10609 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.938122  4988 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:54.939754 10604 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.901052 10221 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.910169  5597 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:11:54.912334 10608 raft_consensus.cc:493] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:54.947156 10608 raft_consensus.cc:515] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.912748 10568 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.949127 10568 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.951452  4943 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:54.893366 10057 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.953826 10057 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.954205 10221 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.913784 10319 leader_election.cc:290] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.914264 10591 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:54.914533 10558 log.cc:927] Time spent T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.675s	user 0.003s	sys 0.000s
I20260709 12:11:54.915958 10553 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:54.916404 10552 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:54.916703 10576 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.917657  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:54.917833 10165 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:11:54.975247  4949 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 18: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:54.918833 10542 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.921893 10164 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.916512 10545 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.923131 10589 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.943375  5597 pending_rounds.cc:85] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 11
I20260709 12:11:54.983450  5597 pending_rounds.cc:107] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:11:54.983752  5597 raft_consensus.cc:2889] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.934181  5604 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 22. Current term is 23. Ops: []
I20260709 12:11:54.909015  4839 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:54.907826 10573 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:54.966126  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 58555.9us
I20260709 12:11:54.967761 10608 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:54.968766 10566 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.977984  4943 raft_consensus.cc:2468] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:54.983364  4988 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:11:54.984611  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 75668us
I20260709 12:11:54.984943  4944 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.960013 10563 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:54.984875 10552 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.984642 10573 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:54.974673 10057 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:11:54.985244  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:54.974943 10601 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.002301  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3700) took 1056 ms. Trace:
I20260709 12:11:55.005584  4840 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:54.985697 10592 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:55.004829  4867 rpcz_store.cc:276] 0709 12:11:53.946167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.946779 (+   612us) service_pool.cc:224] Handling call
0709 12:11:53.953478 (+  6699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:53.963418 (+  9940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:53.963445 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:53.990952 (+ 27507us) log.cc:844] Serialized 26 byte log entry
0709 12:11:54.116818 (+125866us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:54.116858 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.117397 (+   539us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.777432 (+660035us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:54.992919 (+215487us) raft_consensus.cc:1685] finished
0709 12:11:54.992942 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.002248 (+  9306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":804,"raft.queue_time_us":5174,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":73687296,"thread_start_us":102922,"threads_started":1,"wal-append.queue_time_us":158274}
I20260709 12:11:55.009262  4988 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:55.011600  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:54.975332 10553 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:54.998343 10611 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:55.019572  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.020200  5020 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
W20260709 12:11:55.021574  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.003765 10165 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.024199  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.015328 10611 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.025550  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:55.029564  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.030149  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:55.030675  4951 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.029575  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.032263  5016 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.030160  4949 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:55.034535  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:54.993530 10589 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:55.007228 10223 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 12:11:55.041249  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.004890 10545 consensus_queue.cc:1059] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:11:55.001871 10596 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.018314 10199 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:55.020618 10608 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:55.013559 10606 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.043679 10441 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.014609 10592 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.080928 10592 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.034390 10611 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.083554 10568 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.085563 10573 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.085922 10270 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.086275 10589 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.088618 10576 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.051062 10612 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:11:55.091918  4945 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:55.097141 10591 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:11:55.097519 10591 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:55.098233 10591 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.099583 10606 raft_consensus.cc:3055] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:55.099947 10606 raft_consensus.cc:740] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:55.058821  5016 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:55.070298  5022 raft_consensus.cc:1240] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:11:55.103434  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.068733  4951 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
I20260709 12:11:55.104831  4944 raft_consensus.cc:2468] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
W20260709 12:11:55.104993  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:55.110033  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 61071.1us
I20260709 12:11:55.100708 10606 consensus_queue.cc:260] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.097059 10552 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:55.077100 10580 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.434s	user 0.000s	sys 0.002s
I20260709 12:11:55.055472 10553 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.051035 10199 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:55.117264 10199 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:55.124836  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.129191 10265 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:55.129593 10265 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:55.130348 10265 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.131294 10265 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.115588  5017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55716 (request call id 2786) took 1018 ms. Trace:
I20260709 12:11:55.133109  5017 rpcz_store.cc:276] 0709 12:11:54.096722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.096851 (+   129us) service_pool.cc:224] Handling call
0709 12:11:55.115437 (+1018586us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400065754. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:55.115534 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329938304}
I20260709 12:11:55.071309 10596 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.114630 10606 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.136099 10450 leader_election.cc:290] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.069973 10608 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.128711 10577 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:55.138278 10608 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.149772 10574 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:55.164340  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.062700 10584 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.170912  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.172261  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.173133  5016 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:55.180447  5024 raft_consensus.cc:1240] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:55.177502 10565 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.192490  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.192786 10565 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.193253  5016 raft_consensus.cc:2368] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:55.194998 10597 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.195508 10597 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:55.196413 10565 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.197518  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.198081  5598 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:55.199391  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.199949  4948 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:55.172631 10611 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:55.206718 10611 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.207368  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:55.207901  4948 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:55.208326  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.209230  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.217070  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.217690  5016 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
W20260709 12:11:55.225664  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 81416.1us
I20260709 12:11:55.227303  4948 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:55.229758  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:55.235325  5606 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.224296 10542 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.237166  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.238626  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.238811  5016 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 22.
I20260709 12:11:55.241731 10597 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.242479  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.243284 10199 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:55.244324  5023 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:55.246657 10584 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.251682  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.252331  5024 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:55.248904 10582 raft_consensus.cc:493] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.254135 10582 raft_consensus.cc:515] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.256889 10542 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.257381 10542 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.261842 10173 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.262346 10173 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.265334  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.265874  4944 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
W20260709 12:11:55.268980 10602 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.496s	user 0.003s	sys 0.000s
I20260709 12:11:55.270193  5600 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:11:55.271878  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.272192  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.272574  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.273725  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.274260  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.274808  5021 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:11:55.275192  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.278148  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.278690  4944 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 8.
I20260709 12:11:55.279448  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.280004  4943 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:55.281227  5024 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:55.279448  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:55.290035  4915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.293368  5025 raft_consensus.cc:1275] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:55.293766  4841 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:55.296977 10624 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.297394 10624 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.298533  5018 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:55.300980  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.303481 10622 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.003s
W20260709 12:11:55.306934 10621 log.cc:927] Time spent T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:11:55.276973 10360 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:11:55.294636 10173 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.302145 10270 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.300663 10624 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.321669  5021 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 23.
W20260709 12:11:55.333096  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54589.8us
I20260709 12:11:55.334311  5021 raft_consensus.cc:1240] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:55.334614  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.309712 10199 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:55.341957  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.343137  5021 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:55.346295  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.322672 10270 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.347824 10542 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.361042  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.367718 10579 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:55.367815  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.368631 10270 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.369436  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.369719 10582 leader_election.cc:290] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.369364  5606 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:55.370641  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:55.371064 10634 log.cc:927] Time spent T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:55.372848  5023 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:55.373513 10624 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.374341  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.375051  5017 raft_consensus.cc:2393] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 11: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:55.375344  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.375922  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.376461  5020 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:55.369349  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.376487  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:55.377177  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.377849  5602 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.378767  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.379349  5025 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 9.
I20260709 12:11:55.380544  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.380973  5021 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.382572  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.382894  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.383147  5018 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:55.386518  4950 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:55.387204  5021 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
I20260709 12:11:55.388736  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.390936  5602 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:55.392423  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.393646  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.394440  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.395233  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:55.395705  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.395763  4944 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.396185  4950 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:55.393677  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.397792  4948 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 19.
I20260709 12:11:55.399475 10345 consensus_queue.cc:1059] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:11:55.399889 10599 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.630s	user 0.003s	sys 0.000s
I20260709 12:11:55.401161 10608 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:55.395638  4915 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.402791 10309 consensus_queue.cc:1048] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:55.403556 10591 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:11:55.404129  4915 leader_election.cc:400] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:55.404681 10608 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:55.404440  4915 leader_election.cc:403] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:55.407795  5019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2795) took 1297 ms. Trace:
I20260709 12:11:55.410393  4839 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.413302  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:55.414043  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:11:55.415113  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.416422  4841 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:55.408185  5019 rpcz_store.cc:276] 0709 12:11:54.110147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.110619 (+   472us) service_pool.cc:224] Handling call
0709 12:11:54.110921 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:54.563874 (+452953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:54.563909 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:54.564523 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 12:11:54.626566 (+ 62043us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:54.626603 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.626753 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:55.082188 (+455435us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:55.399499 (+317311us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b240037e218. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a576839c4 00007f2a57681acb 00007f2a5783cdc9 00007f2a5783ca55 00007f2a5783c09d 00007f2a5a46e10e 00007f2a5a48588c 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221
0709 12:11:55.407610 (+  8111us) raft_consensus.cc:1685] finished
0709 12:11:55.407629 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.407743 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":324,"raft.queue_time_us":59619,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":7489,"spinlock_wait_cycles":43005696,"thread_start_us":509310,"threads_started":2,"wal-append.queue_time_us":156647}
I20260709 12:11:55.419883  5605 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:55.415604  5567 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:55.422124  4841 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:55.422785  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.422974 10612 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:55.423467 10612 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:55.423475  5604 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 18: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:55.418380  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:55.424605  4915 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.429459  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.430553  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:55.431085  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.430876  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.433218  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.434182  5603 raft_consensus.cc:2393] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 16: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:55.435038  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.430274  5567 leader_election.cc:304] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:55.421192  4944 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:55.430269  4839 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:55.436338  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:55.438695  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:55.433950 10180 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:55.463775  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.473317  4948 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:55.464277  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.438695  5567 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:55.469516  4915 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:55.423952 10606 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:55.421161 10624 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.437505 10567 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:55.470280  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.417246 10309 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:11:55.437177 10573 raft_consensus.cc:2804] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:55.437217 10272 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.464093 10565 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:55.484400  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:55.464010 10563 raft_consensus.cc:2804] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:55.470254 10552 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:11:55.470007 10612 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.482584 10476 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.487668  4839 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:55.437043 10450 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 12:11:55.479192  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:55.491266  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 52634.3us
I20260709 12:11:55.434080 10608 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575) with higher term. Message: Invalid argument: T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14.
I20260709 12:11:55.492246  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5508a3d98b403c8be99338c7e12502" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:55.468998 10553 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:55.439332 10360 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:11:55.480832 10223 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.506094 10223 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:55.508062 10223 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:55.508665 10565 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:55.509526 10565 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:55.500555  5568 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.505364 10572 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:55.532400  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.533965  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.533110  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:55.530781  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.533493  4872 raft_consensus.cc:1240] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:55.539798  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 101173us
I20260709 12:11:55.541294  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:55.541909  4943 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:55.535739  4871 raft_consensus.cc:1240] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:55.543401  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.540422  5567 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:55.538923  4874 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:55.536164  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.490150 10272 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:55.550709  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 50184.7us
I20260709 12:11:55.515201  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.554159  5568 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.551172  4876 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 22: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:55.552765  4871 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:11:55.555814  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.564145  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.499396 10550 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:11:55.567552  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.571229  4872 raft_consensus.cc:2410] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:11:55.569253  4870 raft_consensus.cc:1240] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:55.497720 10552 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:55.501536 10574 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:55.570124  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 67398.1us
I20260709 12:11:55.573015  4988 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:55.503196 10476 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.517455 10569 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.583921  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.525491 10545 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:55.573261  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:55.585134  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 69978.3us
I20260709 12:11:55.593021  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.593238  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:55.593794  4876 raft_consensus.cc:3060] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.504328 10553 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:55.569532 10628 log.cc:927] Time spent T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:55.584162 10476 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.596302  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:55.547454 10573 raft_consensus.cc:697] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:55.564774 10272 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.599586  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:55.593062  4915 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.601078  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:55.599061  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:55.549912 10563 raft_consensus.cc:697] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:55.567476 10566 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:55.572319 10552 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:11:55.571923 10609 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:55.605803  4915 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.605154  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.607389  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.609467  4867 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:55.590634 10568 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.617483  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.618217  4872 raft_consensus.cc:2393] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 19: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:55.584146 10610 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:55.614285 10569 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.615516 10276 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.629523 10276 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.605329 10566 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.602177 10545 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:55.609561 10608 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:55.596776 10550 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:55.599965 10585 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.589782 10561 consensus_queue.cc:1059] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:11:55.628855 10610 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.632797  4869 raft_consensus.cc:2468] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:55.634904  4876 raft_consensus.cc:2468] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
I20260709 12:11:55.651304  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.652307  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:55.622552  5604 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:55.636240  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.638792  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3805e1c03edc45ed8a91427825b04e2e" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.640594  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.634137 10276 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.644735  4948 raft_consensus.cc:1240] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:55.647397  4870 raft_consensus.cc:2468] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:11:55.600014 10553 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.635735 10566 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:55.654876 10545 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:55.636902 10577 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:55.655298 10550 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.630278 10309 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.659624  4873 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:55.660006  4867 raft_consensus.cc:2410] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:11:55.661132  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 107024us
I20260709 12:11:55.664918  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.638458 10180 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:55.667474  4876 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:55.668562  4869 raft_consensus.cc:2393] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 18: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:55.671203  4869 raft_consensus.cc:1240] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:55.675833  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.677126  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.677718  5024 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:55.681779  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ae020fc77f442c9f248fa0f3e45fe4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:55.681957  5020 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260709 12:11:55.682786  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.703822  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.706142  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.714450  4991 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.715842 10549 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.720038  4991 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:55.724545  4991 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.725373 10585 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:55.726928  5570 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:55.668351 10645 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:11:55.658432 10610 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:55.731981  5023 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:55.733093  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 64656us
I20260709 12:11:55.731719  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:55.737679  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:55.740303  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.742966  5568 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:55.737552  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:55.744288  4917 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.743012  5018 raft_consensus.cc:2393] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 11: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:55.666893 10577 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:55.667760 10360 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:55.749096  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:55.637887 10573 consensus_queue.cc:237] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.759284  4917 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.767776  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.769567  4867 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:55.774487  5570 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:55.752681 10568 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.753269 10577 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.775533  5570 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:55.775318  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.759748 10608 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.778785  4991 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.761534 10565 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:55.755199 10560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.008s	sys 0.004s
I20260709 12:11:55.788791  5570 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.798652  5568 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:55.782769 10569 consensus_queue.cc:1059] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:11:55.857394 10660 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:55.781183 10609 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.858455 10193 raft_consensus.cc:2804] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:55.781232 10201 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.732725 10563 consensus_queue.cc:237] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.760943 10360 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.866230 10653 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.776403 10173 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.773582 10572 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.781513 10180 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.870764 10549 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.796981 10588 raft_consensus.cc:2804] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:11:55.861218  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 72488.7us
I20260709 12:11:55.791368  4840 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:55.874122  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 82840.6us
I20260709 12:11:55.789320  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.861728 10660 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.862058 10193 raft_consensus.cc:697] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 18 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:55.767442 10476 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:55.782644 10608 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:11:55.886530  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 127315us
W20260709 12:11:55.795346 10560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.008s	sys 0.004s
I20260709 12:11:55.762053 10654 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 12:11:55.877643  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 88390.8us
I20260709 12:11:55.859715 10568 raft_consensus.cc:2804] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:55.864091 10646 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
W20260709 12:11:55.880046  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 81461.7us
I20260709 12:11:55.796893 10565 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:55.866305 10651 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:55.865146 10201 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:55.864408 10450 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:55.879442 10660 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:55.934286  4840 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.948797  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:55.951633  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.878194 10270 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:55.884266 10588 raft_consensus.cc:697] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:55.962073  4991 leader_election.cc:304] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:55.927502 10561 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.885802 10390 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.888171 10608 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.892203 10560 raft_consensus.cc:697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:55.883736 10596 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.963158  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:55.964118  4872 raft_consensus.cc:1240] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:55.933696 10568 raft_consensus.cc:697] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:55.960961 10603 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.939224 10201 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.890643 10542 consensus_queue.cc:1059] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:11:55.953084 10660 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.961540 10572 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:55.933399 10221 consensus_queue.cc:1059] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:55.977820 10588 consensus_queue.cc:237] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.978480 10565 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:55.978834 10603 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:55.979068 10655 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:11:55.966908 10574 raft_consensus.cc:2749] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.963624 10270 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:55.994215 10622 raft_consensus.cc:3055] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:55.994467 10560 consensus_queue.cc:237] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.989444 10450 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:55.973764 10199 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.011817 10603 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.972205 10193 consensus_queue.cc:237] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.007797 10568 consensus_queue.cc:237] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.971122 10390 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.017351 10622 raft_consensus.cc:740] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:55.991487 10592 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.014338 10476 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.025885  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:56.037961  4868 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.030212 10545 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.031350 10390 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.032222 10360 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.020406 10610 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.034971 10622 consensus_queue.cc:260] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:55.968868 10561 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.018383 10270 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.034633 10553 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.048437  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:56.049464  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:56.048910  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:56.043268 10652 log.cc:927] Time spent T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:11:56.042270 10585 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:56.064253  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 19.
I20260709 12:11:56.062525  4868 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:56.047297 10649 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:56.084594  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.151078  4869 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:56.043232 10592 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.110267 10553 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.112113 10610 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.047698 10545 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.113643 10579 raft_consensus.cc:3055] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:56.083472 10561 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.083412 10272 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:56.118263  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 167172us
I20260709 12:11:56.123682 10276 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.126502 10542 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:56.126252 10577 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.085968 10201 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:56.119307 10591 consensus_meta.cc:287] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.715s	user 0.012s	sys 0.000s
I20260709 12:11:56.145479  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:11:56.148347  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.167253  4944 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:56.168793  4917 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:56.169697  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:56.170392 10561 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:56.170821 10561 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.160862 10276 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.161325  4945 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:11:56.171262 10561 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.171613 10276 raft_consensus.cc:2804] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:56.172091 10276 raft_consensus.cc:697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:56.170591  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:56.174402 10276 consensus_queue.cc:237] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.066707  4876 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:56.179104 10561 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.179368  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:56.181371 10561 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.181773  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:56.182415  4869 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.180624 10390 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.189150 10390 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.189507 10390 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.188619  4869 raft_consensus.cc:2468] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:11:56.194327  4991 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:56.197640 10272 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.198300  4867 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:56.203977 10270 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.211450  4944 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:56.213657 10660 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.215777 10660 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.155900 10579 raft_consensus.cc:740] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:56.212411  5570 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:56.219834 10608 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.225046  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.226151 10201 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:56.227262 10552 consensus_meta.cc:287] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.001s
I20260709 12:11:56.154753 10566 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.163870 10542 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:56.230041 10270 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.236546  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:56.195163 10561 raft_consensus.cc:2804] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:56.238057  5020 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:56.238098  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:56.196074 10672 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 12:11:56.303797  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 78820.1us
I20260709 12:11:56.304106  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:56.287928 10618 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:11:56.209967 10609 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.324277  4949 raft_consensus.cc:1240] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:56.305841  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 93494.6us
I20260709 12:11:56.308008  5022 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:56.308071  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:56.325811  4944 raft_consensus.cc:2410] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:11:56.224599 10603 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.307634 10592 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.315379  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:56.331754  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:56.319808 10577 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.322172 10566 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.322649  5600 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:56.331796  5020 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:56.335115  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:56.316713 10550 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.336171  4944 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:56.305877 10612 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:56.338747  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:56.339020  4946 raft_consensus.cc:1240] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:56.339404  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.342460  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:56.342935  5017 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.343191  4869 raft_consensus.cc:2393] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 15: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:56.343380  4950 raft_consensus.cc:1240] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:56.344463  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:56.328487 10561 raft_consensus.cc:697] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:56.306241 10552 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:56.346873  4868 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:56.344743  4876 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:56.349788  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:56.334244 10309 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:56.351418  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.340885 10360 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.352955  4870 raft_consensus.cc:2410] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:11:56.353708  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:56.354790  4874 raft_consensus.cc:2393] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:56.346546 10608 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.335232 10624 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:11:56.357607  4839 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.359081 10221 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.359510 10221 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.361488 10221 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.361990 10221 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:56.362304 10221 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.342793 10579 consensus_queue.cc:260] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.364440 10579 raft_consensus.cc:3060] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:56.350153 10683 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:11:56.367744 10603 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.341114 10542 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.368444 10542 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.369082  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:56.369645  5606 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:56.374006 10360 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.374522 10561 consensus_queue.cc:237] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.378099 10552 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 22 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.350626 10390 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.379515  4947 raft_consensus.cc:2393] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 16: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:56.379733  5017 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:56.380429 10390 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.383652 10584 consensus_queue.cc:1059] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:11:56.385885 10582 raft_consensus.cc:3055] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:56.386247 10582 raft_consensus.cc:740] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:56.387023 10582 consensus_queue.cc:260] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.387939 10582 raft_consensus.cc:3060] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.390257  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:56.390609  5606 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:11:56.391419  5599 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:56.384693 10584 raft_consensus.cc:3055] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:56.393777 10584 raft_consensus.cc:740] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:56.374131 10270 consensus_queue.cc:1175] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "baa50eb5ed704004b7f391934a59d010" responder_term: 11 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:11:56.394903 10272 consensus_queue.cc:1175] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8de40fe2bb814adcbe13958669063dc9" responder_term: 10 status { last_received { term: 10 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 10 index: 8 } }
W20260709 12:11:56.396914 10644 log.cc:927] Time spent T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.911s	user 0.004s	sys 0.000s
I20260709 12:11:56.398419  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1617) took 1084 ms. Trace:
W20260709 12:11:56.399814  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.398742  5597 rpcz_store.cc:276] 0709 12:11:55.314007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.314122 (+   115us) service_pool.cc:224] Handling call
0709 12:11:55.324198 (+ 10076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.325977 (+  1779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.326002 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.326400 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 12:11:55.366624 (+ 40224us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:55.420943 (+ 54319us) log.cc:844] Serialized 14 byte log entry
0709 12:11:55.431847 (+ 10904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.431917 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.396645 (+964728us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b24002e6148. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a576839c4 00007f2a57681acb 00007f2a5783cdc9 00007f2a5783ca55 00007f2a5783c09d 00007f2a5a46e10e 00007f2a5a48588c 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221
0709 12:11:56.398152 (+  1507us) raft_consensus.cc:1685] finished
0709 12:11:56.398241 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.398352 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31831,"prepare.queue_time_us":34347,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":32,"raft.queue_time_us":15218,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":26093,"spinlock_wait_cycles":8261504,"thread_start_us":25588,"threads_started":1,"wal-append.queue_time_us":99593}
I20260709 12:11:56.396041 10309 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.411132 10309 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.362608 10221 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.413601 10345 consensus_queue.cc:1059] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:56.414870 10671 log.cc:927] Time spent T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
I20260709 12:11:56.414987 10572 raft_consensus.cc:3055] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:56.415352 10572 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:56.416100 10572 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.402863 10584 consensus_queue.cc:260] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.417179 10572 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.406687  5567 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:56.422964 10309 raft_consensus.cc:2804] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:56.394013 10360 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.424083 10309 raft_consensus.cc:697] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:56.425184 10309 consensus_queue.cc:237] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.427721  5019 raft_consensus.cc:1240] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:11:56.431381  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.431974  5016 raft_consensus.cc:3060] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:56.432101  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.433096  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.433679  5020 raft_consensus.cc:3060] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.435184  5024 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:56.437441  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:56.438027  5597 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.428499  4839 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.444679  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.446839  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.450541  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:56.450790  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:56.452270  4944 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:56.452328  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:56.456538  4944 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:56.459313  4839 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:56.457914  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.438686  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:56.463274  5016 raft_consensus.cc:2468] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 10.
I20260709 12:11:56.461154  4839 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.465140 10609 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:11:56.440321 10566 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:56.504987 10311 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.510576 10592 consensus_queue.cc:1059] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:11:56.444235 10201 consensus_queue.cc:1059] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:11:56.512164  4943 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:56.509373  4948 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:11:56.518707  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 80076.5us
I20260709 12:11:56.502017  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.534252  4840 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:56.521027  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
W20260709 12:11:56.517194  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 53435.3us
I20260709 12:11:56.467406  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.525839  4951 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:56.536459  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:56.536993  4951 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 14.
W20260709 12:11:56.537052  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 75982.1us
I20260709 12:11:56.445720 10272 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.466286  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:56.530158  5020 raft_consensus.cc:2468] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:56.539759  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.556883  4874 raft_consensus.cc:2393] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 9: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:56.554706  5018 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:56.561730  5602 raft_consensus.cc:1240] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:56.458135 10360 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:11:56.565757  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:56.565943  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:56.566313  4868 raft_consensus.cc:3060] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.470098 10611 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.567308  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:56.560635  5017 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 22.
I20260709 12:11:56.563210 10649 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:11:56.570971  4870 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:56.575105 10572 consensus_queue.cc:1059] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:11:56.448511 10585 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:11:56.574528  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:11:56.578827  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 125631us
I20260709 12:11:56.532689 10311 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.563532 10560 raft_consensus.cc:3055] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:56.563321 10612 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:56.561949 10603 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.514609 10221 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.583177  4874 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:11:56.580826  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 116610us
I20260709 12:11:56.587339  4869 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:56.532232 10566 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.556090 10552 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:11:56.561127 10057 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:11:56.565488 10550 consensus_queue.cc:1059] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:11:56.592617  4868 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:56.593225  4944 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:56.564770 10272 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.529037 10624 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.598780 10560 raft_consensus.cc:740] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:56.598085  4867 raft_consensus.cc:2393] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 22: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:56.600715 10612 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:56.590046 10609 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:56.593055 10592 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:56.609277  4872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3720) took 1047 ms. Trace:
I20260709 12:11:56.610877  5600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 1625) took 1124 ms. Trace:
I20260709 12:11:56.596493  4875 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 12:11:56.617113  4915 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.629608  4875 pending_rounds.cc:85] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Aborting all ops after (but not including) 12
I20260709 12:11:56.630473  4875 pending_rounds.cc:107] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 12:11:56.630738  4875 raft_consensus.cc:2889] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:56.628912  5600 rpcz_store.cc:276] 0709 12:11:55.486659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.563281 (+ 76622us) service_pool.cc:224] Handling call
0709 12:11:55.587937 (+ 24656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.335937 (+748000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.610684 (+274747us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54006130d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:56.610827 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689223040}
I20260709 12:11:56.628691  4872 rpcz_store.cc:276] 0709 12:11:55.562168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.745040 (+182872us) service_pool.cc:224] Handling call
0709 12:11:55.758865 (+ 13825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.974078 (+215213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.609027 (+634949us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002c33d4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:56.609219 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471473536}
I20260709 12:11:56.617834 10223 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:11:56.709235 10592 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:56.711063 10672 log.cc:927] Time spent T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:11:56.713389  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 113106us
I20260709 12:11:56.617489 10624 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.720892 10653 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:56.713001 10608 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:56.733258  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 98546.3us
I20260709 12:11:56.736011  4870 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:56.732820  5597 raft_consensus.cc:2468] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:56.724821 10624 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.737421  4915 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.726370 10615 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.762850  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.632186 10609 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.763871  4915 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:56.723511 10653 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.772956 10568 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:11:56.767566 10567 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.771036 10608 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:56.783996 10568 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 22 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:56.785118 10568 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
W20260709 12:11:56.786154 10690 log.cc:927] Time spent T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:56.794711 10649 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.777657 10698 raft_consensus.cc:3055] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:56.795230 10677 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.686s	user 0.000s	sys 0.003s
I20260709 12:11:56.770078 10615 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.797183 10649 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:56.827472 10615 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.794916 10612 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.778012 10574 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:11:56.800209 10311 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.827566 10649 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.830681 10609 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:56.803081 10698 raft_consensus.cc:740] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:56.832172 10698 consensus_queue.cc:260] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.834309 10653 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:56.780149 10549 consensus_queue.cc:1059] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:11:56.824837 10585 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
W20260709 12:11:56.846340 10694 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:56.846693 10660 raft_consensus.cc:3055] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:56.847090 10660 raft_consensus.cc:740] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:56.847250 10221 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:56.851400  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.853614  4872 raft_consensus.cc:1240] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:56.855644  4917 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:56.857260 10161 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:56.858522 10161 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:56.859970 10161 raft_consensus.cc:2804] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:56.860646 10161 raft_consensus.cc:697] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:56.861516 10161 consensus_queue.cc:237] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:56.863184  5605 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57006 (request call id 1249) took 1435 ms (client timeout 1835 ms). Trace:
W20260709 12:11:56.865949  5605 rpcz_store.cc:269] 0709 12:11:55.427993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.432982 (+  4989us) service_pool.cc:224] Handling call
0709 12:11:56.862965 (+1429983us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400793e54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:56.863108 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3284251392}
I20260709 12:11:56.863058 10572 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:56.863745  5601 raft_consensus.cc:1240] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:56.867990  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.870411  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.871158  4868 raft_consensus.cc:2393] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 14: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:56.865095 10660 consensus_queue.cc:260] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.872738  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.883517  4874 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:11:56.882957  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.884140  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.884459  4867 raft_consensus.cc:2393] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 15: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:56.885376  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.887946  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.888911  4870 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:11:56.898120  5570 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:56.886512 10566 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:56.900609  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.844832 10585 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.889459 10563 raft_consensus.cc:3055] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:56.904265  5570 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:56.888314 10608 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:56.893033 10272 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:56.888509 10573 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:11:56.912580  4867 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:56.902661 10276 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:56.914258 10276 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.892253 10653 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:11:56.920341  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.925267  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:56.925809  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:56.906602 10563 raft_consensus.cc:740] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:56.908525 10311 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:56.933859  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:56.913739 10660 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:56.938766  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:56.939332  5602 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
I20260709 12:11:56.911125 10566 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.943737  5598 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:56.959555  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:56.959537  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.967267  5022 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:11:56.968262  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:56.969338  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:56.972333  5568 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.933374 10567 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:56.973871  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:56.936697 10272 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.912258 10608 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:56.937546 10311 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.982105  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.973030 10673 raft_consensus.cc:2749] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:56.987213  5568 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:56.949199 10566 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.986124  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:56.991395  5021 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:56.989298  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:56.992233  5018 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 22.
W20260709 12:11:56.980969 10576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.386s	user 0.008s	sys 0.007s
I20260709 12:11:56.982205 10567 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:56.985706 10311 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.004225  5568 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:56.998914 10576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.009s	sys 0.007s
I20260709 12:11:57.005995  5021 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:57.007550  5568 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:56.990713 10685 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:57.008329  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 274237us
I20260709 12:11:56.994314 10566 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.998890 10201 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:56.984477 10272 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:57.015318 10582 consensus_meta.cc:287] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.004s
W20260709 12:11:57.067842  4841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.078431  5019 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:57.021996 10609 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:57.013262 10653 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:11:56.993278 10563 consensus_queue.cc:260] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.077878 10201 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:57.085491 10276 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.081902 10701 raft_consensus.cc:3060] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.085421 10585 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.102878 10390 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:57.103286 10390 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:57.104080 10390 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.096858 10624 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.115341 10584 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.116029 10624 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.097968 10276 raft_consensus.cc:3055] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:57.116680 10276 raft_consensus.cc:740] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:57.117477 10276 consensus_queue.cc:260] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.098677 10201 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.120069  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:57.106521 10608 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:57.096020 10693 log.cc:927] Time spent T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
W20260709 12:11:57.110478 10692 log.cc:927] Time spent T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.498s	user 0.001s	sys 0.000s
W20260709 12:11:57.113224 10707 log.cc:927] Time spent T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:11:57.122462  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:57.123234  4870 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:57.124449  5025 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:11:57.124835  5025 pending_rounds.cc:85] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 6
I20260709 12:11:57.125032  5025 pending_rounds.cc:107] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:57.125239  5025 raft_consensus.cc:2889] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:57.126700  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:57.126909 10272 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.129850 10450 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:57.092154 10565 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:57.087360 10567 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.113729 10311 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.142434  4945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52376 (request call id 3142) took 1411 ms. Trace:
I20260709 12:11:57.138501  4840 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:57.133845 10057 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:11:57.132782  5021 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.143970 10552 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.147411 10566 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:57.148468  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 141236us
I20260709 12:11:57.149111  5567 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:57.151073  5597 raft_consensus.cc:3060] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:57.151638  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.176115  5600 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:57.148667  4839 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:57.147308 10701 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.153121 10272 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:57.154709 10567 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.155256 10450 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.157694 10718 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.159183  4945 rpcz_store.cc:276] 0709 12:11:55.731371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.731498 (+   127us) service_pool.cc:224] Handling call
0709 12:11:55.731754 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.176046 (+444292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.142198 (+966152us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400375854. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:57.142379 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987441024}
I20260709 12:11:57.167745  4867 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:11:57.192107  4867 raft_consensus.cc:1240] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:57.172406  5021 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:11:57.177238  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:57.177830  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.185123  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:57.185328  5567 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:57.193410  5023 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 23.
W20260709 12:11:57.159111  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 200746us
I20260709 12:11:57.195449  5602 raft_consensus.cc:1275] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:57.174854 10649 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:57.175055 10057 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.197196  5605 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 16: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:57.203809  5597 raft_consensus.cc:1275] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:57.194993  4870 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:57.196460  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:57.158742 10565 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.185132 10576 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.216611  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:57.186201 10685 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:57.220647  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.188687 10201 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:57.191643 10567 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.197705 10718 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.224586 10718 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:11:57.224915  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.194006 10450 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.225129 10567 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.226722 10450 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:11:57.239897  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 43511.8us
I20260709 12:11:57.214483 10701 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.216071 10057 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:11:57.176525 10552 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:57.213450 10722 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:57.240597  4840 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:57.265986 10567 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.196244 10714 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:57.196699 10653 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:11:57.272910 10603 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.240063 10727 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:57.274925 10360 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:11:57.239480 10685 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.228845 10576 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:57.294755  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 117352us
I20260709 12:11:57.298486  4950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 3628) took 1665 ms. Trace:
I20260709 12:11:57.278062 10722 raft_consensus.cc:493] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.310585  4950 rpcz_store.cc:276] 0709 12:11:55.632904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.633337 (+   433us) service_pool.cc:224] Handling call
0709 12:11:55.643249 (+  9912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.343733 (+700484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.298280 (+954547us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54001a2054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:57.298433 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609794944}
I20260709 12:11:57.310724  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:57.267727 10649 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:11:57.312012 10666 log.cc:927] Time spent T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 1.225s	user 0.001s	sys 0.002s
W20260709 12:11:57.309742 10678 log.cc:927] Time spent T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 1.136s	user 0.003s	sys 0.000s
I20260709 12:11:57.295483 10360 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:57.310104 10545 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.288713 10567 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.341696 10567 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.333425 10311 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:57.334277  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.347959 10685 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:57.348354 10680 log.cc:927] Time spent T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 1.236s	user 0.000s	sys 0.004s
I20260709 12:11:57.349529  4873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39324 (request call id 3715) took 1788 ms. Trace:
I20260709 12:11:57.349846  4873 rpcz_store.cc:276] 0709 12:11:55.561028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.672090 (+111062us) service_pool.cc:224] Handling call
0709 12:11:55.737220 (+ 65130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.748423 (+ 11203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.748453 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.748861 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.046629 (+297768us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:56.046670 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.046742 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.322970 (+1276228us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:57.349263 (+ 26293us) raft_consensus.cc:1685] finished
0709 12:11:57.349282 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.349475 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19745,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":6368,"spinlock_wait_cycles":86248832,"thread_start_us":297495,"threads_started":1,"wal-append.queue_time_us":353986}
I20260709 12:11:57.351647 10624 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:57.352123 10624 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:57.352955 10624 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.354741 10265 raft_consensus.cc:3055] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:57.355134 10265 raft_consensus.cc:740] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:57.355803 10552 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.355877 10265 consensus_queue.cc:260] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:57.356773  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 116288us
I20260709 12:11:57.358139 10622 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.360865 10715 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:57.361339 10715 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.361650 10715 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.335353 10566 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:57.331063 10360 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:11:57.339885 10201 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:57.319579 10722 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.373016  4874 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:57.375046  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:57.371884  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:56.236922  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:57.333310 10565 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.378990  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:57.350899 10576 leader_election.cc:290] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.383167  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:57.384678  4876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:57.309361 10727 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:57.384279 10719 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:11:57.386150 10265 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:57.401647 10653 consensus_queue.cc:1059] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:57.417095  4870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:57.395077 10649 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:57.423810  5604 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57006 (request call id 1253) took 1086 ms. Trace:
I20260709 12:11:57.424157  5604 rpcz_store.cc:276] 0709 12:11:56.337864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.337986 (+   122us) service_pool.cc:224] Handling call
0709 12:11:56.340851 (+  2865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.409252 (+ 68401us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:56.409492 (+   240us) log.cc:844] Serialized 14 byte log entry
0709 12:11:56.595478 (+185986us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:56.595522 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:56.595562 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.095484 (+499922us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:57.423607 (+328123us) spinlock_profiling.cc:243] Waited 68.2 ms on lock 0x7b54002a6054. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:57.423653 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.423758 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1458,"prepare.queue_time_us":347,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":2384,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3535,"spinlock_wait_cycles":161283712,"thread_start_us":185036,"threads_started":1,"wal-append.queue_time_us":300700}
I20260709 12:11:57.426430 10390 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.432615 10685 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.433121 10685 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.434921 10685 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:57.432142 10360 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.435786 10715 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.437085  4876 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 12: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:57.437014 10360 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 24 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.416445  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:57.442726 10727 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.443063 10592 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:57.445824 10715 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.446365 10716 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.446058  4770 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 11 to 12, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 12 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:57.446851 10716 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:57.449083  4874 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 24 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 23. Current term is 24. Ops: []
I20260709 12:11:57.449342 10716 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:57.451437  4990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.458271  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.466612  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:57.467123  5023 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:11:57.467670  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:57.468241  4873 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:57.470252  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:57.466033  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:57.479892  5604 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:57.468865  4916 leader_election.cc:304] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:11:57.494642  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.496107  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:57.496833  5602 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:57.495378  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:11:57.510172  4942 raft_consensus.cc:3060] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.510994  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.511739  4945 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:57.515918  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.518085 10715 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.518563 10715 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.520457 10715 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.526116  5018 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 12:11:57.527024  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 404869us
I20260709 12:11:57.527135  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.527755  5017 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
W20260709 12:11:57.531963  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 381970us
I20260709 12:11:57.533394  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:57.533901  4872 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:11:57.534714  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.535135  4989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.536518  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:57.536940 10715 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:57.519014 10576 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:57.537920 10576 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.538283 10576 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.541193 10584 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:57.550439  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.551093  5023 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 24.
I20260709 12:11:57.554755  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.555138  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.555931  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd2c2ca421a4b8e9629cd5b12e89e72" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.556284  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:57.555945  4943 raft_consensus.cc:2410] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:11:57.556910  4944 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.558477  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.552347  4840 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:57.563868  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.551050  4945 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:11:57.569041  4950 raft_consensus.cc:1275] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:57.569696  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.570364  4945 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:57.570976  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:57.571229  4947 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:57.542515 10584 raft_consensus.cc:2764] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:11:57.571714  4951 raft_consensus.cc:3060] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.572429  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:57.577523  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.566445 10715 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:11:57.544525 10608 raft_consensus.cc:2749] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:57.574678  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.537351 10542 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:57.575785  4948 raft_consensus.cc:1275] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:57.587986  4948 pending_rounds.cc:85] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 10
I20260709 12:11:57.588263  4948 pending_rounds.cc:107] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:57.588497  4948 raft_consensus.cc:2889] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:57.588973  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.577672  4950 raft_consensus.cc:3060] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.573252 10587 raft_consensus.cc:3055] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:57.579442  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.581491  4942 raft_consensus.cc:1275] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:57.583571  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.586701  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.601357 10610 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:57.602200  4951 raft_consensus.cc:2468] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:11:57.601917 10610 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.505928 10727 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:11:57.592139 10587 raft_consensus.cc:740] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:57.587916 10542 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.629088  4950 raft_consensus.cc:2468] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:57.537660 10696 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:11:57.609140  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.608014  4944 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
W20260709 12:11:57.656100  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 82747.4us
I20260709 12:11:57.548509 10552 consensus_queue.cc:1048] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:11:57.553979 10567 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:11:57.608323  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:57.663754  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 79702.1us
I20260709 12:11:57.649060 10739 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.665248  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.671140  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.678153  5597 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
W20260709 12:11:57.672473  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.658147 10742 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:11:57.679579  4914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.653682 10711 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:57.596454 10611 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:57.683357  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.653400 10715 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 24 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:57.656721 10608 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.685873  5568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.595885 10057 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:57.701776  5606 raft_consensus.cc:1240] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:57.665248 10542 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.716137  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.721776  5022 raft_consensus.cc:2393] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:11:57.722380  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.725652  4916 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:57.703070 10739 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:57.787089  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 61518.9us
I20260709 12:11:57.717435 10201 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.792779  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:57.716084 10733 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.801785  5017 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 12:11:57.804967  5017 raft_consensus.cc:1275] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:57.721897 10579 consensus_queue.cc:1048] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
W20260709 12:11:57.817325 10691 log.cc:927] Time spent T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 1.048s	user 0.011s	sys 0.000s
I20260709 12:11:57.770843 10715 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:57.818465 10744 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:11:57.820801 10552 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:57.822439 10057 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 23 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:57.810844 10201 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.717833 10722 raft_consensus.cc:515] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.828698 10201 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.828820 10722 leader_election.cc:290] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.725700 10587 consensus_queue.cc:260] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.830076 10587 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:57.720189 10608 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:57.834411 10608 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.826112 10576 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:57.830117  4868 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 16: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:57.769488 10735 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.836346 10552 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.836685  5601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37900 (request call id 1618) took 2429 ms. Trace:
I20260709 12:11:57.847524 10735 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.847906  5601 rpcz_store.cc:276] 0709 12:11:55.407229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.414333 (+  7104us) service_pool.cc:224] Handling call
0709 12:11:56.863567 (+1449234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.882756 (+ 19189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.836491 (+953735us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400793e50. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e98ad 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:11:57.836610 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3285531904}
I20260709 12:11:57.837070 10753 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.849080 10753 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:57.838236 10567 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.842435 10563 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:57.850214 10735 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.851864 10739 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.843926 10276 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:57.857362  4990 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:57.858301 10560 consensus_queue.cc:260] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.812482 10733 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.859508 10560 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:57.859787 10697 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:57.860186 10697 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:57.834805 10752 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.860533 10697 raft_consensus.cc:3060] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:57.860898 10752 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.863273 10752 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.865423  5601 raft_consensus.cc:1275] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:57.834899 10608 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.847568 10552 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:57.868496 10552 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.844358 10610 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.870118  5567 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:57.871213  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:57.845067 10390 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:57.872597 10572 consensus_queue.cc:1059] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:57.866524 10567 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.877370 10567 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.878809 10698 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.879347 10753 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.866271 10608 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:57.880013 10592 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.880666 10592 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:57.881114 10592 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.882226 10608 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:57.882347 10726 log.cc:927] Time spent T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.561s	user 0.000s	sys 0.009s
I20260709 12:11:57.883030 10592 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:57.883526  4871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57560 (request call id 1233) took 2334 ms. Trace:
I20260709 12:11:57.883899  4871 rpcz_store.cc:276] 0709 12:11:55.548912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.556618 (+  7706us) service_pool.cc:224] Handling call
0709 12:11:55.556908 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:55.571117 (+ 14209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.571148 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:55.584353 (+ 13205us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.141699 (+1557346us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b1800357940. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577dfe07 00007f2a6063a9a9 00007f2a577fc69b 00007f2a577fa93f 00007f2a577fcc02 00007f2a5a48420b 00007f2a5a489d23 00007f2a5a48a0d1 00007f2a5a8a5a0f
0709 12:11:57.228310 (+ 86611us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:11:57.228350 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.228417 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:57.881730 (+653313us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:57.883311 (+  1581us) raft_consensus.cc:1685] finished
0709 12:11:57.883331 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.883456 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13821,"raft.queue_time_us":13903,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":14780,"spinlock_wait_cycles":7720576,"thread_start_us":86419,"threads_started":1,"wal-append.queue_time_us":1684634}
I20260709 12:11:57.888988 10193 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:57.890630  5567 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:57.891304 10193 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:57.891665 10193 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.891973 10193 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:57.893304  4770 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.894972  4770 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 12 to 16, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 16 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.895872  5018 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:57.860538 10733 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.883540 10592 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:57.902199 10542 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.903939  5599 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 12:11:57.904381 10749 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.177s	user 0.000s	sys 0.005s
I20260709 12:11:57.906798 10697 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.909099 10576 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.909693 10610 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:57.846318  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 53601us
I20260709 12:11:57.911064  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:57.911067  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:57.914006  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.914554  4950 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
I20260709 12:11:57.917932  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.896728  4770 catalog_manager.cc:5697] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 10 to 14, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.918498  5600 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 19.
I20260709 12:11:57.945469  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:57.946062  4944 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
W20260709 12:11:57.949159  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 362715us
I20260709 12:11:57.950002  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.952270  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.952744  4839 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:57.953451  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.954013  5020 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
I20260709 12:11:57.955209  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.955809  5600 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:57.957154  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.957639  5020 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:57.957150  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 46158.8us
I20260709 12:11:57.958376  5567 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
W20260709 12:11:57.960464  4774 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 247) took 15390 ms (client timeout 15000 ms). Trace:
I20260709 12:11:57.960776  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:57.961383  5602 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 18.
I20260709 12:11:57.918118 10697 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.964727  5017 raft_consensus.cc:1275] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:11:57.966048  4770 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 15 to 17, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 17 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.967758  4770 catalog_manager.cc:5697] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 10 to 12, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 12 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.951251 10563 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.961374  4774 rpcz_store.cc:269] 0709 12:11:42.569875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.570072 (+   197us) service_pool.cc:224] Handling call
0709 12:11:57.960385 (+15390313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:54.899017 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:54.910460 (+ 11443us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:54.910507 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:11:54.910524 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:54.911540 (+  1016us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:54.911625 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:54.911666 (+    41us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:11:54.912610 (+   944us) tablet.cc:701] Row locks acquired
0709 12:11:54.912665 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:11:54.940523 (+ 27858us) write_op.cc:270] Start()
0709 12:11:54.940669 (+   146us) write_op.cc:276] Timestamp: P: 1783599114940458 usec, L: 0
0709 12:11:54.940689 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:11:54.941317 (+   628us) log.cc:844] Serialized 4396 byte log entry
0709 12:11:55.141293 (+199976us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b180000cc40. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:11:55.243208 (+101915us) op_driver.cc:464] REPLICATION: finished
0709 12:11:55.316205 (+ 72997us) write_op.cc:301] APPLY: starting
0709 12:11:55.316302 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:55.331193 (+ 14891us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:55.331228 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:55.529271 (+198043us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:55.529510 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:11:55.529552 (+    42us) write_op.cc:312] APPLY: finished
0709 12:11:55.529822 (+   270us) log.cc:844] Serialized 105 byte log entry
0709 12:11:55.529968 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:55.530090 (+   122us) write_op.cc:454] Released schema lock
0709 12:11:55.530136 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:55.530514 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:55.530540 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":278129,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":72771,"apply.run_cpu_time_us":14330,"apply.run_wall_time_us":214286,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50085,"num_ops":11,"prepare.queue_time_us":197919,"prepare.run_cpu_time_us":11792,"prepare.run_wall_time_us":229894,"raft.queue_time_us":99499,"raft.run_cpu_time_us":45406,"raft.run_wall_time_us":60304,"replication_time_us":302383,"spinlock_wait_cycles":16457600,"thread_start_us":338632,"threads_started":4,"wal-append.queue_time_us":94005,"wal-append.run_cpu_time_us":21989,"wal-append.run_wall_time_us":1413710}]]}
I20260709 12:11:57.974691  5019 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:11:57.969977  4770 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 7 to 9, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 9 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:11:57.974924  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.974802  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.975231  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.976948  5024 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 19.
I20260709 12:11:57.975903  5017 raft_consensus.cc:1275] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:11:57.965098 10566 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:57.977200  5023 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 18.
I20260709 12:11:57.979562  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:57.978570  4915 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:57.977777 10345 consensus_queue.cc:1048] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:11:57.980684 10759 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:57.981948 10759 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.983873 10759 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:57.984928  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:57.978566 10563 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.985865  4916 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:57.985984 10653 consensus_queue.cc:1048] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:57.984831 10681 raft_consensus.cc:2804] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:57.986538 10161 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:57.986883 10161 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:57.986821 10685 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:57.987468 10161 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:57.987968  5599 raft_consensus.cc:2468] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:57.982808  4770 catalog_manager.cc:5697] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 12 to 14, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:57.989117 10563 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:57.990613 10560 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:11:57.990979 10560 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:57.989425  4770 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 12 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.994294  4990 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:57.995520 10345 raft_consensus.cc:2804] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:57.995877 10759 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:57.995995 10345 raft_consensus.cc:697] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:57.996986 10345 consensus_queue.cc:237] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.997682 10161 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.999650 10161 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:58.000941  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:58.002142  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:58.006244  4944 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:58.011130  4944 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:58.012468  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:58.014770  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:58.015972  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:58.016940  5020 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:11:58.017158  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:58.018038  4943 raft_consensus.cc:2393] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 12: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:58.014734  4915 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.019193  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:58.019474  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:58.019850  4951 raft_consensus.cc:2393] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 in current term 16: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:58.020253  4942 raft_consensus.cc:2410] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:58.020618  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:58.021311  5019 raft_consensus.cc:2393] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 11: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:58.022768  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:58.024708  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:58.025274  5016 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.012246  5602 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.002596 10759 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.995005 10560 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:57.993949  4770 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:58.036708  5016 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:58.037942  4915 leader_election.cc:304] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.041661  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:58.042320  4950 raft_consensus.cc:2393] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 11: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:58.042532  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.045619  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:58.046507  4915 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.039062  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:58.049999  5020 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 23.
I20260709 12:11:58.054345  4871 raft_consensus.cc:1240] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:11:58.054929  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.055526  4874 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
I20260709 12:11:58.057377  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.058936  4869 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 22. Current term is 23. Ops: []
I20260709 12:11:58.048223  4915 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:58.008592 10193 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.062626  4868 raft_consensus.cc:1240] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:58.037050 10759 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:58.065218  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.037406 10576 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:57.980604 10737 consensus_queue.cc:1048] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:11:58.039811 10161 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.987221 10610 consensus_queue.cc:1048] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:11:58.051102 10276 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:58.061703 10615 consensus_queue.cc:1175] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f3bf546572147c3abe4522189e86ce6" responder_term: 24 status { last_received { term: 23 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 23. Current term is 24. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:58.089221  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.047147 10542 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:58.050967 10718 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.087353  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.096599  4872 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 19.
I20260709 12:11:58.070791 10560 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:11:58.063241 10390 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:11:58.090739 10752 consensus_queue.cc:1048] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:58.094751  5602 raft_consensus.cc:2468] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:11:58.068513 10608 raft_consensus.cc:493] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.085734  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:58.116719  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:58.125248  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 138742us
I20260709 12:11:58.080360 10748 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:11:58.126838  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:58.131542  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 45891.7us
I20260709 12:11:58.079382 10360 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:11:58.158958  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15263062183540bdbd45628b3342a3d5" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:58.161619  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:11:58.165238  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 45234.5us
I20260709 12:11:58.167680  5568 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:58.179111  4915 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.130896 10681 raft_consensus.cc:697] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:58.148343 10748 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.186619  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.198781  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:58.206241  4839 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:58.208048  4872 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:11:58.183373 10748 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:58.167135 10572 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:58.167050 10756 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:58.190091 10718 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.189347 10755 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.123343 10757 consensus_queue.cc:1059] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 12:11:58.250347  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:58.205245 10567 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:58.265235  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
W20260709 12:11:58.269181  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 295414us
I20260709 12:11:58.270659  5567 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:58.273999  5567 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:58.132236 10608 raft_consensus.cc:515] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.197561 10566 consensus_queue.cc:1048] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 12:11:58.252228 10591 raft_consensus.cc:2749] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:58.277158  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 109544us
I20260709 12:11:58.246690 10714 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:11:58.276674 10782 raft_consensus.cc:2804] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:58.277285 10649 raft_consensus.cc:3055] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:58.289750  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:58.290408  5599 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:11:58.293018 10193 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:58.295997 10718 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:58.296460 10718 raft_consensus.cc:3060] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.299635  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:58.304188  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:58.305037  5603 raft_consensus.cc:2410] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:58.286878 10769 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:58.305655 10769 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting leader election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:58.305996 10769 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:58.306231  4916 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:11:58.306941 10767 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.367s	user 0.000s	sys 0.003s
I20260709 12:11:58.307128 10737 raft_consensus.cc:2804] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:58.277493 10757 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:58.263767 10592 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:58.253049 10572 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.266043  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:58.304970  5599 raft_consensus.cc:1240] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:58.289827 10763 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:11:58.314762  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 48800.8us
I20260709 12:11:58.321165  5603 raft_consensus.cc:3055] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:58.284521  5568 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.288689 10649 raft_consensus.cc:740] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:58.321543  5603 raft_consensus.cc:740] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:58.311275 10592 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:58.365379  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 80934.7us
W20260709 12:11:58.407732  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.264739 10681 consensus_queue.cc:237] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.307678 10737 raft_consensus.cc:697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 17 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:58.309355 10782 raft_consensus.cc:697] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:58.315876 10757 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:58.413494  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:58.413888  5603 consensus_queue.cc:260] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.460189  5603 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:58.414796 10766 log.cc:927] Time spent T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.473s	user 0.001s	sys 0.000s
W20260709 12:11:58.415566 10770 log.cc:927] Time spent T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:11:58.416321 10779 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 12:11:58.416414  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 73468.5us
I20260709 12:11:58.418732 10624 raft_consensus.cc:3055] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:58.504946 10624 raft_consensus.cc:740] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:58.505779 10624 consensus_queue.cc:260] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:58.507871  4840 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:58.507754 10718 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:58.418686 10649 consensus_queue.cc:260] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.459965 10560 consensus_queue.cc:1048] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:11:58.509865 10649 raft_consensus.cc:3060] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.510792 10759 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.514242  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:58.514803  4946 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:58.515044  4840 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:58.515403 10549 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:58.515903 10549 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:11:58.419934 10761 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.478s	user 0.000s	sys 0.001s
I20260709 12:11:58.421764  5604 raft_consensus.cc:1240] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:11:58.424561 10762 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
W20260709 12:11:58.425374 10768 log.cc:927] Time spent T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:11:58.431438 10748 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.433166 10572 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:58.434458  4950 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:58.412799  4947 raft_consensus.cc:1240] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:11:58.445885  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:58.453533 10608 leader_election.cc:290] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:58.454281  4841 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:58.458086  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:58.537402  5599 raft_consensus.cc:2393] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 17: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:58.474969  5024 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:11:58.541906  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:58.504995 10754 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.471555  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:58.476774  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.523005  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:58.548941  5602 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.526494  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:58.446475 10592 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:58.529138  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.522490  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:11:58.534880  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 75892.2us
I20260709 12:11:58.509315 10612 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:58.478734  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dd0599104f4ef0a0f49401f0f0687c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:11:58.543475  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 89272.2us
I20260709 12:11:58.543633  5599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15263062183540bdbd45628b3342a3d5"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:39450
I20260709 12:11:58.553905  5599 raft_consensus.cc:606] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:58.554250  5599 raft_consensus.cc:614] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:58.499377 10698 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.518802 10759 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 19 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:58.556172  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:58.450042 10565 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
W20260709 12:11:58.471728 10615 consensus_queue.cc:1175] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "baa50eb5ed704004b7f391934a59d010" responder_term: 16 status { last_received { term: 14 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ab9da67236874634be59ebfd05b18255 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:11:58.546590 10774 log.cc:927] Time spent T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:58.565414  5023 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:58.535508 10622 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:11:58.568857  4917 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:58.551636 10223 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:11:58.551786 10542 consensus_queue.cc:1059] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:11:58.565267 10608 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.575047 10549 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:58.553128 10754 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:58.589079 10622 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 23 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:58.590157 10754 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:58.589933 10622 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:58.591281  5602 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:11:58.548945 10360 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:58.549933 10161 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.593056 10161 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:58.594959 10161 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:58.595196 10592 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.567951 10390 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:11:58.585836 10769 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.598220 10769 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:58.598755 10769 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.599181 10769 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.586956 10781 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:58.577484 10718 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:58.602349 10782 consensus_queue.cc:237] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.603727 10592 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:58.604919 10737 consensus_queue.cc:237] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.610458  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.612470  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.617571  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.615170 10718 raft_consensus.cc:3055] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:11:58.618135 10765 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.611582 10345 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:58.622421  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.568982 10698 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.615598 10567 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:58.616154 10161 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:58.630477  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:58.631750  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.633258  4871 raft_consensus.cc:2393] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 14: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:58.619673 10718 raft_consensus.cc:740] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:58.644332  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:58.644951  4873 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:58.623574 10552 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:58.617446 10752 consensus_queue.cc:1059] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 12:11:58.627321 10608 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:58.624588 10345 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:58.626432  5023 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 19.
I20260709 12:11:58.681550 10345 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:58.701887  5603 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:11:58.702271  5603 pending_rounds.cc:85] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Aborting all ops after (but not including) 12
I20260709 12:11:58.702478  5603 pending_rounds.cc:107] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:11:58.702690  5603 raft_consensus.cc:2889] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:58.684217 10608 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:58.733925 10567 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.737004 10769 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:58.769275 10759 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.785218  4873 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 20.
I20260709 12:11:58.748308 10567 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:58.816880  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 289554us
W20260709 12:11:58.823503  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 285403us
W20260709 12:11:58.823135  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 280294us
I20260709 12:11:58.824683  5570 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:11:58.822876  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 280070us
I20260709 12:11:58.825495 10681 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:58.825978 10681 raft_consensus.cc:493] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:58.826393 10681 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.835229  5021 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:58.836546  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:58.838840  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.839422  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.839452  4871 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:11:58.842221  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:58.844012  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:58.844153  5603 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 24 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 12:11:58.822613 10760 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.629s	user 0.003s	sys 0.003s
I20260709 12:11:58.847484  4945 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 19: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:58.848798  4947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:58.815161 10578 raft_consensus.cc:493] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:58.853780  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.817250 10698 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:58.856971  5023 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:58.794242 10759 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.855137  5570 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.782546 10608 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:58.878041  5603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef"
dest_uuid: "ab9da67236874634be59ebfd05b18255"
mode: GRACEFUL
new_leader_uuid: "4f3bf546572147c3abe4522189e86ce6"
 from {username='slave'} at 127.0.0.1:39450
I20260709 12:11:58.878604  5603 raft_consensus.cc:606] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Received request to transfer leadership to TS 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:58.878907  5603 raft_consensus.cc:614] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:58.862694 10612 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:58.882272  5570 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:58.872856 10754 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:58.868618 10758 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 12:11:58.868991 10057 consensus_queue.cc:1059] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:11:58.897998 10057 raft_consensus.cc:3055] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:58.898293 10199 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.898833 10199 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.900086 10360 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:58.900832 10754 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.901224 10754 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:58.862550 10578 raft_consensus.cc:515] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:58.904316  5025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55716 (request call id 2844) took 1364 ms. Trace:
I20260709 12:11:58.904942 10193 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:58.905953  4840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.911237 10567 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:58.916955  5023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee4c2e710f7a41958315091dfd907d8d"
dest_uuid: "baa50eb5ed704004b7f391934a59d010"
mode: GRACEFUL
new_leader_uuid: "8de40fe2bb814adcbe13958669063dc9"
 from {username='slave'} at 127.0.0.1:36232
I20260709 12:11:58.917491  5023 raft_consensus.cc:606] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:58.917821  5023 raft_consensus.cc:614] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:58.904683  5025 rpcz_store.cc:276] 0709 12:11:57.539653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.541090 (+  1437us) service_pool.cc:224] Handling call
0709 12:11:57.541390 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:57.541741 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.541770 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:57.542267 (+   497us) log.cc:844] Serialized 52 byte log entry
0709 12:11:57.836250 (+293983us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:57.846642 (+ 10392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.846719 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.740508 (+893789us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:58.904057 (+163549us) raft_consensus.cc:1685] finished
0709 12:11:58.904077 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.904264 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24484,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"spinlock_wait_cycles":18266496,"thread_start_us":293633,"threads_started":1,"wal-append.queue_time_us":572859}
I20260709 12:11:58.871865 10223 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:11:58.931248  4916 leader_election.cc:304] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:58.937345  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:58.938045  5603 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 19: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:58.917505 10199 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:58.898321 10057 raft_consensus.cc:740] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:11:58.959874  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:58.961611  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:58.962412  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:58.933094 10563 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:58.939252 10567 raft_consensus.cc:2749] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:58.977037  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 84159.4us
I20260709 12:11:58.978828  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:58.979431  4871 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:11:58.979991  5602 raft_consensus.cc:1240] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 18. Current term is 19. Ops: []
W20260709 12:11:58.984975 10787 log.cc:927] Time spent T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:11:58.987175  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:58.989518  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:58.991214 10697 consensus_queue.cc:1059] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:58.992017 10697 raft_consensus.cc:3055] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:11:58.992354 10697 raft_consensus.cc:740] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:58.994467  5603 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:58.998971  4873 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:58.974007 10803 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.002651  4990 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:11:59.005609 10758 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.010318 10758 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.012960 10798 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:59.014878 10572 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:11:59.017047 10649 consensus_meta.cc:287] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Time spent flushing consensus metadata: real 0.507s	user 0.002s	sys 0.008s
I20260709 12:11:59.017598 10697 consensus_queue.cc:260] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.018764 10697 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:59.022102 10803 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:59.024854  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 466843us
I20260709 12:11:59.043344  4915 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: ab9da67236874634be59ebfd05b18255
W20260709 12:11:59.044179  4988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.045835  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:59.046414  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.047016  5017 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:11:59.047119  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.046387  5018 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:59.047896  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.046726  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:59.059966  5599 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 9.
I20260709 12:11:59.060046  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:59.060835  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:59.061457  4915 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:58.981685 10681 raft_consensus.cc:515] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:11:59.064143  5569 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.061556  5016 raft_consensus.cc:2393] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 19: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:11:59.064589 10608 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.070457  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.074550  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.023530 10057 consensus_queue.cc:260] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.080408 10057 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.066201 10572 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:59.081364 10572 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.048137 10193 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:59.001273 10612 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.085975 10759 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.088068  5018 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 20.
I20260709 12:11:59.089805 10572 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:59.090628 10748 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.091130  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:59.093034  4915 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:59.095422 10752 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:11:59.095906 10752 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 20 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:59.069895 10608 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.098292 10608 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.104334  4988 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:59.055047 10567 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:59.109566  5017 raft_consensus.cc:2468] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 19.
I20260709 12:11:59.111281  5024 raft_consensus.cc:2468] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:59.120705  5598 raft_consensus.cc:1240] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.120857  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.121543  4943 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 8.
I20260709 12:11:59.124537 10803 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:59.124953  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 47449.7us
W20260709 12:11:59.127077 10805 log.cc:927] Time spent T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:59.131110 10754 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.134160  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.134445 10345 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.135756  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c02d3930da4dfba1f61356e4562709" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.136533  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:59.136974  5602 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:11:59.140923  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.141541  5604 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:59.106082 10572 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:59.145545 10785 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.465s	user 0.000s	sys 0.001s
I20260709 12:11:59.153192  5602 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 20.
I20260709 12:11:59.137981 10567 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 19 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:59.161674  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 56322.6us
I20260709 12:11:59.156284  4916 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:59.165051  4916 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:59.163779  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:59.187074  4915 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:11:59.188340  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.185256 10748 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:59.096769 10752 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.186508 10753 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:59.190687 10698 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:59.200459 10698 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.193225 10754 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:59.199316  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:59.200817  4948 raft_consensus.cc:1275] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:59.200845 10698 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:59.193050 10276 raft_consensus.cc:2804] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:59.197387 10748 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.208002 10748 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:59.213197 10276 raft_consensus.cc:697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:59.214246 10276 consensus_queue.cc:237] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.219827  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:59.221650 10807 log.cc:927] Time spent T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:11:59.219177 10578 leader_election.cc:290] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.491911 10793 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.237040 10765 consensus_queue.cc:1059] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.263s
I20260709 12:11:59.529942 10765 raft_consensus.cc:3055] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.530303 10765 raft_consensus.cc:740] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:59.531080 10765 consensus_queue.cc:260] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.532369 10765 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.483538 10697 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:59.533345 10697 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.535960 10697 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.539426 10624 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:59.541034 10777 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 1.130s	user 0.006s	sys 0.001s
W20260709 12:11:59.497529 10825 log.cc:927] Time spent T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
I20260709 12:11:59.493326 10576 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.526130 10608 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.524506  4946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43248 (request call id 1251) took 1072 ms. Trace:
I20260709 12:11:59.516405 10578 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.546468  4946 rpcz_store.cc:276] 0709 12:11:58.451709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.515358 (+ 63649us) service_pool.cc:224] Handling call
0709 12:11:58.515634 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.515926 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.515952 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.516303 (+   351us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.862446 (+346143us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:58.878046 (+ 15600us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.880794 (+  2748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.880884 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.088102 (+207218us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b18002d6880. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a606c5ab1 00007f2a606d2281 00007f2a577fd3f3 00007f2a577ff7c1 00007f2a577ff779 00007f2a577ff709 00007f2a577ff6d1 00007f2a577fe9cd 0000000000388634 0000000000388479 00007f2a577e083a
0709 12:11:59.524213 (+436111us) raft_consensus.cc:1685] finished
0709 12:11:59.524307 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.524448 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3836,"prepare.queue_time_us":18832,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":6373,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":10361,"spinlock_wait_cycles":6118272,"thread_start_us":345825,"threads_started":1,"wal-append.queue_time_us":486650}
I20260709 12:11:59.240412 10567 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.557596 10834 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:59.547644 10345 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.562295 10759 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:59.562796 10759 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.564669 10759 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.547569 10576 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.565078 10565 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:59.565543 10565 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.550655 10578 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.548838 10793 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.547163 10748 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.558248 10834 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.569994 10565 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.572537 10793 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.555238 10697 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:59.579478 10748 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.580456 10608 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.566711 10698 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.566648 10576 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.573993 10759 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.623798  5023 raft_consensus.cc:2393] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 in current term 10: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:11:59.624042 10698 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.605484 10565 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:59.629222 10565 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.631151 10565 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.621332 10759 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.633515 10759 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.617125 10193 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.637360 10193 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.638450 10610 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.639204 10610 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.641162 10803 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:59.645915 10803 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.647842 10803 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.638747 10592 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.639333 10193 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.619450 10697 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.645021 10565 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:11:59.651659 10592 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.659628 10610 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.664422  5601 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:59.666514  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.667584 10592 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.669219  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:59.669771  5603 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:59.671655  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.680677  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.681452  4948 raft_consensus.cc:2410] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab9da67236874634be59ebfd05b18255 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:59.686365  5567 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:59.687600  5567 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:59.690052 10566 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:11:59.684214 10718 consensus_queue.cc:260] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:11:59.690960 10718 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:11:59.689446 10592 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:11:59.694878 10786 log.cc:927] Time spent T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 1.047s	user 0.004s	sys 0.000s
I20260709 12:11:59.697186  5597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1651) took 1396 ms. Trace:
I20260709 12:11:59.697510  5597 rpcz_store.cc:276] 0709 12:11:58.300438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.301150 (+   712us) service_pool.cc:224] Handling call
0709 12:11:58.301440 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.301765 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.301791 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.302169 (+   378us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.452323 (+150154us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:58.498711 (+ 46388us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.930309 (+431598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.930378 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.694385 (+764007us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:59.696918 (+  2533us) raft_consensus.cc:1685] finished
0709 12:11:59.697006 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.697123 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100385,"prepare.queue_time_us":45870,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":105756,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":384417024,"thread_start_us":512263,"threads_started":2,"wal-append.queue_time_us":316081}
I20260709 12:11:59.708170  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.708434  5603 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:59.713208  4946 raft_consensus.cc:1275] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:59.717053  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.719559  4943 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
W20260709 12:11:59.717892 10789 log.cc:927] Time spent T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.938s	user 0.000s	sys 0.011s
I20260709 12:11:59.709553 10390 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:11:59.722029  4916 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:59.732913  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:11:59.733431  4839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.738417  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d62e31abaf34e25ad480865e4285e64" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.741792  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.739938 10755 raft_consensus.cc:2804] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:59.749750  5567 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:11:59.740599 10624 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:59.740280 10565 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:59.752224  5598 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:11:59.748351 10755 raft_consensus.cc:697] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:11:59.758673 10201 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:59.769004 10201 raft_consensus.cc:493] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.769332 10201 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:59.758849 10624 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.774739 10624 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.757840 10565 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.757925 10566 consensus_queue.cc:1048] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:11:59.779407  5023 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:11:59.781415  5019 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:11:59.782347  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9023c271389540b8a7b43d63718a4c7a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.782809 10754 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:59.790696  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.791834  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.792397  5019 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:11:59.793335  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.793833  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:59.794334 10755 consensus_queue.cc:237] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.795758  5019 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:11:59.796558  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.797154  4951 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:11:59.797928  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:11:59.798418  4951 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:59.799683 10754 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.800129  5568 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:11:59.801280 10800 raft_consensus.cc:3060] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:59.801703 10754 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.790362 10835 consensus_queue.cc:1048] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:11:59.783154  5025 raft_consensus.cc:2410] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:59.761943 10567 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:11:59.783432  5022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.784181  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.784328  4991 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:59.806290 10835 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.785701  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.807246  5023 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 24.
I20260709 12:11:59.808513  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.808671 10800 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:59.809127  5597 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:11:59.786393  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.793395  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.811101  5018 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:11:59.811995  4942 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 17.
I20260709 12:11:59.788193  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:11:59.813118  5020 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.776638 10565 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:11:59.825297  4839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 77796.5us
I20260709 12:11:59.828013  5020 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:59.833400  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.822880  4951 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:11:59.837558  5020 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:11:59.843743  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.845587 10714 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:59.846240 10851 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:59.846102 10714 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:11:59.846796 10851 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.848140 10714 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.849908  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:59.842814  4988 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:59.810391 10834 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.849483  4915 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:59.850950  4988 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:59.855363  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.856760 10714 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:11:59.857157 10851 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.857420  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:59.857265 10714 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.858052  4871 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 9.
I20260709 12:11:59.859047  4839 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:11:59.859428 10714 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.860631  4867 raft_consensus.cc:1240] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 23 LEADER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:11:59.860703  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:59.860961  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:59.862303  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:59.862793  4873 raft_consensus.cc:3060] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:59.870074  4873 raft_consensus.cc:2468] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 10.
I20260709 12:11:59.871493  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:59.871735  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:11:59.872303  4871 raft_consensus.cc:2410] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:59.872445  4867 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 16: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:11:59.876045  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:11:59.878458  4873 raft_consensus.cc:3060] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.880518  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "231547812bf34f17b386898e6451cc49" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.881188  4951 raft_consensus.cc:2368] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14.
I20260709 12:11:59.881883  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.882552  4946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:11:59.887825  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:11:59.889452  4839 leader_election.cc:400] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14.
I20260709 12:11:59.890105  4839 leader_election.cc:403] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:59.891292  5018 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:11:59.891505  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 141849us
I20260709 12:11:59.883421 10754 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:59.884686 10698 raft_consensus.cc:2804] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:59.905005  4916 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.883193 10697 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:59.899711  4873 raft_consensus.cc:2468] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:11:59.892731 10834 raft_consensus.cc:2804] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:59.888293 10840 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:11:59.895874 10765 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.913810 10698 raft_consensus.cc:697] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
W20260709 12:11:59.914724 10849 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:59.911527 10840 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:11:59.915190 10784 log.cc:927] Time spent T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 1.177s	user 0.002s	sys 0.002s
I20260709 12:11:59.915875 10863 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:59.957484  4950 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 23 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 12:11:59.957907  4950 pending_rounds.cc:85] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 15
I20260709 12:11:59.958144  4950 pending_rounds.cc:107] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 12:11:59.958355  4950 raft_consensus.cc:2889] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:59.927194 10844 log.cc:927] Time spent T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:11:59.929989 10681 leader_election.cc:290] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:11:59.965224  4949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52392 (request call id 3647) took 1926 ms. Trace:
I20260709 12:11:59.934818 10578 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:11:59.943969 10201 raft_consensus.cc:515] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.978677 10201 leader_election.cc:290] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.944386 10758 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.944736 10757 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:11:59.920799 10754 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:11:59.980175 10754 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.921034 10765 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:59.981503 10765 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.984077 10698 consensus_queue.cc:237] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.957394 10840 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:11:59.987234  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811353fb6b174f3e96608844f05794de" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:59.987546  5568 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:11:59.987950  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:11:59.964095 10861 log.cc:927] Time spent T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:59.972724 10864 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.989122  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.989509 10864 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.991467 10201 raft_consensus.cc:2804] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:11:59.973999 10834 raft_consensus.cc:697] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
W20260709 12:11:59.974489  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 63388us
I20260709 12:11:59.991966 10201 raft_consensus.cc:697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 19 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:11:59.974970 10566 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:11:59.993125  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "951f0af961a844849af172b241003482" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.993088 10566 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.994237  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:11:59.994786  5601 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 16.
I20260709 12:11:59.995183 10566 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:11:59.995561  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:11:59.996184  5602 raft_consensus.cc:2368] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 17. Current term is 18.
I20260709 12:11:59.997056 10836 raft_consensus.cc:493] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:11:59.997603 10836 raft_consensus.cc:515] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.998225 10567 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:11:59.998692 10567 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:11:59.990134  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.001480  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.001117 10201 consensus_queue.cc:237] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.003218  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:11:59.975173 10161 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:59.965610  4949 rpcz_store.cc:276] 0709 12:11:58.039217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.039337 (+   120us) service_pool.cc:224] Handling call
0709 12:11:58.039598 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.122673 (+ 83075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.122702 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.159683 (+ 36981us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.552888 (+393205us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:58.552972 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.780788 (+1227816us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b54001a2f54. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8eae01 00007f2a5a8e983e 00007f2a5f8ae419 00007f2a58e25bd4 00007f2a58e25b62 00007f2a58e25a91 00007f2a58e25a0c 00007f2a58e24cc2 00007f2a58c2548c 00007f2a58c248c6
0709 12:11:59.783746 (+  2958us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:59.884583 (+100837us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b4400022b4c. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a57685db1 00007f2a57723c85 00007f2a577246a2 00007f2a5a4961db 00007f2a5a491aaf 00007f2a5a48586e 00007f2a5a484bb6 00007f2a5a4847d8 00007f2a5a48e221 00007f2a5a48e1d9 00007f2a5a48e169
0709 12:11:59.965007 (+ 80424us) raft_consensus.cc:1685] finished
0709 12:11:59.965031 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.965164 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29780,"raft.queue_time_us":32581,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":27174,"spinlock_wait_cycles":294567424,"thread_start_us":341569,"threads_started":1,"wal-append.queue_time_us":490517}
I20260709 12:12:00.003984  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e3c47814549fe8cf64abe52c00d29" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.004540  5605 raft_consensus.cc:2468] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:12:00.000597 10567 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.096019  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.082322  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:12:00.009397  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 125030us
I20260709 12:12:00.099201  4950 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:00.061509  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:00.043202  4915 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.061808  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.102486  4840 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
W20260709 12:12:00.102602  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 59496.4us
I20260709 12:12:00.105398  5019 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:00.009795  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.006058  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f05b369a3a4067afed9c87ba39f448" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:00.068006 10769 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:00.098243 10851 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:00.115777  5603 raft_consensus.cc:2393] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 14: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:11:59.991489 10864 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.081969 10854 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:00.062917 10856 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:00.103039 10587 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.105289 10753 raft_consensus.cc:493] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:00.107585 10567 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:00.109748 10758 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.133136  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.013537 10836 leader_election.cc:290] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.003957 10865 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473) with higher term. Message: Invalid argument: T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for earlier term 13. Current term is 14.
I20260709 12:12:00.154764  4949 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:12:00.155503  4950 raft_consensus.cc:2468] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 18.
I20260709 12:12:00.020880 10612 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.135s
I20260709 12:12:00.162254 10866 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:00.168239  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.169706  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.167681  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.177150  4867 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 16: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:12:00.177331  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:12:00.134063 10587 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
W20260709 12:12:00.181536 10855 log.cc:927] Time spent T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:12:00.189378 10867 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:00.261584 10867 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.263679 10867 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.132582 10854 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.132720 10856 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.190199  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.152945 10753 raft_consensus.cc:515] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:00.242717 10587 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:00.282094  5603 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:00.272239  5567 leader_election.cc:304] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.283349  5567 leader_election.cc:304] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:12:00.244000 10840 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.249267  4867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.250427  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.251077  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.105894 10834 consensus_queue.cc:237] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:00.253432 10765 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.191772  4872 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.268791  4917 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.293285  4917 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.297436  4917 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.298183  4867 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:00.300568 10856 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.300643 10753 leader_election.cc:290] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:00.291873 10771 raft_consensus.cc:2804] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.302462  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:00.303200 10854 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.303133 10161 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:00.291139 10615 raft_consensus.cc:2804] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:00.304730 10771 raft_consensus.cc:697] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:12:00.305670 10771 consensus_queue.cc:237] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.305393 10615 raft_consensus.cc:697] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 18 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:12:00.295810 10759 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.295392 10718 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.308094 10615 consensus_queue.cc:237] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.311879 10840 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 25 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:00.131537 10755 consensus_queue.cc:1059] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.157s
I20260709 12:12:00.317776  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.318336  4873 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:12:00.320348  4868 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:00.131868 10769 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.321653  4869 raft_consensus.cc:1275] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:00.323212  5597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:00.323762  4872 raft_consensus.cc:2468] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
I20260709 12:12:00.325589  4873 raft_consensus.cc:1240] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Rejecting Update request from peer 8de40fe2bb814adcbe13958669063dc9 for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:00.318166  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:00.328635  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950c0e5da47a49abb359c63b8483f487" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:12:00.329217  4868 raft_consensus.cc:3060] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.329530  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:12:00.333735  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 229693us
I20260709 12:12:00.336858  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.338338  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.321480 10161 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:00.345304  5597 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:12:00.348170  4990 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.349469  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.362174  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.366529  4990 leader_election.cc:304] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.393774  4990 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:00.395038  4990 leader_election.cc:400] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 election: Vote denied by peer ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297) with higher term. Message: Invalid argument: T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 17. Current term is 18.
W20260709 12:12:00.399379  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 288152us
I20260709 12:12:00.353050 10390 raft_consensus.cc:493] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:00.396032  4990 leader_election.cc:304] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.404378  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.401674  4991 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:00.353411 10578 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:00.411690  5570 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.413072  4868 raft_consensus.cc:2468] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:12:00.419297  5570 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.423471  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.424690  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:12:00.423616  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.437268 10552 raft_consensus.cc:3055] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:00.437674 10552 raft_consensus.cc:740] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:12:00.438428 10552 consensus_queue.cc:260] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:00.400480 10587 raft_consensus.cc:2749] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:00.408450 10798 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.446208  4991 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:00.443145  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:12:00.444341  4871 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:00.463624  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.467121  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:00.468799  4874 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 16: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
I20260709 12:12:00.421468 10795 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.425809 10566 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.447444 10856 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:00.480213 10873 log.cc:927] Time spent T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:12:00.416615 10390 raft_consensus.cc:515] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.463469 10793 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.439549 10552 raft_consensus.cc:3060] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.468129 10798 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:00.455247 10876 raft_consensus.cc:2749] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:00.476008 10833 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:00.481365 10875 raft_consensus.cc:2804] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:00.496966 10798 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.495776 10836 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:00.504364 10754 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:00.517709 10875 raft_consensus.cc:697] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:00.505412 10833 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:12:00.537125  4841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.020s	sys 0.049s
I20260709 12:12:00.517863 10769 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:00.540913  4841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.020s	sys 0.049s
I20260709 12:12:00.555807  4841 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.556542 10758 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.557801  4841 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.558538 10758 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:00.564510  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 144178us
I20260709 12:12:00.518254 10836 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:00.566566  5599 raft_consensus.cc:1275] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:12:00.568887 10390 leader_election.cc:290] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.570154  5570 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.572007 10800 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.576267 10161 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:00.578763 10878 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:00.579304 10878 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:00.581349 10878 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:00.586090 10765 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.589983 10612 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.590440 10612 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:00.592012  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.592357 10612 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:00.536051 10753 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:00.593472  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:00.594413  4950 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 16.
I20260709 12:12:00.595896  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.604060 10875 consensus_queue.cc:237] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:00.606067 10836 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:00.607865 10782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.960s	user 0.003s	sys 0.028s
I20260709 12:12:00.613502  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:00.613900  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.614748  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.615324  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.615700  5602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.616386  5601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:12:00.617775 10782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.970s	user 0.003s	sys 0.029s
I20260709 12:12:00.643797  5602 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:12:00.645347 10871 log.cc:927] Time spent T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.404s	user 0.005s	sys 0.001s
I20260709 12:12:00.607357 10753 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.648306 10753 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:00.649155  4950 raft_consensus.cc:3060] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.680263  5604 raft_consensus.cc:1240] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 25 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:00.683280  4873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:00.683912  4873 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 16.
I20260709 12:12:00.722038  4841 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.724440  4841 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.727149  4841 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.728482  4841 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:00.732776  4841 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.719960 10833 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:00.730741 10864 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:00.729804 10611 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.730629 10882 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:00.733925 10856 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:00.735845 10854 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.764164  4945 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:12:00.778017  4841 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.163.68:44297 timed out after 2.165s (SENT) [suppressed 13 similar messages]
I20260709 12:12:00.743781 10826 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.747123 10833 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:00.789163  5020 raft_consensus.cc:1275] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:00.790943  5024 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:12:00.740921 10757 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:12:00.793728  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf61812afc64320acafb43ddc29f4a2" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.741397 10591 consensus_queue.cc:1059] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:00.795449  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:00.796883  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.799083  5021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.799681  5021 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 11.
I20260709 12:12:00.802404  5024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.806828  5018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:00.814035  5024 raft_consensus.cc:2393] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 19: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:12:00.788748 10826 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.859895  5025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:00.860500  5025 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 15.
W20260709 12:12:00.861894  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.830729 10878 raft_consensus.cc:493] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.863404  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:00.798808 10833 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.868846  5606 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 18 LEADER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:00.866487  4945 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:00.867797  5023 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:00.872279  4875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:12:00.861302 10887 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 12:12:00.875883  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 97901.9us
I20260709 12:12:00.872067  4840 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:00.879762  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:00.880964  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:00.853186 10587 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:00.888284  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:00.883601  4945 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 16: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:12:00.899004  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da27e3db08424ba7a8f3d771f12de9a7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:12:00.884567  5600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1650) took 2579 ms (client timeout 2165 ms). Trace:
W20260709 12:12:00.900432  5600 rpcz_store.cc:269] 0709 12:11:58.298704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.299430 (+   726us) service_pool.cc:224] Handling call
0709 12:12:00.878150 (+2578720us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b540059ddd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8ee2fa 00007f2a5f8afb17 00007f2a58e2a6d4 00007f2a58e2a662 00007f2a58e2a591 00007f2a58e2a50c 00007f2a58e297c2 00007f2a58c2548c 00007f2a58c248c6 00007f2a58c2426f
0709 12:12:00.878259 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5448013056}
I20260709 12:12:00.902384  5599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:00.869803 10390 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 12:12:00.908205 10811 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.886204 10864 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:00.909174  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:12:00.909603 10901 log.cc:927] Time spent T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:12:00.910071 10811 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:00.910527 10811 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.878561 10772 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:00.917392  5604 raft_consensus.cc:1275] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:00.863914 10552 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 12:12:00.962651  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 46816.6us
I20260709 12:12:00.908378 10798 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:00.963760  5568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 48605.9us
W20260709 12:12:00.961181  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 62483.3us
I20260709 12:12:00.870456 10878 raft_consensus.cc:515] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:00.909184 10864 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.977128 10903 consensus_queue.cc:1059] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:12:00.977893 10903 consensus_queue.cc:1243] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Peer ab9da67236874634be59ebfd05b18255 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:00.978323 10903 raft_consensus.cc:3055] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:00.978621 10903 raft_consensus.cc:740] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:00.982023  5020 raft_consensus.cc:1275] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:00.961171 10840 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.921139 10896 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:00.896654 10587 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:01.005524  5016 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 16: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
W20260709 12:12:01.007264  4916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 83480.2us
I20260709 12:12:00.981276 10864 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:00.961274 10876 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 12:12:01.005353 10905 log.cc:927] Time spent T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 12:12:01.015846  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 54344.6us
I20260709 12:12:01.018857  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:01.020396  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:01.022171  4872 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:12:01.027447  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 168315us
W20260709 12:12:01.041294  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 75996.3us
W20260709 12:12:01.041872  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 123157us
I20260709 12:12:01.045728  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:01.049295  4951 raft_consensus.cc:1240] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Rejecting Update request from peer baa50eb5ed704004b7f391934a59d010 for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:01.050410  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:01.009342 10560 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:12:01.051787  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49d7b189f495402dbbaadba00a5cebb8" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:01.040899 10854 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:12:01.054404 10798 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:01.037444 10826 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:01.061081  4871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:12:01.066329  4871 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 16: Already voted for candidate 4f3bf546572147c3abe4522189e86ce6 in this term.
W20260709 12:12:01.062186 10893 log.cc:927] Time spent T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:12:01.043604 10879 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.071293  4915 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:01.072180  4915 leader_election.cc:304] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:01.072707 10833 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:01.073177  4915 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:01.074373  4917 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:12:01.076393 10834 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:01.076575 10390 raft_consensus.cc:2749] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.076947 10898 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:01.077268 10390 consensus_queue.cc:1048] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:01.078514 10552 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.078938 10755 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:01.080266 10755 consensus_queue.cc:1048] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:01.080567  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3994e4d9351c414cb95b2a6e7bd76142" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:01.083961 10903 consensus_queue.cc:260] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:01.091357  4990 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:01.094202  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
W20260709 12:12:01.094748  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 47844.2us
I20260709 12:12:01.094954  5603 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 16: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:12:01.076877 10718 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:01.078893 10552 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:01.105160  4841 leader_election.cc:304] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:01.106703 10867 raft_consensus.cc:2749] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.099002 10811 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:01.103044 10903 raft_consensus.cc:3060] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:01.096982 10833 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:01.109643 10911 log.cc:927] Time spent T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:01.087395 10834 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:01.114231  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:01.116155 10811 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:01.116886 10878 leader_election.cc:290] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:01.132845  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:01.117801 10587 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:01.121081  4990 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:01.126773  4942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:01.147200  4942 raft_consensus.cc:2393] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 16: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:12:01.128108  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:12:01.128391  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
W20260709 12:12:01.137678  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 62107.2us
I20260709 12:12:01.139950  4945 raft_consensus.cc:2393] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 16: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:12:01.086634 10793 consensus_queue.cc:1048] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:12:01.110760 10552 raft_consensus.cc:3060] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:01.148370  4917 leader_election.cc:304] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:01.151176  4917 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:01.151844 10915 raft_consensus.cc:2749] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.152433 10915 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.153910 10928 consensus_queue.cc:1048] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:12:01.154966 10918 log.cc:927] Time spent T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:12:01.132519 10834 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:01.090359 10879 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:01.167896  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 46922.5us
I20260709 12:12:01.169809  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:01.187022  4988 leader_election.cc:304] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:01.187384  5021 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:01.191344  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:01.175683 10878 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.196017 10879 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:01.197101 10866 raft_consensus.cc:3055] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:01.197472 10866 raft_consensus.cc:740] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:12:01.198190 10866 consensus_queue.cc:260] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:01.207930  4990 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:12:01.209331  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 68524.9us
I20260709 12:12:01.209587  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:01.217857  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:01.218550  4991 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:01.220050 10793 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:01.220256 10896 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:01.221019 10878 raft_consensus.cc:2749] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:01.233407 10896 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.208961 10866 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:01.242190  4875 raft_consensus.cc:1275] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:01.243638  4951 raft_consensus.cc:1275] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:12:01.244004  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:01.198108 10864 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:01.250380 10755 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 12:12:01.269984 10923 log.cc:927] Time spent T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 12:12:01.271083 10916 consensus_queue.cc:1048] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:01.287690  4874 raft_consensus.cc:2368] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 16. Current term is 17.
W20260709 12:12:01.292196 10933 log.cc:927] Time spent T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:12:01.259104 10834 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:01.300001 10864 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:01.301201 10552 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:01.303224 10552 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:01.329123  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:01.329782  4951 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.334751 10834 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:01.336010  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 52476.4us
I20260709 12:12:01.341301 10834 consensus_queue.cc:1048] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:01.345880  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:01.346391  5020 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:01.349406  4951 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 17.
I20260709 12:12:01.349331  4990 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:01.350560  4839 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:12:01.354596 10811 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:01.355964 10865 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:01.356465 10865 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 17 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:12:01.357282 10865 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:01.369194  5016 raft_consensus.cc:1275] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:12:01.369530  5016 pending_rounds.cc:85] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Aborting all ops after (but not including) 12
I20260709 12:12:01.369737  5016 pending_rounds.cc:107] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:12:01.369940  5016 raft_consensus.cc:2889] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:01.375443  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 70496.3us
I20260709 12:12:01.380456  4950 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:12:01.382401  4950 pending_rounds.cc:85] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Aborting all ops after (but not including) 8
I20260709 12:12:01.382690  4950 pending_rounds.cc:107] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:12:01.382973  4950 raft_consensus.cc:2889] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.384778  5020 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 17.
I20260709 12:12:01.408694  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:12:01.425470  4872 raft_consensus.cc:1275] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:12:01.426630  4874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6"
I20260709 12:12:01.436932  4869 raft_consensus.cc:2468] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 14.
I20260709 12:12:01.440454  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:01.442552  5600 raft_consensus.cc:2393] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 14: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
I20260709 12:12:01.447817  4991 leader_election.cc:400] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 16. Current term is 17.
I20260709 12:12:01.448115  4991 leader_election.cc:403] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:01.475356  4917 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: ab9da67236874634be59ebfd05b18255
I20260709 12:12:01.462646 10833 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799) with higher term. Message: Invalid argument: T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 for earlier term 16. Current term is 17.
I20260709 12:12:01.441354 10201 consensus_queue.cc:1048] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:12:01.501034 10903 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:01.506167 10390 raft_consensus.cc:2804] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:01.535569  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:01.537235 10560 consensus_queue.cc:1048] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:01.156441  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:01.509487 10876 consensus_queue.cc:1048] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:12:01.629189  4951 raft_consensus.cc:1240] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Rejecting Update request from peer 4f3bf546572147c3abe4522189e86ce6 for earlier term 11. Current term is 12. Ops: []
W20260709 12:12:01.619036 10937 log.cc:927] Time spent T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:12:01.646895  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 114659us
W20260709 12:12:01.646368 10941 log.cc:927] Time spent T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:12:01.631098 10390 raft_consensus.cc:697] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:12:01.699085 10390 consensus_queue.cc:237] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:01.701550  4915 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:01.704605 10914 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:12:01.790105  4841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 138285us
W20260709 12:12:01.796965  4840 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 135281us
W20260709 12:12:01.788424 10939 log.cc:927] Time spent T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:12:01.797117 10945 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:12:01.855193 10872 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.889914 10872 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:01.892530 10872 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:01.917116  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:01.917992  5604 raft_consensus.cc:2410] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:01.983268 10927 consensus_queue.cc:1059] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:12:01.998759 10615 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:02.147418 10956 log.cc:927] Time spent T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.165s	user 0.012s	sys 0.010s
I20260709 12:12:02.150115 10927 raft_consensus.cc:3055] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:02.150753 10927 raft_consensus.cc:740] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
W20260709 12:12:02.158771  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 171623us
I20260709 12:12:02.165582 10753 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.170670 10753 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:02.138759 10615 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.190287 10927 consensus_queue.cc:260] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:02.193564 10753 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:02.193948 10917 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:02.193461 10928 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:02.204195  4772 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.207059 10753 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:02.211434 10928 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.215003 10928 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:02.206785  4772 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.200116 10917 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:02.219940 10917 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:02.223019  4770 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 361) took 11355 ms (client timeout 15000 ms). Trace:
I20260709 12:12:02.221578  4772 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 11 to 13, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 13 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:02.248245 10615 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:02.261184  4772 catalog_manager.cc:5697] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 14 to 16, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 16 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.248302 10753 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:02.263792  4772 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 13 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 14 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.268133 10753 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:02.273046 10914 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:02.273763 10914 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.276041 10914 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:02.277981  4951 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:02.282418  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:12:02.284111 10957 log.cc:927] Time spent T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: Append to log took a long time: real 0.286s	user 0.007s	sys 0.006s
I20260709 12:12:02.284768  4948 raft_consensus.cc:2410] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:02.287663 10927 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:02.223888  4770 rpcz_store.cc:269] 0709 12:11:50.867124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.867249 (+   125us) service_pool.cc:224] Handling call
0709 12:11:51.096138 (+228889us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a854090 00007f2a5a8f2f3a 00007f2a606a8e9c 00007f2a607a704e 00007f2a5ec682a4 00007f2a5ec68232 00007f2a5ec68161 00007f2a5ec680dc 00007f2a5ec67392 00007f2a58c2548c 00007f2a58c248c6
0709 12:12:02.222764 (+11126626us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:58.748834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:58.815921 (+ 67087us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:58.817142 (+  1221us) write_op.cc:435] Acquired schema lock
0709 12:11:58.822773 (+  5631us) tablet.cc:662] Decoding operations
0709 12:11:58.970335 (+147562us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:58.970421 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:58.970448 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:11:59.020503 (+ 50055us) tablet.cc:701] Row locks acquired
0709 12:11:59.020522 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:11:59.020663 (+   141us) write_op.cc:270] Start()
0709 12:11:59.020769 (+   106us) write_op.cc:276] Timestamp: P: 1783599119020617 usec, L: 0
0709 12:11:59.020789 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:11:59.105757 (+ 84968us) log.cc:844] Serialized 3956 byte log entry
0709 12:11:59.628028 (+522271us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5400298bd4. stack: 00007f2a577cb343 00007f2a577cb240 00007f2a5715a1d4 00007f2a60e98304 00007f2a60e98299 00007f2a5a853571 00007f2a5a8e5e28 00007f2a5e320581 00007f2a5e31fd58 00007f2a5e3249f1 00007f2a5e3249a9 00007f2a5e324939 00007f2a5e324901 00007f2a5e323b2d 0000000000388634 0000000000388479
0709 12:11:59.665887 (+ 37859us) op_driver.cc:464] REPLICATION: finished
0709 12:11:59.775474 (+109587us) write_op.cc:301] APPLY: starting
0709 12:11:59.775555 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:59.914847 (+139292us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:59.914874 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:00.082258 (+167384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:00.112756 (+ 30498us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:12:00.116440 (+  3684us) write_op.cc:312] APPLY: finished
0709 12:12:00.162036 (+ 45596us) log.cc:844] Serialized 97 byte log entry
0709 12:12:00.162203 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:00.162326 (+   123us) write_op.cc:454] Released schema lock
0709 12:12:00.162378 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:00.162786 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:00.162813 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":494547,"reported_tablets":26,"spinlock_wait_cycles":488383232,"child_traces":[["op",{"apply.queue_time_us":109361,"apply.run_cpu_time_us":13986,"apply.run_wall_time_us":387276,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45907,"num_ops":10,"prepare.queue_time_us":538127,"prepare.run_cpu_time_us":246020,"prepare.run_wall_time_us":879391,"raft.queue_time_us":81307,"raft.run_cpu_time_us":49015,"raft.run_wall_time_us":93224,"replication_time_us":644938,"spinlock_wait_cycles":4883200,"thread_start_us":996917,"threads_started":4,"wal-append.queue_time_us":435688,"wal-append.run_cpu_time_us":15746,"wal-append.run_wall_time_us":1622277}]]}
I20260709 12:12:02.307103  4872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:02.313541  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:02.328190  4772 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 13 to 16, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 16 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.330164  4772 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.331776  4772 catalog_manager.cc:5697] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.337469  4772 catalog_manager.cc:5697] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 12, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.344785  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:02.349438  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:02.351635  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:02.353966  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:02.360210  4772 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 11 to 13, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:02.373159  4869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:02.392896  4868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f3bf546572147c3abe4522189e86ce6" is_pre_election: true
I20260709 12:12:02.398176  4869 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:02.399480 10879 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:02.415964 10879 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.418442 10879 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:02.421604  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:02.422520  5598 raft_consensus.cc:2393] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 25: Already voted for candidate ab9da67236874634be59ebfd05b18255 in this term.
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 12:12:02.431686  3725 tablet_server.cc:179] TabletServer@127.3.163.65:0 shutting down...
I20260709 12:12:02.436964  4772 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 5 to 8, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 8 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:02.449672  4772 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 14 to 15, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 15 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.451212  4772 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 13 to 14, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 14 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:02.453233  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:02.477558  5020 raft_consensus.cc:2410] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f3bf546572147c3abe4522189e86ce6 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:12:02.459515  5017 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:02.465400  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:02.470279  5603 raft_consensus.cc:1275] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:02.472558  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:02.479540 10866 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:02.480839  4772 catalog_manager.cc:5697] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.478329  4839 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:02.488315 10864 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.489100  4772 catalog_manager.cc:5697] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 13, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:02.522997  4917 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:02.524019 10917 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.529997  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:02.531141  4917 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:02.525281  4772 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 13, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 13 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:02.536118 10718 raft_consensus.cc:2749] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:02.532960 10917 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.533975  4772 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 14, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 14 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:02.544725  4772 catalog_manager.cc:5697] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 11, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 11 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.549986 10927 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:12:02.552978  4772 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 8 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:02.551298 10917 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:12:02.559998  4916 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:02.560616 10917 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.561340 10963 consensus_queue.cc:1048] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:02.561311  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:02.566430  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:02.568954 10963 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:02.644827  4772 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
W20260709 12:12:02.712757  4917 consensus_peers.cc:597] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.713436  4917 consensus_peers.cc:597] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.714433 10927 raft_consensus.cc:493] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:02.715047 10927 raft_consensus.cc:515] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:02.715487  4991 leader_election.cc:336] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:02.715952  4991 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:12:02.717142  4991 consensus_peers.cc:597] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.717664  4991 consensus_peers.cc:597] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.719271 10793 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:02.717607 10927 leader_election.cc:290] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:02.727522 10927 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.728065 10927 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:02.721349  4917 consensus_peers.cc:597] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.731524  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:02.734733 10927 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:12:02.735330  4917 consensus_peers.cc:597] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.737210  4991 consensus_peers.cc:597] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.742900  4948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:02.746336  5600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:02.746968  5600 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 25.
I20260709 12:12:02.752800  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea0cbe752f64a3cb8e0ca3a9a520c60" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:02.759542  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:12:02.762151  4991 consensus_peers.cc:597] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.763314  4841 leader_election.cc:304] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
W20260709 12:12:02.773211  4991 consensus_peers.cc:597] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.780196 10955 raft_consensus.cc:2749] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.782792 10882 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:02.783221 10882 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:02.783532 10882 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:02.784300  4991 consensus_peers.cc:597] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.789110 10976 log.cc:927] Time spent T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:12:02.790726  4917 consensus_peers.cc:597] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.795563 10793 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:02.796236  5017 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 25.
I20260709 12:12:02.799804 10864 raft_consensus.cc:493] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:02.800325 10864 raft_consensus.cc:515] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.802940 10864 leader_election.cc:290] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:02.805166  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:02.819860  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "737cb737da3146798e07c2c2026eebcc" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:02.856573 10955 raft_consensus.cc:493] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:02.857165 10955 raft_consensus.cc:515] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.861440  5598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:02.861964 10964 raft_consensus.cc:493] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:02.862515 10964 raft_consensus.cc:515] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.866779 10955 leader_election.cc:290] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:02.869315 10882 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.871848  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:02.873294  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ea9d9171fa428195bc085a20e92e3a" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:02.864573 10964 leader_election.cc:290] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:02.876847  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b5f40fd4fa49619588c424099a9a3b" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:02.881963  4839 leader_election.cc:304] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:02.883198 10964 raft_consensus.cc:2749] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:02.883338  4839 leader_election.cc:304] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:02.884302 10964 raft_consensus.cc:2749] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:02.885371 10882 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 26 election: Requested vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:02.891163  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:02.898375  5604 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:02.912770  5604 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 26.
I20260709 12:12:02.921607  4841 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:12:02.923933 10955 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:02.929108 10955 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 26 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:12:02.930024 10955 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:02.948164  4840 leader_election.cc:304] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:02.949198 10854 raft_consensus.cc:2749] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:02.966114  5570 consensus_peers.cc:597] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.966971  5570 consensus_peers.cc:597] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.968462  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:02.969071  5016 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:02.970417  5570 consensus_peers.cc:597] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.971016  5570 consensus_peers.cc:597] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:02.972328  5570 leader_election.cc:336] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:02.973075  5570 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:12:02.974735  5570 consensus_peers.cc:597] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:02.975829 10782 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:02.996510  5016 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 26.
I20260709 12:12:02.999729 10718 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.000288 10718 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.007110 10718 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.008940  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.009564  5603 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:12:03.011229  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.011859  5016 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:12:03.013687  4915 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:03.014464 10718 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.016664 10718 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.018380 10718 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:03.025983  5570 consensus_peers.cc:597] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:03.028244  4991 consensus_peers.cc:597] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:03.026579  5570 consensus_peers.cc:597] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:03.031884  4917 consensus_peers.cc:597] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:03.029269  5570 consensus_peers.cc:597] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:03.033650  5570 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:03.035327  4917 consensus_peers.cc:597] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:03.035884  4917 consensus_peers.cc:597] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:03.040982  4917 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:03.045697  4917 consensus_peers.cc:597] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:03.049435 10882 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.049935 10882 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.051972 10882 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.053560  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.054291 10882 raft_consensus.cc:493] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:03.054816  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93239e0814394381aa73ef05e3ce06f0" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.056911  4841 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:03.057948 10955 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.059168 10882 raft_consensus.cc:515] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.066397  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.071857 10882 leader_election.cc:290] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.073084  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184edf8541a448c78939e0c2fd55ae1f" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:12:03.074438  4917 consensus_peers.cc:597] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:03.075760  4840 leader_election.cc:304] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:03.078531 10882 raft_consensus.cc:2749] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:03.075661 10718 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.094269  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:03.094791  5017 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:03.100630  4917 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.105398  5017 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:12:03.111353  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:03.111860  5603 raft_consensus.cc:3060] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.122299  5603 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:12:03.123229 10718 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.123402  4916 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:03.126541 10718 raft_consensus.cc:2804] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:03.128057 10718 raft_consensus.cc:697] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 17 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:12:03.146090 10955 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:03.146711 10955 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.150045  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.152837  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.154716  4839 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:03.158222 10882 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:03.161082 10955 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.160658 10718 consensus_queue.cc:237] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.161104 10882 raft_consensus.cc:493] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:03.162370 10882 raft_consensus.cc:515] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:03.162626  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.166298  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.170231 10882 leader_election.cc:290] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:03.171448  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34fa1ee1e05941b1a81b5aa296c1867c" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.173213  4840 leader_election.cc:304] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:03.174072  4772 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47384 (request call id 346) took 7535 ms. Trace:
I20260709 12:12:03.175350  4769 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.177834 10854 raft_consensus.cc:2749] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.182225  4769 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.184770  4769 catalog_manager.cc:5697] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 10, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.187353  4769 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 11 to 13, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 13 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.195703  4769 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 10, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.174448  4772 rpcz_store.cc:276] 0709 12:11:55.668772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.681323 (+ 12551us) service_pool.cc:224] Handling call
0709 12:12:03.173997 (+7492674us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:02.962851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:02.992167 (+ 29316us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:02.992225 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:12:02.992243 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:03.009487 (+ 17244us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:03.009564 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:03.009592 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:12:03.018956 (+  9364us) tablet.cc:701] Row locks acquired
0709 12:12:03.019004 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:12:03.019160 (+   156us) write_op.cc:270] Start()
0709 12:12:03.019305 (+   145us) write_op.cc:276] Timestamp: P: 1783599123019102 usec, L: 0
0709 12:12:03.019322 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:12:03.020050 (+   728us) log.cc:844] Serialized 7789 byte log entry
0709 12:12:03.077106 (+ 57056us) op_driver.cc:464] REPLICATION: finished
0709 12:12:03.078234 (+  1128us) write_op.cc:301] APPLY: starting
0709 12:12:03.078327 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:03.098047 (+ 19720us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:03.098166 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:03.117761 (+ 19595us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:03.118157 (+   396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:12:03.118202 (+    45us) write_op.cc:312] APPLY: finished
0709 12:12:03.118649 (+   447us) log.cc:844] Serialized 180 byte log entry
0709 12:12:03.118824 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.118982 (+   158us) write_op.cc:454] Released schema lock
0709 12:12:03.119052 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:03.119511 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.119539 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1689846,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":882,"apply.run_cpu_time_us":22468,"apply.run_wall_time_us":41249,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87687,"num_ops":20,"prepare.queue_time_us":86754,"prepare.run_cpu_time_us":27086,"prepare.run_wall_time_us":102151,"raft.queue_time_us":6871,"raft.run_cpu_time_us":795,"raft.run_wall_time_us":6119,"replication_time_us":57602,"spinlock_wait_cycles":3584,"thread_start_us":113647,"threads_started":4,"wal-append.queue_time_us":27032}]]}
I20260709 12:12:03.218624  4769 catalog_manager.cc:5697] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 15 to 16, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 16 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.220100  4769 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 19 to 22, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 22 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.221619  4769 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 13 to 14, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 14 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.223407  4769 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 10, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 10 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.260959  4769 catalog_manager.cc:5697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 8 to 11, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.262708  4769 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.369573  5016 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 26 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:12:03.375783  4769 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47380 (request call id 394) took 6366 ms. Trace:
I20260709 12:12:03.378412  4774 catalog_manager.cc:5697] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 13 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.373780 10882 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:12:03.392765  4774 catalog_manager.cc:5697] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 13 to 15, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 15 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.395203  4774 catalog_manager.cc:5697] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 13 to 16, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 16 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.396742  4774 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 9 to 12, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.376183  4769 rpcz_store.cc:276] 0709 12:11:57.007558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.076346 (+ 68788us) service_pool.cc:224] Handling call
0709 12:12:03.374353 (+6298007us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:03.280902 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:03.281401 (+   499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:03.281436 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:12:03.281453 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:03.282353 (+   900us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:03.282405 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:03.282429 (+    24us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:12:03.283393 (+   964us) tablet.cc:701] Row locks acquired
0709 12:12:03.283414 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:12:03.283559 (+   145us) write_op.cc:270] Start()
0709 12:12:03.283666 (+   107us) write_op.cc:276] Timestamp: P: 1783599123283498 usec, L: 0
0709 12:12:03.283688 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:03.284282 (+   594us) log.cc:844] Serialized 4344 byte log entry
0709 12:12:03.286453 (+  2171us) op_driver.cc:464] REPLICATION: finished
0709 12:12:03.286768 (+   315us) write_op.cc:301] APPLY: starting
0709 12:12:03.286865 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:03.292262 (+  5397us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:03.292342 (+    80us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:03.298501 (+  6159us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:03.298735 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:12:03.298776 (+    41us) write_op.cc:312] APPLY: finished
0709 12:12:03.299040 (+   264us) log.cc:844] Serialized 105 byte log entry
0709 12:12:03.308929 (+  9889us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.309064 (+   135us) write_op.cc:454] Released schema lock
0709 12:12:03.309108 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:03.309456 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.309482 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":243957,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":12833,"apply.run_wall_time_us":22648,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45958,"num_ops":11,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":3619,"prepare.run_wall_time_us":3620,"replication_time_us":2641}]]}
I20260709 12:12:03.405544  4774 catalog_manager.cc:5697] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 16 to 18, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 18 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.431025  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:03.432642  3725 tablet_replica.cc:333] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.433441  3725 raft_consensus.cc:2243] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.434520  3725 raft_consensus.cc:2272] T 36177f71106c42f98afc1b375e5f6838 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.439352  3725 tablet_replica.cc:333] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.440246  3725 raft_consensus.cc:2243] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.455019  3725 raft_consensus.cc:2272] T 9752c5a68f0f415b848ef1da168f8d82 P 4f3bf546572147c3abe4522189e86ce6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.456434  4774 catalog_manager.cc:5697] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 16 to 17, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 17 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.457862  4774 catalog_manager.cc:5697] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 16 to 19, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 19 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.459278  4774 catalog_manager.cc:5697] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 9 to 10, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.464715  5603 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 26 FOLLOWER]: Refusing update from remote peer 4f3bf546572147c3abe4522189e86ce6: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:12:03.466216  3725 tablet_replica.cc:333] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.466033 10854 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:03.467073  3725 raft_consensus.cc:2243] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.467720  3725 raft_consensus.cc:2272] T 184edf8541a448c78939e0c2fd55ae1f P 4f3bf546572147c3abe4522189e86ce6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.473374  4774 catalog_manager.cc:5697] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 12, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.475338  4774 catalog_manager.cc:5697] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 15 to 18, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 18 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.479375  4774 catalog_manager.cc:5697] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 15 to 16, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 16 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.483325  4774 catalog_manager.cc:5697] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.484786  4774 catalog_manager.cc:5697] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 14 to 15, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 15 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.489135  4774 catalog_manager.cc:5697] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 14 to 15, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 15 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.490585  4774 catalog_manager.cc:5697] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 11, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.491945  4774 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 17 to 20, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 20 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } attrs { replace: true } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.495330  4774 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 14 to 16, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 16 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.507282  4774 catalog_manager.cc:5697] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 12, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.509292  4774 catalog_manager.cc:5697] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 6 to 10, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 10 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.512491  4774 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.522234  4774 catalog_manager.cc:5697] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.510318  3725 tablet_replica.cc:333] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.533479  4774 catalog_manager.cc:5697] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.534868  3725 raft_consensus.cc:2243] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.537292  3725 raft_consensus.cc:2272] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.537418  4774 catalog_manager.cc:5697] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.540179  3725 tablet_replica.cc:333] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.546057  3725 raft_consensus.cc:2243] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.546932  3725 raft_consensus.cc:2272] T b0ae020fc77f442c9f248fa0f3e45fe4 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.551127  3725 tablet_replica.cc:333] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.559487  3725 raft_consensus.cc:2243] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.561179  3725 raft_consensus.cc:2272] T 231547812bf34f17b386898e6451cc49 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.563867  3725 tablet_replica.cc:333] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.564658  3725 raft_consensus.cc:2243] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.572311  3725 pending_rounds.cc:70] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Trying to abort 1 pending ops.
I20260709 12:12:03.572561  3725 pending_rounds.cc:77] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6: Aborting op as it isn't in flight: id { term: 13 index: 11 } timestamp: 7305621978607038464 op_type: NO_OP noop_request { }
I20260709 12:12:03.572991  3725 raft_consensus.cc:2889] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:03.573313  3725 raft_consensus.cc:2272] T 93239e0814394381aa73ef05e3ce06f0 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.590487  3725 tablet_replica.cc:333] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.591301  3725 raft_consensus.cc:2243] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.591861  3725 raft_consensus.cc:2272] T 3994e4d9351c414cb95b2a6e7bd76142 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.599124  3725 tablet_replica.cc:333] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.599879  3725 raft_consensus.cc:2243] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.600404  3725 raft_consensus.cc:2272] T 3805e1c03edc45ed8a91427825b04e2e P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.602983  3725 tablet_replica.cc:333] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.603811  3725 raft_consensus.cc:2243] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.604390  3725 raft_consensus.cc:2272] T ecf61812afc64320acafb43ddc29f4a2 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.642086  4772 catalog_manager.cc:5697] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 13 to 14, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 14 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.648339  4774 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36362 (request call id 248) took 2194 ms. Trace:
I20260709 12:12:03.659390  3725 tablet_replica.cc:333] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.660287  3725 raft_consensus.cc:2243] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.661306  3725 raft_consensus.cc:2272] T 0c4699787549416cb829da40d250e0cf P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.665109  5017 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:03.667215 10960 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:03.649832  4772 catalog_manager.cc:5697] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 6 to 10, leader changed from ab9da67236874634be59ebfd05b18255 (127.3.163.68) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 10 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.670280  4772 catalog_manager.cc:5697] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 11 to 14, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 14 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:03.672312  4772 catalog_manager.cc:5697] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 13 to 14, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 14 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.671252  3725 tablet_replica.cc:333] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.673616  5603 raft_consensus.cc:1275] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:03.650316  4774 rpcz_store.cc:276] 0709 12:12:01.454314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.457705 (+  3391us) service_pool.cc:224] Handling call
0709 12:12:03.648266 (+2190561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:03.553594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:03.554081 (+   487us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:03.554122 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:12:03.554139 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:03.555657 (+  1518us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:03.555717 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:03.555747 (+    30us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:12:03.557274 (+  1527us) tablet.cc:701] Row locks acquired
0709 12:12:03.557292 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:12:03.557414 (+   122us) write_op.cc:270] Start()
0709 12:12:03.557516 (+   102us) write_op.cc:276] Timestamp: P: 1783599123557372 usec, L: 0
0709 12:12:03.557537 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:12:03.558205 (+   668us) log.cc:844] Serialized 8952 byte log entry
0709 12:12:03.560786 (+  2581us) op_driver.cc:464] REPLICATION: finished
0709 12:12:03.561228 (+   442us) write_op.cc:301] APPLY: starting
0709 12:12:03.561296 (+    68us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:03.571836 (+ 10540us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:03.571923 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:03.600597 (+ 28674us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:03.600911 (+   314us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 12:12:03.600957 (+    46us) write_op.cc:312] APPLY: finished
0709 12:12:03.601367 (+   410us) log.cc:844] Serialized 204 byte log entry
0709 12:12:03.609969 (+  8602us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.610138 (+   169us) write_op.cc:454] Released schema lock
0709 12:12:03.610196 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:03.610505 (+   309us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.610536 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":572385,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":219,"apply.run_cpu_time_us":24421,"apply.run_wall_time_us":49262,"cfile_cache_hit":92,"cfile_cache_hit_bytes":96094,"num_ops":23,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":4870,"prepare.run_wall_time_us":4870,"replication_time_us":3149}]]}
I20260709 12:12:03.679311 10960 consensus_queue.cc:1048] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:12:03.680146  3725 raft_consensus.cc:2243] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.679502  4772 catalog_manager.cc:5697] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 11 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 14 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.684166  3725 raft_consensus.cc:2272] T c480da15ff054400bdd09744d494717c P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.684607  4772 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 17 to 19, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 19 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.693737 10854 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:03.693312  4772 catalog_manager.cc:5697] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 14, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 14 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.694267 10854 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.695046  3725 tablet_replica.cc:333] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.697360 10854 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.698225  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.697463  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da8832a07224abb9a1f8815f3dcd745" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.701866  4840 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:03.702065  3725 raft_consensus.cc:2243] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.703312  3725 raft_consensus.cc:2272] T 88f88700ce294dc2bbfa0b1c51666ce7 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.710847  3725 tablet_replica.cc:333] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.712901  3725 raft_consensus.cc:2243] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.711179 10854 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:03.695012  4772 catalog_manager.cc:5697] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:03.715386  4772 catalog_manager.cc:5697] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 9 to 12, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:03.716627  4772 catalog_manager.cc:5697] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 10 to 12, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 12 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:03.718247  3725 raft_consensus.cc:2272] T 9023c271389540b8a7b43d63718a4c7a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.726899  3725 tablet_replica.cc:333] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.722014  4772 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 21 to 23, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 23 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } }
I20260709 12:12:03.739524  4772 catalog_manager.cc:5697] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 17, leader changed from <none> to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 17 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:03.741271  4772 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } }
I20260709 12:12:03.742672  4772 catalog_manager.cc:5697] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:03.758215 10955 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:03.741246  3725 raft_consensus.cc:2243] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.759778  3725 raft_consensus.cc:2272] T 7d62e31abaf34e25ad480865e4285e64 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.762832  3725 tablet_replica.cc:333] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.771171 10963 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.771696 10963 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:03.772104  3725 raft_consensus.cc:2243] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.758769 10955 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.774253 10955 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.775688  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.779129 10963 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:03.779842  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.792346  3725 raft_consensus.cc:2272] T 950c0e5da47a49abb359c63b8483f487 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.795032  3725 tablet_replica.cc:333] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.795938  3725 raft_consensus.cc:2243] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.796538  3725 raft_consensus.cc:2272] T 3da8832a07224abb9a1f8815f3dcd745 P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.797796  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f8b0320f7e94e2688e2a1d2005746ef" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.806638 10882 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:03.806963 10955 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:03.807219 10882 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.807662 10955 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.809279  3725 tablet_replica.cc:333] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.810163  3725 raft_consensus.cc:2243] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.810209 10955 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.809206 10854 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:03.811307  3725 raft_consensus.cc:2272] T c4bd638d42a041ffa8deaf7135228fd6 P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.810274 10882 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.812198 10854 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:03.812747  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.814327  3725 tablet_replica.cc:333] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.814564  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.814970 10854 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:03.810273 10995 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:03.818106 10995 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.820749 10995 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.820713  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b626d6ae78534a64a64c129ed023c901" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.822897  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.824654  3725 raft_consensus.cc:2243] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.825181  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "694e27a66efd449e81ce6297d4201cc3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.827138  3725 raft_consensus.cc:2272] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.829730  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.829303  4840 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:03.832111  4839 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:03.832261 10996 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.832878 10996 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:03.833210  4839 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:03.834642 10995 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:03.841122  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9425cbf78b044ef8b0190a6eb0be1b3" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.845062  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33c26da92464c7896c3c4d2243075e8" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:12:03.848531  4917 consensus_peers.cc:597] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:03.849356 10854 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:03.849833 10854 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.851760 10854 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.852169 10854 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:03.853067  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.852562 10854 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:03.856611 10854 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:03.858165 10996 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:03.858616 10996 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.860738  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.861744  3725 tablet_replica.cc:333] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.862533  3725 raft_consensus.cc:2243] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.863749  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.866807 10996 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.870119  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2004e797943d48d0ab1d7ed726902783" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.871685  4840 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:03.872538  4839 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:03.873267 10995 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:03.872982 10854 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.878202  3725 raft_consensus.cc:2272] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.880622  4840 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:12:03.891324  4840 raft_consensus.cc:2686] T b33c26da92464c7896c3c4d2243075e8 P 4f3bf546572147c3abe4522189e86ce6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:03.893199  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d89e729329948059879ed6f44a07690" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.894240  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4428def03fb45c99d3538acc2628494" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:03.897667  3725 tablet_replica.cc:333] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.898427  3725 raft_consensus.cc:2243] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.898924  3725 raft_consensus.cc:2272] T 0e7b07518a00402aaa235a0d34263b1f P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.901729  3725 tablet_replica.cc:333] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.902456  3725 raft_consensus.cc:2243] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.903451  3725 raft_consensus.cc:2272] T 3271fdf9e70240dc96def0f272e84933 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:03.904512  4917 leader_election.cc:336] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:03.904963  4917 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:03.906119 10994 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.917294  4840 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010
W20260709 12:12:03.917902  4840 raft_consensus.cc:2686] T 7d89e729329948059879ed6f44a07690 P 4f3bf546572147c3abe4522189e86ce6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:12:03.918646  4840 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:03.919301 10854 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:03.922556 10854 raft_consensus.cc:493] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ab9da67236874634be59ebfd05b18255)
I20260709 12:12:03.923063 10854 raft_consensus.cc:515] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:03.926697  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:03.932088 10854 leader_election.cc:290] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:03.933387  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66df43bc3234fd5b769c5dc5afc1096" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:03.935293  4841 leader_election.cc:304] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:03.936312  3725 tablet_replica.cc:333] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.936647 10995 raft_consensus.cc:2749] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:03.937247  3725 raft_consensus.cc:2243] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.938081  3725 raft_consensus.cc:2272] T 1f8b0320f7e94e2688e2a1d2005746ef P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.946671  3725 tablet_replica.cc:333] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.948737  3725 raft_consensus.cc:2243] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.949319  3725 raft_consensus.cc:2272] T b626d6ae78534a64a64c129ed023c901 P 4f3bf546572147c3abe4522189e86ce6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.939631  4770 catalog_manager.cc:5697] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 8 to 12, leader changed from baa50eb5ed704004b7f391934a59d010 (127.3.163.67) to 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65). New cstate: current_term: 12 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.959398  3725 tablet_replica.cc:333] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.961699  3725 raft_consensus.cc:2243] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.967043  3725 raft_consensus.cc:2272] T 6f4e29d1896a40e18a1e129dfc2a01c4 P 4f3bf546572147c3abe4522189e86ce6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.963497  4770 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:03.978154  3725 tablet_replica.cc:333] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.979187  3725 raft_consensus.cc:2243] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:03.982950  3725 raft_consensus.cc:2272] T b4428def03fb45c99d3538acc2628494 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.987293  3725 tablet_replica.cc:333] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:03.992229  3725 raft_consensus.cc:2243] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:03.993424  3725 raft_consensus.cc:2272] T 42e9d7673d8444ae8097208f1095114d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:03.996460  3725 tablet_replica.cc:333] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.007793 10995 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.009092 10995 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:04.008548 10578 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.011835 10578 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:04.012465  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:04.014149  4951 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 12.
I20260709 12:12:04.014984 10995 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:04.015885  4839 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9; no voters: 
I20260709 12:12:04.015658  4774 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "4f3bf546572147c3abe4522189e86ce6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:04.023257  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:04.023910  5017 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 11.
I20260709 12:12:04.024058  3725 raft_consensus.cc:2243] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.024775  3725 pending_rounds.cc:70] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: Trying to abort 1 pending ops.
I20260709 12:12:04.025095  3725 pending_rounds.cc:77] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6: Aborting op as it isn't in flight: id { term: 12 index: 9 } timestamp: 7305621998272544768 op_type: NO_OP noop_request { }
I20260709 12:12:04.025694 10578 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:04.025400  4991 leader_election.cc:336] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:12:04.027452  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:04.028169  4951 raft_consensus.cc:2393] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa50eb5ed704004b7f391934a59d010 in current term 12: Already voted for candidate 8de40fe2bb814adcbe13958669063dc9 in this term.
I20260709 12:12:04.025467  3725 raft_consensus.cc:2889] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:04.029760  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:04.030051  3725 raft_consensus.cc:2272] T 34fa1ee1e05941b1a81b5aa296c1867c P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.032641  3725 tablet_replica.cc:333] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.033447  3725 raft_consensus.cc:2243] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.034104  3725 raft_consensus.cc:2272] T e66df43bc3234fd5b769c5dc5afc1096 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.034832 10995 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:04.035319 10995 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.036715 10995 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.036363 10879 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.056128  3725 tablet_replica.cc:333] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.056943  3725 raft_consensus.cc:2243] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.057559  3725 raft_consensus.cc:2272] T 694e27a66efd449e81ce6297d4201cc3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.064565  3725 tablet_replica.cc:333] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.065307  3725 raft_consensus.cc:2243] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.065961  3725 raft_consensus.cc:2272] T 2004e797943d48d0ab1d7ed726902783 P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.068527  3725 tablet_replica.cc:333] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.069265  3725 raft_consensus.cc:2243] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.070276  3725 raft_consensus.cc:2272] T 4be803cbf3854da89561de85968acd64 P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.030097  4770 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47400 (request call id 362) took 1464 ms. Trace:
I20260709 12:12:04.071273  4770 rpcz_store.cc:276] 0709 12:12:02.565296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.565483 (+   187us) service_pool.cc:224] Handling call
0709 12:12:04.030008 (+1464525us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:03.973336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:03.973825 (+   489us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:03.973857 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:12:03.973874 (+    17us) tablet.cc:662] Decoding operations
0709 12:12:03.974245 (+   371us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:03.974297 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:03.974322 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:12:03.974610 (+   288us) tablet.cc:701] Row locks acquired
0709 12:12:03.974627 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:12:03.974751 (+   124us) write_op.cc:270] Start()
0709 12:12:03.974853 (+   102us) write_op.cc:276] Timestamp: P: 1783599123974711 usec, L: 0
0709 12:12:03.974874 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:12:03.975486 (+   612us) log.cc:844] Serialized 913 byte log entry
0709 12:12:03.977618 (+  2132us) op_driver.cc:464] REPLICATION: finished
0709 12:12:03.977880 (+   262us) write_op.cc:301] APPLY: starting
0709 12:12:03.977946 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:03.979250 (+  1304us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:03.979339 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:03.980592 (+  1253us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:03.980752 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:12:03.980794 (+    42us) write_op.cc:312] APPLY: finished
0709 12:12:03.980990 (+   196us) log.cc:844] Serialized 33 byte log entry
0709 12:12:03.981129 (+   139us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.981205 (+    76us) write_op.cc:454] Released schema lock
0709 12:12:03.981240 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:03.981571 (+   331us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:03.981606 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30812,"reported_tablets":44,"spinlock_wait_cycles":12032,"child_traces":[["op",{"apply.queue_time_us":81,"apply.run_cpu_time_us":3633,"apply.run_wall_time_us":3633,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":2479,"prepare.run_wall_time_us":2478,"replication_time_us":2647}]]}
I20260709 12:12:04.086181  3725 tablet_replica.cc:333] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.086766  3725 raft_consensus.cc:2243] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.087680  3725 raft_consensus.cc:2272] T 22be31682d204ff18c81f1e0ac60a00a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.090132  3725 tablet_replica.cc:333] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.090785  3725 raft_consensus.cc:2243] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.091686  3725 raft_consensus.cc:2272] T af1ac4f5e2f747228d3574209d49e46f P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.101667 10879 raft_consensus.cc:2749] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:04.117362  3725 tablet_replica.cc:333] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.138800  3725 raft_consensus.cc:2243] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.138630 10995 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:04.139482  3725 raft_consensus.cc:2272] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 4f3bf546572147c3abe4522189e86ce6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.141716  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:04.142235  4951 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.142920  3725 tablet_replica.cc:333] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.142776  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "4f3bf546572147c3abe4522189e86ce6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:04.143376  5017 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.143694  3725 raft_consensus.cc:2243] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.144744  3725 raft_consensus.cc:2272] T fedd910b0097474d987abca8337e4e48 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.147327  3725 tablet_replica.cc:333] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.148115  3725 raft_consensus.cc:2243] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.148844  3725 raft_consensus.cc:2272] T c9425cbf78b044ef8b0190a6eb0be1b3 P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.150162  5017 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:12:04.151311  3725 tablet_replica.cc:333] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.151748  4840 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:04.152109  3725 raft_consensus.cc:2243] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.152628 10854 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:04.152962  3725 raft_consensus.cc:2272] T c3ea9d9171fa428195bc085a20e92e3a P 4f3bf546572147c3abe4522189e86ce6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.153193 10854 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Becoming Leader. State: Replica: 4f3bf546572147c3abe4522189e86ce6, State: Running, Role: LEADER
I20260709 12:12:04.154431 10854 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:04.155309  3725 tablet_replica.cc:333] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.156060  3725 raft_consensus.cc:2243] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.156687  3725 raft_consensus.cc:2272] T b3b5f40fd4fa49619588c424099a9a3b P 4f3bf546572147c3abe4522189e86ce6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.150619 10995 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:04.164105  3725 tablet_replica.cc:333] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.164872  3725 raft_consensus.cc:2243] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.151674  4951 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f3bf546572147c3abe4522189e86ce6 in term 13.
I20260709 12:12:04.165822  3725 raft_consensus.cc:2272] T 1fb0f431b68a4f78a03a58597b9cc66a P 4f3bf546572147c3abe4522189e86ce6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.168380  3725 tablet_replica.cc:333] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.169135  3725 raft_consensus.cc:2243] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:04.169664  3725 raft_consensus.cc:2272] T 737cb737da3146798e07c2c2026eebcc P 4f3bf546572147c3abe4522189e86ce6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.172384  3725 tablet_replica.cc:333] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.173092  3725 raft_consensus.cc:2243] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.173830  3725 pending_rounds.cc:70] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Trying to abort 1 pending ops.
I20260709 12:12:04.174108  3725 pending_rounds.cc:77] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6: Aborting op as it isn't in flight: id { term: 13 index: 8 } timestamp: 7305622012548304896 op_type: NO_OP noop_request { }
I20260709 12:12:04.174449  3725 raft_consensus.cc:2889] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:04.174798  3725 raft_consensus.cc:2272] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.184999  3725 tablet_replica.cc:333] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.185623  3725 raft_consensus.cc:2243] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.186585  3725 raft_consensus.cc:2272] T c88d711fba9d480a97828652c6908d3f P 4f3bf546572147c3abe4522189e86ce6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.200855  3725 tablet_replica.cc:333] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.201467  3725 raft_consensus.cc:2243] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.202441  3725 raft_consensus.cc:2272] T 008a4803b16b4c108fa5d52753a9f9a3 P 4f3bf546572147c3abe4522189e86ce6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.210122  3725 tablet_replica.cc:333] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6: stopping tablet replica
I20260709 12:12:04.210718  3725 raft_consensus.cc:2243] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:12:04.211694  3725 raft_consensus.cc:2272] T 6f0691894555408ab3e2a8dedaa21303 P 4f3bf546572147c3abe4522189e86ce6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:04.628279 10771 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.629083 10771 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:04.635973  5570 leader_election.cc:336] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.639254 10771 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:04.639420  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:04.641064  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:04.642026 10771 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:04.734930  4991 consensus_peers.cc:597] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.742846 10578 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.743373 10578 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:04.745486 10578 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:04.748441  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:04.749095 10994 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.749776 10994 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:04.751776 10994 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:12:04.752624  4991 leader_election.cc:336] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.753070  4991 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:04.754632  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:04.755237  5603 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
I20260709 12:12:04.756409  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:12:04.757154 10994 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:04.757508 10994 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.757834 10994 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.758636 10578 raft_consensus.cc:2749] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:04.765034  4917 leader_election.cc:336] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.770138 10994 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:04.786393  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36177f71106c42f98afc1b375e5f6838" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:04.786890  5603 raft_consensus.cc:3060] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:04.789721  4917 leader_election.cc:336] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.793469  5603 raft_consensus.cc:2468] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:12:04.794505  4916 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:04.795789 10994 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:04.796252 11004 raft_consensus.cc:2804] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:04.796861 11004 raft_consensus.cc:697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 17 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:12:04.797859 11004 consensus_queue.cc:237] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:04.817394  4991 consensus_peers.cc:597] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.826139  4770 catalog_manager.cc:5697] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 16 to 17, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 17 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.842592 11004 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.843158 11004 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:04.845151 11004 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:04.849511 10994 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.849990 10994 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:04.851887 10994 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:04.852456  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:04.858425  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:12:04.860220  4917 leader_election.cc:336] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.860697  4917 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:04.862946 10960 raft_consensus.cc:2749] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:04.867194  4917 leader_election.cc:336] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.867636  4917 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:04.868676 11004 raft_consensus.cc:2749] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:04.872735  4917 consensus_peers.cc:597] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:04.875474  5570 consensus_peers.cc:597] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.891412 10782 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.891978 10782 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:04.894083 10782 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:04.897151  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:12:04.901389  5570 leader_election.cc:336] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.901785  5570 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:04.902834 10782 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:04.914397 10771 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.914891 10771 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:04.916886 10771 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:04.918286  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:04.918927  5016 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 11.
I20260709 12:12:04.922029  5568 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:04.922780 11003 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:04.923136 11003 raft_consensus.cc:493] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:04.923471 11003 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:12:04.940300  5570 leader_election.cc:336] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.943363 11003 raft_consensus.cc:515] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:04.949802  5570 leader_election.cc:336] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.957037 11003 leader_election.cc:290] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:04.957198  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9752c5a68f0f415b848ef1da168f8d82" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:04.957754  5016 raft_consensus.cc:3060] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:04.963876  5016 raft_consensus.cc:2468] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
I20260709 12:12:04.965082  5568 leader_election.cc:304] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:04.968101 11003 raft_consensus.cc:2804] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:04.970279 10782 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
W20260709 12:12:04.970891  4991 consensus_peers.cc:597] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:04.970782 10782 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:04.974677 10782 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:04.974853  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:04.968560 11003 raft_consensus.cc:697] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:12:04.984661 11003 consensus_queue.cc:237] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:04.991977  5570 leader_election.cc:336] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:04.992385  5570 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:04.993269 10782 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:05.002946 10879 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.003470 10879 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.005506 10879 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.011396 10782 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.011893 10782 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.012059  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:12:05.012560  4991 leader_election.cc:336] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.012681  4951 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:12:05.013849  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.014822 10578 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.015187 10578 raft_consensus.cc:493] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.015539 10578 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.016780  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:12:05.026489  5570 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:05.027221  4991 consensus_peers.cc:597] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:05.027379 10782 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.027158  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:05.028913 10782 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.029259 10879 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.029758 10879 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.041361  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:05.041930  5603 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
W20260709 12:12:05.047653  4991 leader_election.cc:336] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.050200 10879 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:05.057942 10578 raft_consensus.cc:515] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:12:05.062569  4917 consensus_peers.cc:597] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.064138  4991 leader_election.cc:336] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.071499  4990 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.073463 10879 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.073818 10879 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.075356 10879 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.082832  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c480da15ff054400bdd09744d494717c" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:05.083057 10578 leader_election.cc:290] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.083442  4951 raft_consensus.cc:3060] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.086547  4770 catalog_manager.cc:5697] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 11 to 12, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 12 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:05.088639  4991 consensus_peers.cc:597] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:05.089951  4951 raft_consensus.cc:2468] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
I20260709 12:12:05.091248  4988 leader_election.cc:304] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.091955 11013 raft_consensus.cc:2804] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.092417 11013 raft_consensus.cc:697] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.097131 11013 consensus_queue.cc:237] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.106978 10879 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:05.114166  4991 leader_election.cc:336] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.121001 10879 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:05.120693  4770 catalog_manager.cc:5697] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 14 to 15, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 15 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.121876  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3271fdf9e70240dc96def0f272e84933" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:05.122946 10578 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.129812  5603 raft_consensus.cc:3060] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.130537 10994 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.131062 10994 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.133047 10994 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.135609  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:12:05.141453  4917 leader_election.cc:336] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.141858  4917 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:05.142628 10994 raft_consensus.cc:2749] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.129884 10578 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.146225 10578 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.148391  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:05.149017  4951 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:12:05.151841  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.152927  5603 raft_consensus.cc:2468] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:12:05.153916 10879 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.154266 10879 raft_consensus.cc:493] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.154608 10879 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:05.159559  5570 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:05.158715  4990 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.169094 10578 raft_consensus.cc:2804] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:05.170228 10578 raft_consensus.cc:697] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.171046 10578 consensus_queue.cc:237] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.176394 10994 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.176986 10994 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:05.177875  4991 leader_election.cc:336] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.178967 10994 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:05.180766 10879 raft_consensus.cc:515] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.181074  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:05.182804 10879 leader_election.cc:290] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.183001  5604 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 15.
I20260709 12:12:05.186311  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4699787549416cb829da40d250e0cf" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:05.197396  4945 raft_consensus.cc:3060] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.197981  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:12:05.198743 11004 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.199122 11004 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.199465 11004 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.186744 11012 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.205140 11012 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.207270 11012 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.197340 10994 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.209684 10994 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:12:05.209932  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:05.210518  4951 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:12:05.211529  4988 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.212240 11012 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:05.212604 11012 raft_consensus.cc:493] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.212965 11012 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:05.215209  5570 consensus_peers.cc:597] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.218138  4991 leader_election.cc:336] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:05.220960  4917 consensus_peers.cc:597] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:05.218348  4945 raft_consensus.cc:2468] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
W20260709 12:12:05.224941  4917 consensus_peers.cc:597] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:05.225979  4988 leader_election.cc:304] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.226660 10879 raft_consensus.cc:2804] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.227133 10879 raft_consensus.cc:697] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.227453 10994 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.227945 10879 consensus_queue.cc:237] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.228374  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:05.230759 11011 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.231251 11011 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.233314 11011 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:05.234685  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:12:05.246917  4917 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:05.250952  4991 leader_election.cc:336] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:05.253820  4991 leader_election.cc:336] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.254199  4991 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:05.254927 11013 raft_consensus.cc:2749] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.258396 10960 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.260350 10960 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.261648 11013 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.262348 10960 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.262147 11013 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.264257 11013 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.264405 11003 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.264928 11003 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.267462  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:05.268025  4945 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:12:05.268671 11003 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.269381  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:12:05.269923  4991 leader_election.cc:336] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.270040 11013 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.270444 11013 raft_consensus.cc:493] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.270798 11013 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.270897  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:05.271485 11011 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.271967 11011 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.273922 11011 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.275082  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
W20260709 12:12:05.277671  5570 leader_election.cc:336] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.278106  5570 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:05.278745 11013 raft_consensus.cc:515] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:12:05.286170  4991 leader_election.cc:336] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.286619  4991 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:05.280309 11004 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.280184 11003 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:05.279598 11012 raft_consensus.cc:515] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.294129 11011 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:05.298381  5604 raft_consensus.cc:1275] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:05.301283  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:05.301949  5017 raft_consensus.cc:2393] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8de40fe2bb814adcbe13958669063dc9 in current term 15: Already voted for candidate baa50eb5ed704004b7f391934a59d010 in this term.
I20260709 12:12:05.300609 10994 consensus_queue.cc:1048] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:12:05.305181  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f88700ce294dc2bbfa0b1c51666ce7" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:05.305372 11004 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:12:05.307236  5570 consensus_peers.cc:597] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.307605  5570 consensus_peers.cc:597] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:05.305823  5603 raft_consensus.cc:3060] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.317008 11012 leader_election.cc:290] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.325138  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4bd638d42a041ffa8deaf7135228fd6" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:05.325671  4945 raft_consensus.cc:3060] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.331678  4945 raft_consensus.cc:2468] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:12:05.336058  5603 raft_consensus.cc:2468] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 16.
W20260709 12:12:05.337448  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 51301.9us
I20260709 12:12:05.337903  4916 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
I20260709 12:12:05.332628  4988 leader_election.cc:304] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.342777 11020 raft_consensus.cc:2804] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:05.345288  4770 catalog_manager.cc:5697] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 12 to 13, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 13 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.342226 11017 raft_consensus.cc:2804] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:05.348078 11017 raft_consensus.cc:697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:12:05.348933 11017 consensus_queue.cc:237] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.350473 11004 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.350958 11004 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.342815 11012 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.337174 10879 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.356150 10879 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.356490 11004 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.345382 11020 raft_consensus.cc:697] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.357744 11020 consensus_queue.cc:237] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.358213 10879 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.358812 11012 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.361397 11012 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.363404  4951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:05.363549  4950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22be31682d204ff18c81f1e0ac60a00a" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:12:05.363891  5570 consensus_peers.cc:597] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:05.364230  4950 raft_consensus.cc:3060] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.364979  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:05.366340  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:05.366882  4945 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:12:05.367815  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:12:05.352634  4991 consensus_peers.cc:597] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.368767  4991 leader_election.cc:336] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:05.369328  4991 leader_election.cc:336] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.365553  5017 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 12.
I20260709 12:12:05.370306 11012 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:05.384060 11012 raft_consensus.cc:493] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.384435 11012 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.376849  4915 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.389952 11004 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.390347 11004 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.390702 11004 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.391357 11012 raft_consensus.cc:515] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:12:05.370126  4917 leader_election.cc:336] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.393251  4917 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:05.393923 11018 raft_consensus.cc:2749] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:12:05.396857  4917 leader_election.cc:336] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.397280  4917 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:05.379431 11013 leader_election.cc:290] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.375670  4950 raft_consensus.cc:2468] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 15.
W20260709 12:12:05.381062  5570 consensus_peers.cc:597] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.412686 10960 raft_consensus.cc:2749] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.413726 10879 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.414238 10879 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.416124 10879 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:05.417457  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:05.418246  4988 leader_election.cc:304] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
W20260709 12:12:05.408785  4917 consensus_peers.cc:597] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.402360  4991 leader_election.cc:336] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.410665  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c88d711fba9d480a97828652c6908d3f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:05.419485  4945 raft_consensus.cc:3060] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.403131 11012 leader_election.cc:290] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:05.419988  4991 leader_election.cc:336] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.428323  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:05.429361 11012 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.430183 10782 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.430694 10782 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.421480 11004 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:12:05.419047  4917 consensus_peers.cc:597] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:05.419435 10879 raft_consensus.cc:2804] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.411567 10578 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.436038  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:05.437188  5016 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 16.
I20260709 12:12:05.438223  5568 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.438956 11003 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:05.439289 11003 raft_consensus.cc:493] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.441385 11003 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.443137 10879 raft_consensus.cc:697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.444024 10879 consensus_queue.cc:237] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.439576 11017 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.445039 11017 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.446694  4945 raft_consensus.cc:2468] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:12:05.446940 11017 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.439353  4770 catalog_manager.cc:5697] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 14 to 15, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 15 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.449249  4770 catalog_manager.cc:5697] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 13 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.449121  4988 leader_election.cc:304] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.454439  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:05.455004  5017 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 17.
I20260709 12:12:05.455790 11019 raft_consensus.cc:2804] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:05.455922  3725 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 4897)
W20260709 12:12:05.457018  4991 leader_election.cc:336] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:05.457319  5570 leader_election.cc:336] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.434015 10782 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:05.460003  4991 leader_election.cc:336] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.460448  4991 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:05.465140  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.466935 10782 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.471267 10782 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.473208 10782 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.466639 11012 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.473944 11012 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.476910  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:05.477451  5604 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 10.
I20260709 12:12:05.468381 11011 raft_consensus.cc:2749] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.478060 10960 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:05.478066 11012 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:05.453401 10578 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.478681  4990 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.481742  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:05.489077  5016 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 12.
W20260709 12:12:05.485963  5570 consensus_peers.cc:597] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.490059  5570 leader_election.cc:336] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.480193 10960 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.490833 10960 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.491451 11004 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.491618  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42e9d7673d8444ae8097208f1095114d" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:05.490849  5568 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.492285  5016 raft_consensus.cc:3060] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:05.493798  4991 leader_election.cc:336] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.496150 11009 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.496549 11009 raft_consensus.cc:493] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.496899 11009 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.500903  5016 raft_consensus.cc:2468] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 13.
I20260709 12:12:05.501972  4915 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.502187 11012 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:05.502539 11012 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.465644 11017 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.503983  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:05.488299 10578 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:12:05.507232  4917 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.502715 11018 raft_consensus.cc:2804] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:05.509361 11018 raft_consensus.cc:697] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:12:05.510205 11018 consensus_queue.cc:237] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.510442  4774 catalog_manager.cc:5697] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 15 to 16, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 16 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.505249  5604 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 26.
I20260709 12:12:05.506844 11011 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.514554  5016 raft_consensus.cc:1275] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:05.502918 11012 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:12:05.512892  4991 leader_election.cc:336] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.517158 11019 raft_consensus.cc:697] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.515219 11011 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:12:05.529150 11003 raft_consensus.cc:515] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.530665 11011 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.531181 11003 leader_election.cc:290] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.520862  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.514196 11017 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.532332 11011 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:12:05.532696 11011 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.533078 11011 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:05.533488 11017 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:12:05.534874  4991 consensus_peers.cc:597] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.535909  5570 leader_election.cc:336] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.533908  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fedd910b0097474d987abca8337e4e48" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:05.536988  5016 raft_consensus.cc:3060] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:05.538347  4991 leader_election.cc:336] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.539613  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:05.543447  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:05.544010  4945 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 23.
I20260709 12:12:05.545099  5016 raft_consensus.cc:2468] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
I20260709 12:12:05.545848  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.530089 11019 consensus_queue.cc:237] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.548049  5568 leader_election.cc:304] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.553282 11028 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:05.522092 10782 consensus_queue.cc:1048] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:12:05.553675 11028 raft_consensus.cc:493] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.554142 11028 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:05.559473 10960 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.562119 11009 raft_consensus.cc:515] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:05.517498  4917 leader_election.cc:336] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:05.564838  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 47368.9us
I20260709 12:12:05.567687 11028 raft_consensus.cc:515] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:12:05.567625 10771 raft_consensus.cc:2804] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:05.568611 10771 raft_consensus.cc:697] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:12:05.569674 11028 leader_election.cc:290] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 24 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.569490 10771 consensus_queue.cc:237] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:05.572182  5570 consensus_peers.cc:597] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.574596  5570 leader_election.cc:336] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.574703  4945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f0691894555408ab3e2a8dedaa21303" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
W20260709 12:12:05.565088  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 62343.5us
I20260709 12:12:05.575347  4945 raft_consensus.cc:3060] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:05.564147 11009 leader_election.cc:290] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.579325  5017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4be803cbf3854da89561de85968acd64" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:05.579882  5017 raft_consensus.cc:3060] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:05.582902  4917 consensus_peers.cc:597] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.584417  4917 consensus_peers.cc:597] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.584908  4917 consensus_peers.cc:597] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.586005  4917 consensus_peers.cc:597] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:05.586410  4917 leader_election.cc:336] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:05.587038  4917 leader_election.cc:336] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.600627  4945 raft_consensus.cc:2468] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 24.
I20260709 12:12:05.601519  5017 raft_consensus.cc:2468] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 13.
W20260709 12:12:05.602463  4991 leader_election.cc:336] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.603008  4988 leader_election.cc:304] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.564226 11012 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.632871 10578 raft_consensus.cc:2804] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:05.569453 11011 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:05.746201  4917 leader_election.cc:336] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.746759  4917 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
I20260709 12:12:05.753604  5568 leader_election.cc:304] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:05.764999  4770 catalog_manager.cc:5697] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 12 to 13, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 13 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.751526 10578 raft_consensus.cc:697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 24 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.804507 10578 consensus_queue.cc:237] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } }
I20260709 12:12:05.777001 10960 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:05.779978 11012 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:05.782590 11018 raft_consensus.cc:2749] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.786381 11011 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 27 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:05.803166 11003 raft_consensus.cc:2804] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:05.831463  4951 raft_consensus.cc:1275] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:05.825156  4774 catalog_manager.cc:5697] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 14 to 15, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 15 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.834939  4774 catalog_manager.cc:5697] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 13 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:05.840525  4917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 94366.5us
W20260709 12:12:05.841055  4917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111) [suppressed 217 similar messages]
I20260709 12:12:05.845671  5016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1ac4f5e2f747228d3574209d49e46f" candidate_uuid: "8de40fe2bb814adcbe13958669063dc9" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:05.845212  4770 catalog_manager.cc:5697] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 16 to 17, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 17 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.846212  5016 raft_consensus.cc:3060] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.852587  5016 raft_consensus.cc:2468] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8de40fe2bb814adcbe13958669063dc9 in term 18.
I20260709 12:12:05.860553  4915 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:12:05.863502  5570 consensus_peers.cc:597] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:05.878937 11003 raft_consensus.cc:697] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:12:05.880887 11003 consensus_queue.cc:237] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.883270 11026 raft_consensus.cc:2804] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:05.883841 11026 raft_consensus.cc:697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 18 LEADER]: Becoming Leader. State: Replica: 8de40fe2bb814adcbe13958669063dc9, State: Running, Role: LEADER
I20260709 12:12:05.885373 11026 consensus_queue.cc:237] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:05.889784  5604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008a4803b16b4c108fa5d52753a9f9a3" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:05.890340  5604 raft_consensus.cc:3060] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:05.890712 11009 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:05.891194 11009 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.893127 11009 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:05.896440  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f4e29d1896a40e18a1e129dfc2a01c4" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:05.898859  5603 raft_consensus.cc:3060] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:05.902050  5604 raft_consensus.cc:2468] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 11.
I20260709 12:12:05.907280  5598 raft_consensus.cc:1275] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:05.909958  4990 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
W20260709 12:12:05.911296  4917 leader_election.cc:336] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:05.912550 10578 raft_consensus.cc:2804] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:05.913146 10578 raft_consensus.cc:697] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.920171  5603 raft_consensus.cc:2468] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 27.
I20260709 12:12:05.920991  4990 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:05.956084  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:05.966261  4774 catalog_manager.cc:5697] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 12 to 13, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 13 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:05.962862  4949 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 14.
I20260709 12:12:05.974822 11012 raft_consensus.cc:2804] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:12:05.975356 11012 raft_consensus.cc:697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 27 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:05.906997 10879 consensus_queue.cc:1048] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:12:05.976187 11012 consensus_queue.cc:237] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.988263  5598 raft_consensus.cc:1275] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:05.996070  4948 raft_consensus.cc:1275] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:06.002779  4949 raft_consensus.cc:1275] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:05.988121 10578 consensus_queue.cc:237] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:05.999310 11017 consensus_queue.cc:1048] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:12:05.937381 11013 consensus_queue.cc:1048] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:12:06.013655  5567 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 
W20260709 12:12:06.004463  4991 leader_election.cc:336] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:06.027333  4948 raft_consensus.cc:1275] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:12:06.027542  4991 consensus_peers.cc:597] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.028239  4991 consensus_peers.cc:597] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.029116  4991 leader_election.cc:336] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:06.030967 11035 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.034073 11035 raft_consensus.cc:493] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f3bf546572147c3abe4522189e86ce6)
I20260709 12:12:06.034545 11035 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.032316 11020 consensus_queue.cc:1048] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:12:06.034186 11044 consensus_queue.cc:1048] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:12:06.034008 11037 consensus_queue.cc:1048] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:12:06.164142  5567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 93710.6us
W20260709 12:12:06.166667  5570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 73662.5us
W20260709 12:12:06.167496  4915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:40575, user_credentials={real_user=slave}} blocked reactor thread for 67825.1us
W20260709 12:12:06.172710  5570 leader_election.cc:336] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:06.172071  4770 catalog_manager.cc:5697] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 23 to 24, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 24 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:06.169109  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 248168us
I20260709 12:12:06.197680 11035 raft_consensus.cc:515] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:06.205513  4917 consensus_peers.cc:597] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:06.227679 11035 leader_election.cc:290] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:06.229386  5570 consensus_peers.cc:597] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.243355  4917 consensus_peers.cc:597] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.243836  4917 consensus_peers.cc:597] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.250392  5016 raft_consensus.cc:1275] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:06.256793  5020 raft_consensus.cc:1275] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:06.259287 10960 consensus_queue.cc:1048] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:06.262566 11042 consensus_queue.cc:1048] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:06.262637  5570 leader_election.cc:336] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:06.268301  4949 raft_consensus.cc:1275] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:12:06.270733  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 241191us
W20260709 12:12:06.272897  4991 consensus_peers.cc:597] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.285045 11051 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.287953 10578 consensus_queue.cc:1048] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:06.283913  4770 catalog_manager.cc:5697] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 reported cstate change: term changed from 17 to 18, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66). New cstate: current_term: 18 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.318336  4943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fb0f431b68a4f78a03a58597b9cc66a" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:06.318961  4943 raft_consensus.cc:3060] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.292945 11051 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:12:06.319273  4991 consensus_peers.cc:597] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.325266 11051 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:06.325572  4991 consensus_peers.cc:597] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.329630  4991 leader_election.cc:336] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:06.364938  4944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9" is_pre_election: true
I20260709 12:12:06.365598  4944 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
W20260709 12:12:06.388200  5570 consensus_peers.cc:597] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.390293  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:06.391037 11044 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:06.391414 11044 raft_consensus.cc:493] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.391752 11044 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.401093  4943 raft_consensus.cc:2468] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 15.
I20260709 12:12:06.411574  4944 raft_consensus.cc:1275] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 24 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:06.410213  5567 leader_election.cc:304] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:06.419493 10578 consensus_queue.cc:1048] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:06.425635 10771 raft_consensus.cc:2804] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.426194 10771 raft_consensus.cc:697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:12:06.427089 10771 consensus_queue.cc:237] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:06.440658  4991 consensus_peers.cc:597] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.448391  5023 raft_consensus.cc:1275] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
W20260709 12:12:06.456713  3725 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 4897)
I20260709 12:12:06.444459 11044 raft_consensus.cc:515] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:06.465554 11044 leader_election.cc:290] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Requested vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:06.468932  4991 consensus_peers.cc:597] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:06.470921  4917 consensus_peers.cc:597] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:06.478299  4991 leader_election.cc:336] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:06.479235  4991 consensus_peers.cc:597] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.469631  4772 catalog_manager.cc:5697] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 26 to 27, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 27 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.495438  4772 catalog_manager.cc:5697] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 10 to 11, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 11 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.525175  4949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec4626ffb3e4c87ab8ad80ac34ac61d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8de40fe2bb814adcbe13958669063dc9"
I20260709 12:12:06.525731  4949 raft_consensus.cc:3060] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.521997 11041 consensus_queue.cc:1048] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:12:06.554831  4949 raft_consensus.cc:2468] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 14.
I20260709 12:12:06.561851  5016 raft_consensus.cc:1275] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:06.565249  4770 catalog_manager.cc:5697] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 14 to 15, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 15 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:06.593034  4991 consensus_peers.cc:597] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.594113  4988 leader_election.cc:304] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6
I20260709 12:12:06.598471 11050 consensus_queue.cc:1048] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:06.601979  4917 consensus_peers.cc:597] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.605854 11044 raft_consensus.cc:2804] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:06.619732  5603 raft_consensus.cc:1275] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 27 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:12:06.633389 11044 raft_consensus.cc:697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:06.634317 11044 consensus_queue.cc:237] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:06.636034 11013 consensus_queue.cc:1048] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:06.669266  5605 raft_consensus.cc:1275] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:06.670819 11051 consensus_queue.cc:1048] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:06.740135  4772 catalog_manager.cc:5697] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 11 to 14, leader changed from 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 14 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:06.858315  4949 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:06.887626  5017 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:06.889398 10960 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:06.893759  5605 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Refusing update from remote peer 8de40fe2bb814adcbe13958669063dc9: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:06.895282 10960 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:06.950867  5570 consensus_peers.cc:597] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:06.954044 11050 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 3 to 13, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:06.958118  5603 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 3 to 13, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:06.961365  5017 raft_consensus.cc:2955] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 3 to 13, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:06.981822  4772 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 reported cstate change: config changed from index 3 to 13, VOTER 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65) evicted. New cstate: current_term: 20 leader_uuid: "8de40fe2bb814adcbe13958669063dc9" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } } }
I20260709 12:12:06.987533  4758 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
W20260709 12:12:07.029874  4761 catalog_manager.cc:4755] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:07.062959  4944 raft_consensus.cc:1275] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:07.064389 11060 consensus_queue.cc:1048] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:07.199338  4991 consensus_peers.cc:597] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:07.217975  4949 raft_consensus.cc:1275] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:07.219385 11044 consensus_queue.cc:1048] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:12:07.228260  4917 consensus_peers.cc:597] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.239717  4991 consensus_peers.cc:597] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:07.382714  4991 consensus_peers.cc:597] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.457130  3725 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 4897)
W20260709 12:12:07.508347  5570 consensus_peers.cc:597] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.600086  5570 consensus_peers.cc:597] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.657462  5570 consensus_peers.cc:597] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:07.668433  5570 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.689363  5570 consensus_peers.cc:597] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.735224  4991 consensus_peers.cc:597] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.757863  4991 consensus_peers.cc:597] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.776520  4991 consensus_peers.cc:597] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.821565  4917 consensus_peers.cc:597] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:07.853623  5570 consensus_peers.cc:597] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.883867  5570 consensus_peers.cc:597] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.944514  4991 consensus_peers.cc:597] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:07.964686  4917 consensus_peers.cc:597] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.029381  4917 consensus_peers.cc:597] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.045866  4917 consensus_peers.cc:597] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.063926  4917 consensus_peers.cc:597] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.087076  5570 consensus_peers.cc:597] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.093286  4917 consensus_peers.cc:597] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.117241  4917 consensus_peers.cc:597] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.148646  5570 consensus_peers.cc:597] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.175868  4991 consensus_peers.cc:597] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.179823  5570 consensus_peers.cc:597] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.282483  4761 catalog_manager.cc:4755] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:08.303781  5570 consensus_peers.cc:597] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.350363  4917 consensus_peers.cc:597] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.415481  4917 consensus_peers.cc:597] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.457588  3725 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 4897)
W20260709 12:12:08.471961  4991 consensus_peers.cc:597] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.487179  4917 consensus_peers.cc:597] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.554229  4991 consensus_peers.cc:597] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.586440  4991 consensus_peers.cc:597] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.660202  4991 consensus_peers.cc:597] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.681646  4991 consensus_peers.cc:597] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.745764  4917 consensus_peers.cc:597] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.785676  4917 consensus_peers.cc:597] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:08.803483  4991 consensus_peers.cc:597] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.870541  4991 consensus_peers.cc:597] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.885831  5570 consensus_peers.cc:597] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:08.947695  4991 consensus_peers.cc:597] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.187337  4917 consensus_peers.cc:597] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.214661  4991 consensus_peers.cc:597] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.395278  5570 consensus_peers.cc:597] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.557840  4761 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 103666us
W20260709 12:12:09.562299  4761 catalog_manager.cc:4755] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:09.638347  4991 consensus_peers.cc:597] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:09.682322  4991 consensus_peers.cc:597] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:09.762751  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 53499.5us
W20260709 12:12:09.973959  5570 consensus_peers.cc:597] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.010787  4991 consensus_peers.cc:597] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.036773  4991 consensus_peers.cc:597] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.151804  5570 consensus_peers.cc:597] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.162544  4917 consensus_peers.cc:597] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.223552  5570 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.274427  4991 consensus_peers.cc:597] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.319221  4991 consensus_peers.cc:597] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.340217  5570 consensus_peers.cc:597] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.362517  5570 consensus_peers.cc:597] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:10.395614  3725 tablet_server.cc:196] TabletServer@127.3.163.65:0 shutdown complete.
W20260709 12:12:10.443497  5570 consensus_peers.cc:597] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:10.487726  4991 consensus_peers.cc:597] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.489360  5570 consensus_peers.cc:597] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.526605  5570 consensus_peers.cc:597] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:10.534879  3725 tablet_server.cc:179] TabletServer@127.3.163.66:0 shutting down...
W20260709 12:12:10.570698  4991 consensus_peers.cc:597] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.624883  4917 consensus_peers.cc:597] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.625540  4988 consensus_peers.cc:597] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.626137  4988 consensus_peers.cc:597] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.645138  5567 consensus_peers.cc:597] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.647148  5570 consensus_peers.cc:597] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.648474  5567 consensus_peers.cc:597] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.666622  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080024ee20 after lost signal to thread 3728
W20260709 12:12:10.667692  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080034b5a0 after lost signal to thread 4808
W20260709 12:12:10.668941  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce140 after lost signal to thread 4975
W20260709 12:12:10.669970  5627 debug-util.cc:398] Leaking SignalData structure 0x7b08003dffe0 after lost signal to thread 5049
W20260709 12:12:10.672132  5627 debug-util.cc:398] Leaking SignalData structure 0x7b080037ffa0 after lost signal to thread 5630
W20260709 12:12:10.673853  5567 consensus_peers.cc:597] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.674751  4988 consensus_peers.cc:597] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.675541  5567 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.679898  4988 consensus_peers.cc:597] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.680564  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:10.682160  3725 tablet_replica.cc:333] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
W20260709 12:12:10.683650  5570 consensus_peers.cc:597] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:10.683976  3725 raft_consensus.cc:2243] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.685063  3725 raft_consensus.cc:2272] T 36177f71106c42f98afc1b375e5f6838 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.693781  3725 tablet_replica.cc:333] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.694694  3725 raft_consensus.cc:2243] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.695377  3725 raft_consensus.cc:2272] T 951f0af961a844849af172b241003482 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.698092  3725 tablet_replica.cc:333] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.698905  3725 raft_consensus.cc:2243] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.699893  3725 raft_consensus.cc:2272] T 231547812bf34f17b386898e6451cc49 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.708523  4917 consensus_peers.cc:597] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:10.714753  3725 tablet_replica.cc:333] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.715623  3725 raft_consensus.cc:2243] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.716279  3725 raft_consensus.cc:2272] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.718658  4917 consensus_peers.cc:597] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:10.718873  3725 tablet_replica.cc:333] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.719717  3725 raft_consensus.cc:2243] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.720732  3725 raft_consensus.cc:2272] T 93239e0814394381aa73ef05e3ce06f0 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.722189  4988 consensus_peers.cc:597] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.722994  4988 consensus_peers.cc:597] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.725693  4917 consensus_peers.cc:597] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:10.726714  4988 consensus_peers.cc:597] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.727509  4988 consensus_peers.cc:597] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.728223  4988 consensus_peers.cc:597] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.730756  4988 consensus_peers.cc:597] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.723206  3725 tablet_replica.cc:333] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.733543  3725 raft_consensus.cc:2243] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.734210  3725 raft_consensus.cc:2272] T 3994e4d9351c414cb95b2a6e7bd76142 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.736936  3725 tablet_replica.cc:333] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.737725  3725 raft_consensus.cc:2243] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.738366  3725 raft_consensus.cc:2272] T 811353fb6b174f3e96608844f05794de P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.741093  3725 tablet_replica.cc:333] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.742560  3725 raft_consensus.cc:2243] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:12:10.742767  5567 consensus_peers.cc:597] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.743652  3725 raft_consensus.cc:2272] T b626d6ae78534a64a64c129ed023c901 P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.746222  3725 tablet_replica.cc:333] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.747006  3725 raft_consensus.cc:2243] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.747706  3725 raft_consensus.cc:2272] T ecf61812afc64320acafb43ddc29f4a2 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.750170  3725 tablet_replica.cc:333] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.750982  3725 raft_consensus.cc:2243] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.753204  3725 raft_consensus.cc:2272] T 66c02d3930da4dfba1f61356e4562709 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.755762  3725 tablet_replica.cc:333] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.756567  3725 raft_consensus.cc:2243] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.757156  3725 raft_consensus.cc:2272] T c480da15ff054400bdd09744d494717c P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.759554  3725 tablet_replica.cc:333] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.760344  3725 raft_consensus.cc:2243] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.760898  3725 raft_consensus.cc:2272] T 0c4699787549416cb829da40d250e0cf P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.763314  3725 tablet_replica.cc:333] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.764053  3725 raft_consensus.cc:2243] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.765049  3725 raft_consensus.cc:2272] T 9023c271389540b8a7b43d63718a4c7a P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.768131  3725 tablet_replica.cc:333] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
W20260709 12:12:10.768478  5567 consensus_peers.cc:597] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.768959  3725 raft_consensus.cc:2243] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.770077  3725 raft_consensus.cc:2272] T 88f88700ce294dc2bbfa0b1c51666ce7 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.772627  5567 consensus_peers.cc:597] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.773300  3725 tablet_replica.cc:333] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.774101  3725 raft_consensus.cc:2243] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.774781  3725 raft_consensus.cc:2272] T da27e3db08424ba7a8f3d771f12de9a7 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.777359  3725 tablet_replica.cc:333] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.778234  3725 raft_consensus.cc:2243] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.778872  3725 raft_consensus.cc:2272] T cd5508a3d98b403c8be99338c7e12502 P 8de40fe2bb814adcbe13958669063dc9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.781426  3725 tablet_replica.cc:333] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.782171  3725 raft_consensus.cc:2243] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.782730  3725 raft_consensus.cc:2272] T c4bd638d42a041ffa8deaf7135228fd6 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.785140  3725 tablet_replica.cc:333] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.785879  3725 raft_consensus.cc:2243] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.786826  3725 raft_consensus.cc:2272] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.789384  3725 tablet_replica.cc:333] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.790112  3725 raft_consensus.cc:2243] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.790655  3725 raft_consensus.cc:2272] T 950c0e5da47a49abb359c63b8483f487 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.793208  3725 tablet_replica.cc:333] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.793934  3725 raft_consensus.cc:2243] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:12:10.794970  4917 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.797935  3725 raft_consensus.cc:2272] T 0e7b07518a00402aaa235a0d34263b1f P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.800550  3725 tablet_replica.cc:333] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.801295  3725 raft_consensus.cc:2243] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.801857  3725 raft_consensus.cc:2272] T 97f05b369a3a4067afed9c87ba39f448 P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.804961  3725 tablet_replica.cc:333] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.805759  3725 raft_consensus.cc:2243] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.806664  3725 raft_consensus.cc:2272] T b4428def03fb45c99d3538acc2628494 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.807359  5567 consensus_peers.cc:597] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.809089  3725 tablet_replica.cc:333] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.809918  3725 raft_consensus.cc:2243] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.810938  3725 raft_consensus.cc:2272] T 7d62e31abaf34e25ad480865e4285e64 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.813505  3725 tablet_replica.cc:333] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.814270  3725 raft_consensus.cc:2243] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.814884  3725 raft_consensus.cc:2272] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.817312  3725 tablet_replica.cc:333] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.818068  3725 raft_consensus.cc:2243] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.818723  3725 raft_consensus.cc:2272] T c88d711fba9d480a97828652c6908d3f P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.821096  3725 tablet_replica.cc:333] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.821859  3725 raft_consensus.cc:2243] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.822914  3725 raft_consensus.cc:2272] T 2f74ad2f73ca4aeda444924811dca81b P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.827068  3725 tablet_replica.cc:333] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.828684  3725 raft_consensus.cc:2243] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.829329  3725 raft_consensus.cc:2272] T 22be31682d204ff18c81f1e0ac60a00a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.831615  3725 tablet_replica.cc:333] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.832331  3725 raft_consensus.cc:2243] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.833338  3725 raft_consensus.cc:2272] T af1ac4f5e2f747228d3574209d49e46f P 8de40fe2bb814adcbe13958669063dc9 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.833864  4988 consensus_peers.cc:597] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.835631  3725 tablet_replica.cc:333] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.836396  3725 raft_consensus.cc:2243] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.837339  3725 raft_consensus.cc:2272] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P 8de40fe2bb814adcbe13958669063dc9 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.839943  3725 tablet_replica.cc:333] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.840711  3725 raft_consensus.cc:2243] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.841369  3725 raft_consensus.cc:2272] T e66df43bc3234fd5b769c5dc5afc1096 P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.843544  4917 consensus_peers.cc:597] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:10.844023  3725 tablet_replica.cc:333] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.844907  3725 raft_consensus.cc:2243] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.845815  3725 raft_consensus.cc:2272] T acd2c2ca421a4b8e9629cd5b12e89e72 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.848307  3725 tablet_replica.cc:333] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.849054  3725 raft_consensus.cc:2243] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.850008  3725 raft_consensus.cc:2272] T 694e27a66efd449e81ce6297d4201cc3 P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.852489  3725 tablet_replica.cc:333] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
W20260709 12:12:10.852537  4988 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 469 similar messages]
I20260709 12:12:10.853472  3725 raft_consensus.cc:2243] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.854466  3725 raft_consensus.cc:2272] T 2004e797943d48d0ab1d7ed726902783 P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.854704  4988 consensus_peers.cc:597] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:10.857148  3725 tablet_replica.cc:333] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.857893  3725 raft_consensus.cc:2243] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.858534  3725 raft_consensus.cc:2272] T 49d7b189f495402dbbaadba00a5cebb8 P 8de40fe2bb814adcbe13958669063dc9 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.861091  3725 tablet_replica.cc:333] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.861820  3725 raft_consensus.cc:2243] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.862782  3725 raft_consensus.cc:2272] T c9425cbf78b044ef8b0190a6eb0be1b3 P 8de40fe2bb814adcbe13958669063dc9 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.865303  3725 tablet_replica.cc:333] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.866019  3725 raft_consensus.cc:2243] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.866518  3725 raft_consensus.cc:2272] T ee4c2e710f7a41958315091dfd907d8d P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.869002  3725 tablet_replica.cc:333] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.869736  3725 raft_consensus.cc:2243] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.870327  3725 raft_consensus.cc:2272] T c3ea9d9171fa428195bc085a20e92e3a P 8de40fe2bb814adcbe13958669063dc9 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.875106  3725 tablet_replica.cc:333] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.875901  3725 raft_consensus.cc:2243] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:10.876861  3725 raft_consensus.cc:2272] T 42e9d7673d8444ae8097208f1095114d P 8de40fe2bb814adcbe13958669063dc9 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.879385  3725 tablet_replica.cc:333] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.880199  3725 raft_consensus.cc:2243] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.880743  3725 raft_consensus.cc:2272] T 34fa1ee1e05941b1a81b5aa296c1867c P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.883118  3725 tablet_replica.cc:333] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.883859  3725 raft_consensus.cc:2243] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.884505  3725 raft_consensus.cc:2272] T 6f0691894555408ab3e2a8dedaa21303 P 8de40fe2bb814adcbe13958669063dc9 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.886902  3725 tablet_replica.cc:333] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.887601  3725 raft_consensus.cc:2243] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.888131  3725 raft_consensus.cc:2272] T 83dd0599104f4ef0a0f49401f0f0687c P 8de40fe2bb814adcbe13958669063dc9 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.890576  3725 tablet_replica.cc:333] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.891280  3725 raft_consensus.cc:2243] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.891860  3725 raft_consensus.cc:2272] T 968e3c47814549fe8cf64abe52c00d29 P 8de40fe2bb814adcbe13958669063dc9 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.894387  3725 tablet_replica.cc:333] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
W20260709 12:12:10.894855  4991 consensus_peers.cc:597] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:10.895040  3725 raft_consensus.cc:2243] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.895777  3725 raft_consensus.cc:2272] T b3b5f40fd4fa49619588c424099a9a3b P 8de40fe2bb814adcbe13958669063dc9 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.898252  3725 tablet_replica.cc:333] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.898916  3725 raft_consensus.cc:2243] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.899448  3725 raft_consensus.cc:2272] T 1fb0f431b68a4f78a03a58597b9cc66a P 8de40fe2bb814adcbe13958669063dc9 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:10.901780  3725 tablet_replica.cc:333] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9: stopping tablet replica
I20260709 12:12:10.902407  3725 raft_consensus.cc:2243] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:10.903049  3725 raft_consensus.cc:2272] T 15263062183540bdbd45628b3342a3d5 P 8de40fe2bb814adcbe13958669063dc9 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:10.919643  5570 consensus_peers.cc:597] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:10.928609  5567 consensus_peers.cc:597] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.932457  5567 consensus_peers.cc:597] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.934329  4988 consensus_peers.cc:597] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.937500  4988 consensus_peers.cc:597] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.990707  5567 consensus_peers.cc:597] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:10.992272  4991 consensus_peers.cc:597] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:10.993577  5567 consensus_peers.cc:597] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.003623  5567 consensus_peers.cc:597] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.024411  5567 consensus_peers.cc:597] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:11.163329  5567 connection.cc:769] client connection to 127.3.163.66:43473 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:12:11.328598  4991 consensus_peers.cc:597] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.348681  5570 consensus_peers.cc:597] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.405818  4991 consensus_peers.cc:597] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.416854  4991 consensus_peers.cc:597] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.456148  4991 consensus_peers.cc:597] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.613408  4991 consensus_peers.cc:597] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.674122  4761 catalog_manager.cc:4755] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:11.676915  5570 consensus_peers.cc:597] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.706319 11107 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:11.706919 11107 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:11.709061 11107 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:11.709537  4991 consensus_peers.cc:597] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:11.717022  5570 leader_election.cc:336] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:11.717804  5567 leader_election.cc:336] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:11.718189  5567 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:11.719746 11112 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:11.725961  4991 consensus_peers.cc:597] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:11.737581 11106 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:11.738051 11106 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:11.741077  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:11.744587 11106 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:11.745039 11115 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:11.749094 11115 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:11.751611 11115 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:11.752970  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
W20260709 12:12:11.765023  4991 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:11.765460  4991 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, ab9da67236874634be59ebfd05b18255
W20260709 12:12:11.768119  4988 leader_election.cc:336] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:11.768581 11115 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:11.772935  4988 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9, ab9da67236874634be59ebfd05b18255
I20260709 12:12:11.776049 11115 raft_consensus.cc:2749] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:11.776979  4988 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:11.790117 11107 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:11.790628 11107 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:11.792775 11107 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:11.794504  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
W20260709 12:12:11.796835  5567 leader_election.cc:336] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:11.797549  5568 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:11.798714 11107 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:11.813261 11107 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:11.813691 11107 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:11.815694 11107 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:11.824002 11112 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:11.824461 11112 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:11.826426 11112 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:11.827880  5567 leader_election.cc:336] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:11.830632  5570 leader_election.cc:336] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:11.831058  5570 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:11.831790 11113 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:11.837299  5567 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:11.839787  5570 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:11.840207  5570 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:11.841354 11107 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:12.000476 11113 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.001026 11113 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.003082 11113 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:12.004521  5020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:12.005936 11115 raft_consensus.cc:493] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.006461 11115 raft_consensus.cc:515] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:12.008359 11115 leader_election.cc:290] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:12.009130  5567 leader_election.cc:336] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.009557  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:12.011459 11106 raft_consensus.cc:493] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.011925 11106 raft_consensus.cc:515] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:12.014245 11106 leader_election.cc:290] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:12.015933  4988 leader_election.cc:336] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:12.019867  4991 leader_election.cc:336] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:12.020171  4988 leader_election.cc:336] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.020460 11113 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:12.020262  4991 leader_election.cc:304] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.023661 11115 raft_consensus.cc:2749] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:12.029618  4991 leader_election.cc:336] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:12.030014  4991 leader_election.cc:304] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.030668 11106 raft_consensus.cc:2749] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.044096 11115 raft_consensus.cc:493] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.044526 11115 raft_consensus.cc:515] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:12.046334 11115 leader_election.cc:290] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:12.053495  4988 leader_election.cc:336] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:12.056483  4991 leader_election.cc:336] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:12.054214 11113 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.057078 11113 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.061345  4991 leader_election.cc:304] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.064121 11106 raft_consensus.cc:2749] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:12.065477 11113 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:12.066490  5567 leader_election.cc:336] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:12.067265  5570 leader_election.cc:336] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:12.067641  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.068773 11113 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:12.077754 11115 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.078230 11115 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.080147 11115 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:12.081691  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:12.082266  5603 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 19.
I20260709 12:12:12.085008  4990 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:12.086483 11106 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:12.086822 11106 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.087138 11106 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:12.091615  4988 leader_election.cc:336] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.098932 11106 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.101253 11115 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.102053 11115 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
W20260709 12:12:12.107617  4991 leader_election.cc:336] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:12.108786 11115 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:12.113382  4988 leader_election.cc:336] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.113850  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.114863 11115 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:12.117664  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f74ad2f73ca4aeda444924811dca81b" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:12.118160  5603 raft_consensus.cc:3060] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:12.130036  5603 raft_consensus.cc:2468] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 20.
I20260709 12:12:12.134465 11115 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.135385  4990 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:12.136272 11093 raft_consensus.cc:2804] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:12.139053 11113 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.139884 11113 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.140628 11115 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.144300 11107 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.144789 11107 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.146744 11107 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:12.150671  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255" is_pre_election: true
I20260709 12:12:12.151278  5603 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 12.
W20260709 12:12:12.152879  5570 leader_election.cc:336] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:12.156213  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:12.156230 11113 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:12.156355  5567 leader_election.cc:336] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:12.157204  5567 leader_election.cc:336] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.157621  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.156879  5023 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 20.
I20260709 12:12:12.163321 11113 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.166507 11113 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.167014 11113 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.166733 11106 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:12.169019 11113 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:12.171244 11115 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
W20260709 12:12:12.174718  5570 leader_election.cc:336] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:12.175022  4988 leader_election.cc:336] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.177781  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.178848 11112 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:12.179211 11112 raft_consensus.cc:493] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.179557 11107 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
W20260709 12:12:12.180100  5567 leader_election.cc:336] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.180063 11107 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.182173 11107 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:12.180752  5567 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.179533 11112 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:12.187858 11113 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:12.194730  5570 leader_election.cc:336] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:12.200907  5567 leader_election.cc:336] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.202850  5567 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.205349 11113 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.204016 11112 raft_consensus.cc:515] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.207993 11112 leader_election.cc:290] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:12.212085  4991 consensus_peers.cc:597] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:12.216216  5567 leader_election.cc:336] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.217896  5023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdc8c4ad3594326a9fe9ab6fdc2974d" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010"
I20260709 12:12:12.218137 11120 raft_consensus.cc:493] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.218456  5023 raft_consensus.cc:3060] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:12.218619 11120 raft_consensus.cc:515] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:12.222270  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 
I20260709 12:12:12.224876 11106 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:12.225270 11106 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.225443  5023 raft_consensus.cc:2468] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 21.
I20260709 12:12:12.225689 11106 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:12.226263 11093 raft_consensus.cc:697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 20 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:12.227198 11093 consensus_queue.cc:237] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.232553 11119 raft_consensus.cc:493] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.233065 11119 raft_consensus.cc:515] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:12.233964 11106 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.235251 11119 leader_election.cc:290] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:12.236220 11106 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Requested vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), ab9da67236874634be59ebfd05b18255 (127.3.163.68:44297)
I20260709 12:12:12.236647 11120 leader_election.cc:290] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:12.289860  4988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:43473, user_credentials={real_user=slave}} blocked reactor thread for 71783us
W20260709 12:12:12.290660  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 68377us
W20260709 12:12:12.293262  4990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:44297, user_credentials={real_user=slave}} blocked reactor thread for 62066.7us
W20260709 12:12:12.292232  4988 leader_election.cc:336] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.309350  4772 catalog_manager.cc:5697] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 19 to 20, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 20 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:12.321722  4991 leader_election.cc:336] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:12.335763  4991 leader_election.cc:336] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:12.406054  5568 leader_election.cc:304] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
W20260709 12:12:12.408565  4991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:38799, user_credentials={real_user=slave}} blocked reactor thread for 72873.6us
I20260709 12:12:12.404197  5603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da05b23b88546d1b3a9c8ec5ec7bb26" candidate_uuid: "baa50eb5ed704004b7f391934a59d010" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ab9da67236874634be59ebfd05b18255"
I20260709 12:12:12.416800  5603 raft_consensus.cc:3060] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:12.335287 11107 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:12.414980 11126 raft_consensus.cc:2804] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:12.425026 11126 raft_consensus.cc:697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 21 LEADER]: Becoming Leader. State: Replica: ab9da67236874634be59ebfd05b18255, State: Running, Role: LEADER
I20260709 12:12:12.424784 11107 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.426748 11126 consensus_queue.cc:237] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:12.454322 11107 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:12.463275  4988 leader_election.cc:336] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.463806  4988 leader_election.cc:304] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.464763 11125 raft_consensus.cc:2749] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:12.466027  4988 leader_election.cc:336] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:12.466133  5567 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:12.466670  4988 leader_election.cc:336] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:12.467139  4988 leader_election.cc:304] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.467893 11125 raft_consensus.cc:2749] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:12.471120  5019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7b07518a00402aaa235a0d34263b1f" candidate_uuid: "ab9da67236874634be59ebfd05b18255" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "baa50eb5ed704004b7f391934a59d010" is_pre_election: true
I20260709 12:12:12.471998  5019 raft_consensus.cc:2468] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9da67236874634be59ebfd05b18255 in term 17.
W20260709 12:12:12.512017  4991 consensus_peers.cc:597] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:12.515014  5603 raft_consensus.cc:2468] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa50eb5ed704004b7f391934a59d010 in term 13.
I20260709 12:12:12.516466  4990 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.519196 11125 raft_consensus.cc:2804] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:12.519685 11125 raft_consensus.cc:697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Becoming Leader. State: Replica: baa50eb5ed704004b7f391934a59d010, State: Running, Role: LEADER
I20260709 12:12:12.520731 11125 consensus_queue.cc:237] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:12.517935  4991 consensus_peers.cc:597] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:12.550390  5570 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:12.550951  5570 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255, baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:12.552235 11126 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.554296  4769 catalog_manager.cc:5697] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 reported cstate change: term changed from 20 to 21, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to ab9da67236874634be59ebfd05b18255 (127.3.163.68). New cstate: current_term: 21 leader_uuid: "ab9da67236874634be59ebfd05b18255" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:12.593212  5570 consensus_peers.cc:597] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:12.597035  5570 consensus_peers.cc:597] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:12.632344  4769 catalog_manager.cc:5697] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 reported cstate change: term changed from 12 to 13, leader changed from 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66) to baa50eb5ed704004b7f391934a59d010 (127.3.163.67). New cstate: current_term: 13 leader_uuid: "baa50eb5ed704004b7f391934a59d010" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:12.674891  4988 consensus_peers.cc:597] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:12.682228  5570 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:12.731632  4991 consensus_peers.cc:597] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:12.760710  5567 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:12.783263  5603 raft_consensus.cc:1275] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:12:12.784901 11125 consensus_queue.cc:1048] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:12:12.827699  4991 consensus_peers.cc:597] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:12:12.879336  3725 tablet_server.cc:196] TabletServer@127.3.163.66:0 shutdown complete.
W20260709 12:12:12.882839  5570 consensus_peers.cc:597] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:12.885505  5570 consensus_peers.cc:597] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:12.901734  5567 consensus_peers.cc:597] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:12.907014  5023 raft_consensus.cc:1275] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Refusing update from remote peer ab9da67236874634be59ebfd05b18255: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:12.908672 11128 consensus_queue.cc:1048] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:12:12.920748  4991 consensus_peers.cc:597] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:12.949442  4988 consensus_peers.cc:597] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:12.954591  5567 consensus_peers.cc:597] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:12.975246  5605 raft_consensus.cc:1275] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Refusing update from remote peer baa50eb5ed704004b7f391934a59d010: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:12.976703 11125 consensus_queue.cc:1048] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:12:13.012684  5567 consensus_peers.cc:597] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.022979  5570 consensus_peers.cc:597] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:13.031584  4991 consensus_peers.cc:597] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:13.052158  4988 consensus_peers.cc:597] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.064229  4991 consensus_peers.cc:597] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:13.091985  4988 consensus_peers.cc:597] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.094204  5567 consensus_peers.cc:597] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.104846  5570 consensus_peers.cc:597] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:13.106542  4988 consensus_peers.cc:597] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.126996  4988 consensus_peers.cc:597] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.138880  5567 consensus_peers.cc:597] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.145846  5570 consensus_peers.cc:597] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:13.190913  5570 consensus_peers.cc:597] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:13.225917  4988 consensus_peers.cc:597] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.234475  5570 consensus_peers.cc:597] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:12:13.262802  5567 consensus_peers.cc:597] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.265228  3725 tablet_server.cc:179] TabletServer@127.3.163.67:0 shutting down...
W20260709 12:12:13.284689  5568 consensus_peers.cc:597] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.286437  4988 consensus_peers.cc:597] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.287048  4988 consensus_peers.cc:597] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.307153  5568 consensus_peers.cc:597] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.304420  5567 consensus_peers.cc:597] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.311774  4988 consensus_peers.cc:597] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.340996  5567 consensus_peers.cc:597] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.341778  4988 consensus_peers.cc:597] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.368432  4988 consensus_peers.cc:597] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.376988  5567 consensus_peers.cc:597] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.392457 11107 raft_consensus.cc:493] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:13.393081 11107 raft_consensus.cc:515] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:13.395185 11107 leader_election.cc:290] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:13.403105  5567 consensus_peers.cc:597] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.406030  5568 consensus_peers.cc:597] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.411192  5568 consensus_peers.cc:597] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.415408  4991 consensus_peers.cc:597] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:13.417101  5570 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:13.432137  5567 consensus_peers.cc:597] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.436518  5568 consensus_peers.cc:597] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.440981  5567 leader_election.cc:336] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:13.442373  5567 leader_election.cc:304] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
W20260709 12:12:13.441955  5570 consensus_peers.cc:597] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.446558 11126 raft_consensus.cc:2749] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:13.447444  4988 consensus_peers.cc:597] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.461493  5567 consensus_peers.cc:597] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.475351  4988 consensus_peers.cc:597] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:13.479504  5568 consensus_peers.cc:597] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.489883  5568 consensus_peers.cc:597] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.516032  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:13.523766  3725 tablet_replica.cc:333] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.524720  3725 raft_consensus.cc:2243] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.525486  3725 raft_consensus.cc:2272] T 9752c5a68f0f415b848ef1da168f8d82 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.528143  3725 tablet_replica.cc:333] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.528959  3725 raft_consensus.cc:2243] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.529619  3725 raft_consensus.cc:2272] T b0ae020fc77f442c9f248fa0f3e45fe4 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:13.554754  5568 consensus_peers.cc:597] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.561096  3725 tablet_replica.cc:333] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.561998  3725 raft_consensus.cc:2243] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.562640  3725 raft_consensus.cc:2272] T 231547812bf34f17b386898e6451cc49 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.565472  3725 tablet_replica.cc:333] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.566275  3725 raft_consensus.cc:2243] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:13.570221  5568 consensus_peers.cc:597] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.570523  3725 raft_consensus.cc:2272] T 184edf8541a448c78939e0c2fd55ae1f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:13.575556  5568 consensus_peers.cc:597] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:13.578650  4988 consensus_peers.cc:597] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.580910  3725 tablet_replica.cc:333] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.581851  3725 raft_consensus.cc:2243] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.582455  3725 raft_consensus.cc:2272] T 951f0af961a844849af172b241003482 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:13.586187  5568 consensus_peers.cc:597] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.588373  3725 tablet_replica.cc:333] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.589216  3725 raft_consensus.cc:2243] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.590378  3725 raft_consensus.cc:2272] T 9ec4626ffb3e4c87ab8ad80ac34ac61d P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.593178  3725 tablet_replica.cc:333] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.593998  3725 raft_consensus.cc:2243] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.598829  3725 raft_consensus.cc:2272] T c88d711fba9d480a97828652c6908d3f P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:13.605046  4991 consensus_peers.cc:597] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:13.606959  3725 tablet_replica.cc:333] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.607780  3725 raft_consensus.cc:2243] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.608961  3725 raft_consensus.cc:2272] T 3805e1c03edc45ed8a91427825b04e2e P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.611461  3725 tablet_replica.cc:333] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.612265  3725 raft_consensus.cc:2243] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.613461  3725 raft_consensus.cc:2272] T c480da15ff054400bdd09744d494717c P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.616127  3725 tablet_replica.cc:333] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
W20260709 12:12:13.622032  5568 consensus_peers.cc:597] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.623136  3725 raft_consensus.cc:2243] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.624293  3725 raft_consensus.cc:2272] T ecf61812afc64320acafb43ddc29f4a2 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.626756  3725 tablet_replica.cc:333] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.627482  3725 raft_consensus.cc:2243] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.629186  3725 raft_consensus.cc:2272] T 66c02d3930da4dfba1f61356e4562709 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.638444  3725 tablet_replica.cc:333] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.639267  3725 raft_consensus.cc:2243] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.640486  3725 raft_consensus.cc:2272] T 0c4699787549416cb829da40d250e0cf P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.642891  3725 tablet_replica.cc:333] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.643700  3725 raft_consensus.cc:2243] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.644356  3725 raft_consensus.cc:2272] T da27e3db08424ba7a8f3d771f12de9a7 P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.647095  3725 tablet_replica.cc:333] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.649355  3725 raft_consensus.cc:2243] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.650560  3725 raft_consensus.cc:2272] T cd5508a3d98b403c8be99338c7e12502 P baa50eb5ed704004b7f391934a59d010 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.653180  3725 tablet_replica.cc:333] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.653924  3725 raft_consensus.cc:2243] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.654778  3725 raft_consensus.cc:2272] T 9023c271389540b8a7b43d63718a4c7a P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.662442  3725 tablet_replica.cc:333] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.663354  3725 raft_consensus.cc:2243] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.664463  3725 raft_consensus.cc:2272] T 811353fb6b174f3e96608844f05794de P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.685298  3725 tablet_replica.cc:333] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.686242  3725 raft_consensus.cc:2243] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.686894  3725 raft_consensus.cc:2272] T 83dd0599104f4ef0a0f49401f0f0687c P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.689721  3725 tablet_replica.cc:333] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.690447  3725 raft_consensus.cc:2243] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.691715  3725 raft_consensus.cc:2272] T c4bd638d42a041ffa8deaf7135228fd6 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.694182  3725 tablet_replica.cc:333] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.694936  3725 raft_consensus.cc:2243] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.696038  3725 raft_consensus.cc:2272] T b33c26da92464c7896c3c4d2243075e8 P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.698447  3725 tablet_replica.cc:333] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.699200  3725 raft_consensus.cc:2243] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.700192  3725 raft_consensus.cc:2272] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.704367  3725 tablet_replica.cc:333] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.705220  3725 raft_consensus.cc:2243] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.706311 11107 raft_consensus.cc:493] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:13.706910 11107 raft_consensus.cc:515] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:13.707388  3725 raft_consensus.cc:2272] T 1f8b0320f7e94e2688e2a1d2005746ef P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.710207  3725 tablet_replica.cc:333] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.710958  3725 raft_consensus.cc:2243] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.712002  3725 raft_consensus.cc:2272] T 0e7b07518a00402aaa235a0d34263b1f P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.714453  3725 tablet_replica.cc:333] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.715237  3725 raft_consensus.cc:2243] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:12:13.715317  5570 leader_election.cc:336] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:13.716398  3725 raft_consensus.cc:2272] T 3271fdf9e70240dc96def0f272e84933 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:13.718788  5567 consensus_peers.cc:597] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.719017  3725 tablet_replica.cc:333] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.719877  3725 raft_consensus.cc:2243] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.719914 11107 leader_election.cc:290] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:13.724660  5567 leader_election.cc:336] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:13.743443  5567 leader_election.cc:304] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:13.743542  3725 raft_consensus.cc:2272] T 97f05b369a3a4067afed9c87ba39f448 P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.744755 11142 raft_consensus.cc:2749] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:13.733822 11126 raft_consensus.cc:493] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:13.748520 11126 raft_consensus.cc:515] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:13.750571 11126 leader_election.cc:290] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:13.750712  5568 consensus_peers.cc:597] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.751474  3725 tablet_replica.cc:333] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.752249  3725 raft_consensus.cc:2243] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:12:13.753834  5567 consensus_peers.cc:597] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.753464  3725 raft_consensus.cc:2272] T 3da8832a07224abb9a1f8815f3dcd745 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.757367  3725 tablet_replica.cc:333] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.758607  3725 raft_consensus.cc:2243] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.759657  3725 raft_consensus.cc:2272] T 7d89e729329948059879ed6f44a07690 P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:13.760149  5567 leader_election.cc:336] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:13.764356  5570 leader_election.cc:336] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:13.766137  4988 consensus_peers.cc:597] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:13.766397  5570 leader_election.cc:304] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:13.767930 11126 raft_consensus.cc:2749] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.769104  3725 tablet_replica.cc:333] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.769928  3725 raft_consensus.cc:2243] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.771131  3725 raft_consensus.cc:2272] T 6f4e29d1896a40e18a1e129dfc2a01c4 P baa50eb5ed704004b7f391934a59d010 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.773578  3725 tablet_replica.cc:333] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.774293  3725 raft_consensus.cc:2243] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.774921  3725 raft_consensus.cc:2272] T b4428def03fb45c99d3538acc2628494 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.777422  3725 tablet_replica.cc:333] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.778115  3725 raft_consensus.cc:2243] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.779201  3725 raft_consensus.cc:2272] T acd2c2ca421a4b8e9629cd5b12e89e72 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.782027  3725 tablet_replica.cc:333] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.782753  3725 raft_consensus.cc:2243] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.783455  3725 raft_consensus.cc:2272] T 49d7b189f495402dbbaadba00a5cebb8 P baa50eb5ed704004b7f391934a59d010 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.785874  3725 tablet_replica.cc:333] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.786585  3725 raft_consensus.cc:2243] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.787199  3725 raft_consensus.cc:2272] T c9425cbf78b044ef8b0190a6eb0be1b3 P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.788177 11125 raft_consensus.cc:493] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:13.788635 11125 raft_consensus.cc:515] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } }
I20260709 12:12:13.790617 11125 leader_election.cc:290] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:13.799727  4991 leader_election.cc:336] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:13.800415  4988 leader_election.cc:336] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:13.800825  4988 leader_election.cc:304] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa50eb5ed704004b7f391934a59d010; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:13.804536 11121 raft_consensus.cc:2749] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:13.811792  5568 consensus_peers.cc:597] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 -> Peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Couldn't send request to peer baa50eb5ed704004b7f391934a59d010. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.814795  3725 tablet_replica.cc:333] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.815575  3725 raft_consensus.cc:2243] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.816210  3725 raft_consensus.cc:2272] T ee4c2e710f7a41958315091dfd907d8d P baa50eb5ed704004b7f391934a59d010 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.818799  3725 tablet_replica.cc:333] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.819497  3725 raft_consensus.cc:2243] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.820194  3725 raft_consensus.cc:2272] T 42e9d7673d8444ae8097208f1095114d P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.822794  3725 tablet_replica.cc:333] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.828768  3725 raft_consensus.cc:2243] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.829888  3725 raft_consensus.cc:2272] T 34fa1ee1e05941b1a81b5aa296c1867c P baa50eb5ed704004b7f391934a59d010 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.832537  3725 tablet_replica.cc:333] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.833266  3725 raft_consensus.cc:2243] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.834081  3725 raft_consensus.cc:2272] T af1ac4f5e2f747228d3574209d49e46f P baa50eb5ed704004b7f391934a59d010 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.836673  3725 tablet_replica.cc:333] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.837373  3725 raft_consensus.cc:2243] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.838429  3725 raft_consensus.cc:2272] T 22be31682d204ff18c81f1e0ac60a00a P baa50eb5ed704004b7f391934a59d010 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.840946  3725 tablet_replica.cc:333] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.841691  3725 raft_consensus.cc:2243] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.842248  3725 raft_consensus.cc:2272] T 968e3c47814549fe8cf64abe52c00d29 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.844839  3725 tablet_replica.cc:333] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.845520  3725 raft_consensus.cc:2243] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.846743  3725 raft_consensus.cc:2272] T 4be803cbf3854da89561de85968acd64 P baa50eb5ed704004b7f391934a59d010 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.866125  3725 tablet_replica.cc:333] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.866832  3725 raft_consensus.cc:2243] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.867633  3725 raft_consensus.cc:2272] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P baa50eb5ed704004b7f391934a59d010 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.882628 11107 raft_consensus.cc:493] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:13.883167 11107 raft_consensus.cc:515] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:13.885669 11107 leader_election.cc:290] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:13.890934  5570 leader_election.cc:336] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:13.891628  5567 leader_election.cc:336] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:13.891790  3725 tablet_replica.cc:333] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.892073  5567 leader_election.cc:304] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:13.892839 11107 raft_consensus.cc:2749] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.892630  3725 raft_consensus.cc:2243] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.894546  3725 raft_consensus.cc:2272] T fedd910b0097474d987abca8337e4e48 P baa50eb5ed704004b7f391934a59d010 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.897215  3725 tablet_replica.cc:333] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.898003  3725 raft_consensus.cc:2243] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.907053  3725 raft_consensus.cc:2272] T 2f74ad2f73ca4aeda444924811dca81b P baa50eb5ed704004b7f391934a59d010 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.910163  3725 tablet_replica.cc:333] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.910856  3725 raft_consensus.cc:2243] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.912043  3725 raft_consensus.cc:2272] T 008a4803b16b4c108fa5d52753a9f9a3 P baa50eb5ed704004b7f391934a59d010 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.914664  3725 tablet_replica.cc:333] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.915383  3725 raft_consensus.cc:2243] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.916489  3725 raft_consensus.cc:2272] T 6f0691894555408ab3e2a8dedaa21303 P baa50eb5ed704004b7f391934a59d010 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.919066  3725 tablet_replica.cc:333] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.919798  3725 raft_consensus.cc:2243] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:13.921099  3725 raft_consensus.cc:2272] T 15263062183540bdbd45628b3342a3d5 P baa50eb5ed704004b7f391934a59d010 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.923588  3725 tablet_replica.cc:333] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010: stopping tablet replica
I20260709 12:12:13.924284  3725 raft_consensus.cc:2243] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:13.924998  3725 raft_consensus.cc:2272] T 737cb737da3146798e07c2c2026eebcc P baa50eb5ed704004b7f391934a59d010 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:13.990149 11126 raft_consensus.cc:493] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:13.990690 11126 raft_consensus.cc:515] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:13.992748 11126 leader_election.cc:290] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:14.000197  5567 leader_election.cc:336] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:14.001156  5570 leader_election.cc:336] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:14.001529  5570 leader_election.cc:304] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:14.002354 11107 raft_consensus.cc:2749] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:14.013154 11107 raft_consensus.cc:493] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:14.013628 11107 raft_consensus.cc:515] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:14.015971 11107 leader_election.cc:290] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
W20260709 12:12:14.028823  5570 leader_election.cc:336] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:14.039732  5567 leader_election.cc:336] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:14.041342  5567 leader_election.cc:304] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:14.042356 11107 raft_consensus.cc:2749] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:14.051465  5570 consensus_peers.cc:597] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:12:14.230664  5570 consensus_peers.cc:597] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:12:14.292228 11142 raft_consensus.cc:493] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:14.292764 11142 raft_consensus.cc:515] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:14.294814 11142 leader_election.cc:290] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473)
I20260709 12:12:14.296216 11142 raft_consensus.cc:493] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8de40fe2bb814adcbe13958669063dc9)
I20260709 12:12:14.296731 11142 raft_consensus.cc:515] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } attrs { replace: true } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
W20260709 12:12:14.312637  5568 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
W20260709 12:12:14.306478  5567 leader_election.cc:336] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:14.323469 11142 leader_election.cc:290] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:14.331138  5570 leader_election.cc:336] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:14.332142  5570 leader_election.cc:304] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, 8de40fe2bb814adcbe13958669063dc9
I20260709 12:12:14.333674 11142 raft_consensus.cc:2749] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:14.332674  5567 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:14.334465  5567 leader_election.cc:304] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:14.335516 11142 raft_consensus.cc:2749] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:14.336875  5570 leader_election.cc:336] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:14.692565 11142 raft_consensus.cc:493] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:14.693041 11142 raft_consensus.cc:515] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:14.694667 11142 leader_election.cc:290] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:14.699433  5570 leader_election.cc:336] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:14.699837  5568 leader_election.cc:336] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:14.700205  5568 leader_election.cc:304] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:14.700834 11107 raft_consensus.cc:2749] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:14.741374 11107 raft_consensus.cc:493] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:14.741724 11107 raft_consensus.cc:515] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:14.743155 11107 leader_election.cc:290] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:14.747120  5570 leader_election.cc:336] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:14.748150  5568 leader_election.cc:336] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:14.748579  5568 leader_election.cc:304] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:14.749274 11142 raft_consensus.cc:2749] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:14.875921 11107 raft_consensus.cc:493] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:14.876458 11107 raft_consensus.cc:515] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:14.878394 11107 leader_election.cc:290] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:14.882469  5568 leader_election.cc:336] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
W20260709 12:12:14.883814  5567 leader_election.cc:336] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:14.884202  5567 leader_election.cc:304] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:14.884876 11107 raft_consensus.cc:2749] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:12:14.893615  5570 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:14.916111 11142 raft_consensus.cc:493] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:14.916585 11142 raft_consensus.cc:515] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:14.918520 11142 leader_election.cc:290] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:14.923579  5570 leader_election.cc:336] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:14.925117  5568 leader_election.cc:336] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:14.925503  5568 leader_election.cc:304] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:14.926131 11142 raft_consensus.cc:2749] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:14.959329  5570 consensus_peers.cc:597] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:14.997175 11107 raft_consensus.cc:493] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:14.997670 11107 raft_consensus.cc:515] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:14.999581 11107 leader_election.cc:290] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.003707  5568 leader_election.cc:336] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
W20260709 12:12:15.004211  5567 leader_election.cc:336] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:15.004611  5567 leader_election.cc:304] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.005260 11107 raft_consensus.cc:2749] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:12:15.023370 11107 raft_consensus.cc:493] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.023794 11107 raft_consensus.cc:515] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.025601 11107 leader_election.cc:290] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.029785  5570 leader_election.cc:336] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:15.030505  5568 leader_election.cc:336] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:15.030880  5568 leader_election.cc:304] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.031495 11107 raft_consensus.cc:2749] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.034914 11107 raft_consensus.cc:493] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.035605 11142 raft_consensus.cc:493] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.036099 11142 raft_consensus.cc:515] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.038093 11142 leader_election.cc:290] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:15.035310 11107 raft_consensus.cc:515] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.041590 11107 leader_election.cc:290] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.042861  5570 leader_election.cc:336] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:15.046345  5568 leader_election.cc:336] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
W20260709 12:12:15.046756  5570 leader_election.cc:336] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:15.046762  5568 leader_election.cc:304] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.047672 11107 raft_consensus.cc:2749] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:15.048547  5568 leader_election.cc:336] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:15.048975  5568 leader_election.cc:304] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.049630 11107 raft_consensus.cc:2749] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.097415 11107 raft_consensus.cc:493] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.097905 11107 raft_consensus.cc:515] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.099736 11107 leader_election.cc:290] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.103950  5568 leader_election.cc:336] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
W20260709 12:12:15.104437  5567 leader_election.cc:336] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:15.104864  5567 leader_election.cc:304] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.105580 11107 raft_consensus.cc:2749] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:15.106541  3725 tablet_server.cc:196] TabletServer@127.3.163.67:0 shutdown complete.
I20260709 12:12:15.120543 11107 raft_consensus.cc:493] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.121143 11107 raft_consensus.cc:515] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.123636 11107 leader_election.cc:290] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.129408  5568 leader_election.cc:336] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
W20260709 12:12:15.133039  5567 leader_election.cc:336] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:15.133476  5567 leader_election.cc:304] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.134552 11142 raft_consensus.cc:493] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.135479 11107 raft_consensus.cc:2749] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.135074 11142 raft_consensus.cc:515] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.137351 11142 leader_election.cc:290] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
I20260709 12:12:15.141920 11107 raft_consensus.cc:493] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.142382 11107 raft_consensus.cc:515] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.144192 11107 leader_election.cc:290] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.145272  5568 leader_election.cc:336] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
W20260709 12:12:15.148150  5567 leader_election.cc:336] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
I20260709 12:12:15.148603  5567 leader_election.cc:304] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.149708 11107 raft_consensus.cc:2749] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:12:15.148061  5570 leader_election.cc:336] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
W20260709 12:12:15.152909  5568 leader_election.cc:336] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:15.153323  5568 leader_election.cc:304] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.154311 11142 raft_consensus.cc:2749] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:15.169365 11142 raft_consensus.cc:493] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.169855 11142 raft_consensus.cc:515] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4f3bf546572147c3abe4522189e86ce6" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38799 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.172148 11142 leader_election.cc:290] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.175868  5570 leader_election.cc:336] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:15.176911 11142 raft_consensus.cc:493] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
W20260709 12:12:15.177372  5568 leader_election.cc:336] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:15.177426 11142 raft_consensus.cc:515] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.177878  5568 leader_election.cc:304] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 4f3bf546572147c3abe4522189e86ce6, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.179229 11107 raft_consensus.cc:2749] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:12:15.179970 11142 leader_election.cc:290] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.184296  5567 leader_election.cc:336] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:15.185063  5568 leader_election.cc:336] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:15.185490  5568 leader_election.cc:304] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.186177 11142 raft_consensus.cc:2749] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:15.219293  3725 tablet_server.cc:179] TabletServer@127.3.163.68:0 shutting down...
I20260709 12:12:15.227372 11142 raft_consensus.cc:493] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader baa50eb5ed704004b7f391934a59d010)
I20260709 12:12:15.227955 11142 raft_consensus.cc:515] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8de40fe2bb814adcbe13958669063dc9" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43473 } } peers { permanent_uuid: "baa50eb5ed704004b7f391934a59d010" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 40575 } } peers { permanent_uuid: "ab9da67236874634be59ebfd05b18255" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 44297 } attrs { promote: false } }
I20260709 12:12:15.230404 11142 leader_election.cc:290] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473), baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575)
W20260709 12:12:15.234956  5567 leader_election.cc:336] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111)
W20260709 12:12:15.236935  5568 leader_election.cc:336] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer baa50eb5ed704004b7f391934a59d010 (127.3.163.67:40575): Network error: Client connection negotiation failed: client connection to 127.3.163.67:40575: connect: Connection refused (error 111)
I20260709 12:12:15.237565  5568 leader_election.cc:304] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab9da67236874634be59ebfd05b18255; no voters: 8de40fe2bb814adcbe13958669063dc9, baa50eb5ed704004b7f391934a59d010
I20260709 12:12:15.238723 11107 raft_consensus.cc:2749] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.279353  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:15.280449  3725 tablet_replica.cc:333] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.281507  3725 raft_consensus.cc:2243] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.282648  3725 raft_consensus.cc:2272] T 9752c5a68f0f415b848ef1da168f8d82 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.285535  3725 tablet_replica.cc:333] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.286440  3725 raft_consensus.cc:2243] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.287444  3725 raft_consensus.cc:2272] T 6ea0cbe752f64a3cb8e0ca3a9a520c60 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.289822  3725 tablet_replica.cc:333] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.290624  3725 raft_consensus.cc:2243] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.291401  3725 raft_consensus.cc:2272] T 950c0e5da47a49abb359c63b8483f487 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.293566  3725 tablet_replica.cc:333] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.294327  3725 raft_consensus.cc:2243] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.295264  3725 raft_consensus.cc:2272] T b626d6ae78534a64a64c129ed023c901 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:15.297158  5567 consensus_peers.cc:597] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:15.297977  3725 tablet_replica.cc:333] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.298666  3725 raft_consensus.cc:2243] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.299052  3725 raft_consensus.cc:2272] T 2f74ad2f73ca4aeda444924811dca81b P ab9da67236874634be59ebfd05b18255 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.301095  3725 tablet_replica.cc:333] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.301833  3725 raft_consensus.cc:2243] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.302706  3725 raft_consensus.cc:2272] T 3994e4d9351c414cb95b2a6e7bd76142 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.304993  3725 tablet_replica.cc:333] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.305549  3725 raft_consensus.cc:2243] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.305979  3725 raft_consensus.cc:2272] T 66c02d3930da4dfba1f61356e4562709 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.308111  3725 tablet_replica.cc:333] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.308791  3725 raft_consensus.cc:2243] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.309434  3725 raft_consensus.cc:2272] T 93239e0814394381aa73ef05e3ce06f0 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.312012  3725 tablet_replica.cc:333] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
W20260709 12:12:15.312390  5567 consensus_peers.cc:597] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 -> Peer 8de40fe2bb814adcbe13958669063dc9 (127.3.163.66:43473): Couldn't send request to peer 8de40fe2bb814adcbe13958669063dc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:15.312780  3725 raft_consensus.cc:2243] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.313336  3725 raft_consensus.cc:2272] T 008a4803b16b4c108fa5d52753a9f9a3 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.315474  3725 tablet_replica.cc:333] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.316004  3725 raft_consensus.cc:2243] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.316780  3725 raft_consensus.cc:2272] T 4be803cbf3854da89561de85968acd64 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.318919  3725 tablet_replica.cc:333] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.319468  3725 raft_consensus.cc:2243] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.319952  3725 raft_consensus.cc:2272] T acd2c2ca421a4b8e9629cd5b12e89e72 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.322013  3725 tablet_replica.cc:333] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.322557  3725 raft_consensus.cc:2243] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.323089  3725 raft_consensus.cc:2272] T 36177f71106c42f98afc1b375e5f6838 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.325050  3725 tablet_replica.cc:333] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.325599  3725 raft_consensus.cc:2243] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.326540  3725 raft_consensus.cc:2272] T fedd910b0097474d987abca8337e4e48 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.328536  3725 tablet_replica.cc:333] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.329061  3725 raft_consensus.cc:2243] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.329540  3725 raft_consensus.cc:2272] T 3271fdf9e70240dc96def0f272e84933 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.331550  3725 tablet_replica.cc:333] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.332086  3725 raft_consensus.cc:2243] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.332855  3725 raft_consensus.cc:2272] T 7bdc8c4ad3594326a9fe9ab6fdc2974d P ab9da67236874634be59ebfd05b18255 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.334705  3725 tablet_replica.cc:333] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.335193  3725 raft_consensus.cc:2243] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.335619  3725 raft_consensus.cc:2272] T 811353fb6b174f3e96608844f05794de P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.337558  3725 tablet_replica.cc:333] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.338059  3725 raft_consensus.cc:2243] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.338680  3725 raft_consensus.cc:2272] T 3805e1c03edc45ed8a91427825b04e2e P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.340893  3725 tablet_replica.cc:333] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.341403  3725 raft_consensus.cc:2243] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.342126  3725 raft_consensus.cc:2272] T e66df43bc3234fd5b769c5dc5afc1096 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.344039  3725 tablet_replica.cc:333] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.344550  3725 raft_consensus.cc:2243] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.345361  3725 raft_consensus.cc:2272] T 951f0af961a844849af172b241003482 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.347417  3725 tablet_replica.cc:333] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.347910  3725 raft_consensus.cc:2243] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.348373  3725 raft_consensus.cc:2272] T 6f4e29d1896a40e18a1e129dfc2a01c4 P ab9da67236874634be59ebfd05b18255 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.350204  3725 tablet_replica.cc:333] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.350672  3725 raft_consensus.cc:2243] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.351162  3725 raft_consensus.cc:2272] T 694e27a66efd449e81ce6297d4201cc3 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.352885  3725 tablet_replica.cc:333] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.353338  3725 raft_consensus.cc:2243] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.354033  3725 raft_consensus.cc:2272] T 737cb737da3146798e07c2c2026eebcc P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.355921  3725 tablet_replica.cc:333] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.356541  3725 raft_consensus.cc:2243] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.357563  3725 raft_consensus.cc:2272] T 184edf8541a448c78939e0c2fd55ae1f P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.360246  3725 tablet_replica.cc:333] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.361019  3725 raft_consensus.cc:2243] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:15.361595  5570 consensus_peers.cc:597] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 -> Peer 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): Couldn't send request to peer 4f3bf546572147c3abe4522189e86ce6. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:12:15.361675  3725 raft_consensus.cc:2272] T 7d62e31abaf34e25ad480865e4285e64 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.364243  3725 tablet_replica.cc:333] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.364840  3725 raft_consensus.cc:2243] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.365563  3725 raft_consensus.cc:2272] T da27e3db08424ba7a8f3d771f12de9a7 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.367587  3725 tablet_replica.cc:333] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.368119  3725 raft_consensus.cc:2243] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.368907  3725 raft_consensus.cc:2272] T 83dd0599104f4ef0a0f49401f0f0687c P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.370824  3725 tablet_replica.cc:333] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.371300  3725 raft_consensus.cc:2243] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.371737  3725 raft_consensus.cc:2272] T 2004e797943d48d0ab1d7ed726902783 P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.373589  3725 tablet_replica.cc:333] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.374074  3725 raft_consensus.cc:2243] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.374799  3725 raft_consensus.cc:2272] T c3ea9d9171fa428195bc085a20e92e3a P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.376888  3725 tablet_replica.cc:333] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.377393  3725 raft_consensus.cc:2243] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.378137  3725 raft_consensus.cc:2272] T 968e3c47814549fe8cf64abe52c00d29 P ab9da67236874634be59ebfd05b18255 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.380025  3725 tablet_replica.cc:333] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.380529  3725 raft_consensus.cc:2243] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.381009  3725 raft_consensus.cc:2272] T 88f88700ce294dc2bbfa0b1c51666ce7 P ab9da67236874634be59ebfd05b18255 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.382892  3725 tablet_replica.cc:333] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.383364  3725 raft_consensus.cc:2243] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.383776  3725 raft_consensus.cc:2272] T cd5508a3d98b403c8be99338c7e12502 P ab9da67236874634be59ebfd05b18255 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.385637  3725 tablet_replica.cc:333] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.386108  3725 raft_consensus.cc:2243] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.386803  3725 raft_consensus.cc:2272] T b0ae020fc77f442c9f248fa0f3e45fe4 P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.388733  3725 tablet_replica.cc:333] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.389341  3725 raft_consensus.cc:2243] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.389801  3725 raft_consensus.cc:2272] T 3da8832a07224abb9a1f8815f3dcd745 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.391889  3725 tablet_replica.cc:333] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.392412  3725 raft_consensus.cc:2243] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.392828  3725 raft_consensus.cc:2272] T 7d89e729329948059879ed6f44a07690 P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.394851  3725 tablet_replica.cc:333] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.395366  3725 raft_consensus.cc:2243] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.395751  3725 raft_consensus.cc:2272] T b33c26da92464c7896c3c4d2243075e8 P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.397631  3725 tablet_replica.cc:333] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.398102  3725 raft_consensus.cc:2243] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.398878  3725 raft_consensus.cc:2272] T b3b5f40fd4fa49619588c424099a9a3b P ab9da67236874634be59ebfd05b18255 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.400945  3725 tablet_replica.cc:333] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.401419  3725 raft_consensus.cc:2243] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.401830  3725 raft_consensus.cc:2272] T 15263062183540bdbd45628b3342a3d5 P ab9da67236874634be59ebfd05b18255 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.403733  3725 tablet_replica.cc:333] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.404198  3725 raft_consensus.cc:2243] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.404707  3725 raft_consensus.cc:2272] T 0e7b07518a00402aaa235a0d34263b1f P ab9da67236874634be59ebfd05b18255 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.406692  3725 tablet_replica.cc:333] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.407119  3725 raft_consensus.cc:2243] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.407801  3725 raft_consensus.cc:2272] T 97f05b369a3a4067afed9c87ba39f448 P ab9da67236874634be59ebfd05b18255 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.409830  3725 tablet_replica.cc:333] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.410305  3725 raft_consensus.cc:2243] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.411093  3725 raft_consensus.cc:2272] T 1fb0f431b68a4f78a03a58597b9cc66a P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.412997  3725 tablet_replica.cc:333] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.413450  3725 raft_consensus.cc:2243] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.413877  3725 raft_consensus.cc:2272] T 1f8b0320f7e94e2688e2a1d2005746ef P ab9da67236874634be59ebfd05b18255 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.415699  3725 tablet_replica.cc:333] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.416106  3725 raft_consensus.cc:2243] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.416528  3725 raft_consensus.cc:2272] T 7da05b23b88546d1b3a9c8ec5ec7bb26 P ab9da67236874634be59ebfd05b18255 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.418179  3725 tablet_replica.cc:333] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.418620  3725 raft_consensus.cc:2243] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.419296  3725 raft_consensus.cc:2272] T ee4c2e710f7a41958315091dfd907d8d P ab9da67236874634be59ebfd05b18255 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.421200  3725 tablet_replica.cc:333] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255: stopping tablet replica
I20260709 12:12:15.421628  3725 raft_consensus.cc:2243] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.422297  3725 raft_consensus.cc:2272] T 49d7b189f495402dbbaadba00a5cebb8 P ab9da67236874634be59ebfd05b18255 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.740397  3725 tablet_server.cc:196] TabletServer@127.3.163.68:0 shutdown complete.
W20260709 12:12:15.807857  4761 catalog_manager.cc:4755] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:15.814270  3725 master.cc:562] Master@127.3.163.126:34023 shutting down...
W20260709 12:12:15.844612  4822 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:12:15.844913  4822 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:12:15.845108  4822 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:12:24.032436  4761 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111) [suppressed 571 similar messages]
W20260709 12:12:24.035636  4761 catalog_manager.cc:4755] TS 4f3bf546572147c3abe4522189e86ce6 (127.3.163.65:38799): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7bdc8c4ad3594326a9fe9ab6fdc2974d: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38799: connect: Connection refused (error 111)
I20260709 12:12:24.572597  3725 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:24.573534  3725 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:24.573869  3725 tablet_replica.cc:333] T 00000000000000000000000000000000 P ed86163b2a3e48d0879181588237bafe: stopping tablet replica
I20260709 12:12:24.795068  3725 master.cc:584] Master@127.3.163.126:34023 shutdown complete.
I20260709 12:12:24.840867  3725 test_util.cc:182] -----------------------------------------------
I20260709 12:12:24.841070  3725 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598894987430-3725-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (190641 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:12:24.844187  3725 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.163.126:38385
I20260709 12:12:24.845283  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:24.850478 11152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:24.851137 11154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:24.850394 11151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:24.852239  3725 server_base.cc:1061] running on GCE node
I20260709 12:12:24.854913  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:24.855088  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:24.855195  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599144855184 us; error 0 us; skew 500 ppm
I20260709 12:12:24.855624  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:24.858191  3725 webserver.cc:533] Webserver started at http://127.3.163.126:36497/ using document root <none> and password file <none>
I20260709 12:12:24.858655  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:24.858824  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:24.859069  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:24.860292  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/master-0-root/instance:
uuid: "1cb74fc28c97463e95847b18a6808a69"
format_stamp: "Formatted at 2026-07-09 12:12:24 on dist-test-slave-s43n"
I20260709 12:12:24.864377  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:12:24.867404 11159 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:24.868033  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:24.868288  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/master-0-root
uuid: "1cb74fc28c97463e95847b18a6808a69"
format_stamp: "Formatted at 2026-07-09 12:12:24 on dist-test-slave-s43n"
I20260709 12:12:24.868527  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:24.882798  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:24.883894  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:24.919924  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.126:38385
I20260709 12:12:24.920022 11210 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.126:38385 every 8 connection(s)
I20260709 12:12:24.923836 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:24.934655 11211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69: Bootstrap starting.
I20260709 12:12:24.939205 11211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:24.943001 11211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69: No bootstrap required, opened a new log
I20260709 12:12:24.945065 11211 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb74fc28c97463e95847b18a6808a69" member_type: VOTER }
I20260709 12:12:24.945472 11211 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:24.945675 11211 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb74fc28c97463e95847b18a6808a69, State: Initialized, Role: FOLLOWER
I20260709 12:12:24.946259 11211 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb74fc28c97463e95847b18a6808a69" member_type: VOTER }
I20260709 12:12:24.946703 11211 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:24.946909 11211 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:24.947167 11211 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:24.951210 11211 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb74fc28c97463e95847b18a6808a69" member_type: VOTER }
I20260709 12:12:24.951669 11211 leader_election.cc:304] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cb74fc28c97463e95847b18a6808a69; no voters: 
I20260709 12:12:24.952677 11211 leader_election.cc:290] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:24.953037 11214 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:24.954294 11214 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 1 LEADER]: Becoming Leader. State: Replica: 1cb74fc28c97463e95847b18a6808a69, State: Running, Role: LEADER
I20260709 12:12:24.954960 11214 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb74fc28c97463e95847b18a6808a69" member_type: VOTER }
I20260709 12:12:24.955430 11211 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:24.961200 11216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cb74fc28c97463e95847b18a6808a69. Latest consensus state: current_term: 1 leader_uuid: "1cb74fc28c97463e95847b18a6808a69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb74fc28c97463e95847b18a6808a69" member_type: VOTER } }
I20260709 12:12:24.961313 11215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1cb74fc28c97463e95847b18a6808a69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb74fc28c97463e95847b18a6808a69" member_type: VOTER } }
I20260709 12:12:24.961839 11215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:24.961815 11216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:24.963785 11222 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:24.969362 11222 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:24.970937  3725 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:24.977627 11222 catalog_manager.cc:1383] Generated new cluster ID: d15d009aa0d045599c704b466c762250
I20260709 12:12:24.977871 11222 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:25.000919 11222 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:25.002005 11222 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:25.013594 11222 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69: Generated new TSK 0
I20260709 12:12:25.014063 11222 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:25.036795  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:25.042388 11232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.043165 11233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.045365 11235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.045814  3725 server_base.cc:1061] running on GCE node
I20260709 12:12:25.047753  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:25.047926  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:25.048044  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599145048034 us; error 0 us; skew 500 ppm
I20260709 12:12:25.048520  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:25.050518  3725 webserver.cc:533] Webserver started at http://127.3.163.65:34417/ using document root <none> and password file <none>
I20260709 12:12:25.050943  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:25.051088  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:25.051275  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:25.052322  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/instance:
uuid: "8cd91ce67df74245a4fcfd0c7c799002"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:25.056314  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:25.059298 11240 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.059937  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:25.060177  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "8cd91ce67df74245a4fcfd0c7c799002"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:25.060423  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:25.087260  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:25.088301  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:25.089613  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:25.091660  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:25.091825  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.092041  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:25.092190  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.130293  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:32937
I20260709 12:12:25.130429 11302 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:32937 every 8 connection(s)
I20260709 12:12:25.137493  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:25.145291 11308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.145821 11307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.151089 11310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.152082  3725 server_base.cc:1061] running on GCE node
I20260709 12:12:25.154064  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:25.154268  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:25.154438  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599145154421 us; error 0 us; skew 500 ppm
I20260709 12:12:25.154973  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:25.157315 11303 heartbeater.cc:344] Connected to a master server at 127.3.163.126:38385
I20260709 12:12:25.157495  3725 webserver.cc:533] Webserver started at http://127.3.163.66:38491/ using document root <none> and password file <none>
I20260709 12:12:25.157682 11303 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:25.158063  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:25.158277  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:25.158468 11303 heartbeater.cc:507] Master 127.3.163.126:38385 requested a full tablet report, sending...
I20260709 12:12:25.158537  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:25.160043  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/instance:
uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:25.160578 11176 ts_manager.cc:194] Registered new tserver with Master: 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:25.163093 11176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59560
I20260709 12:12:25.165639  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:12:25.168958 11315 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.169684  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:25.169958  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-1-root
uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:25.170193  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:25.183076  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:25.184157  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:25.185491  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:25.187484  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:25.187661  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.187870  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:25.188012  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.225194  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.66:46063
I20260709 12:12:25.225301 11377 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.66:46063 every 8 connection(s)
I20260709 12:12:25.229776  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:25.236404 11381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.237584 11382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.239249 11384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.240137  3725 server_base.cc:1061] running on GCE node
I20260709 12:12:25.240996  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:25.241202  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:25.241377  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599145241359 us; error 0 us; skew 500 ppm
I20260709 12:12:25.241459 11378 heartbeater.cc:344] Connected to a master server at 127.3.163.126:38385
I20260709 12:12:25.241856 11378 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:25.242139  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:25.242681 11378 heartbeater.cc:507] Master 127.3.163.126:38385 requested a full tablet report, sending...
I20260709 12:12:25.244560  3725 webserver.cc:533] Webserver started at http://127.3.163.67:34975/ using document root <none> and password file <none>
I20260709 12:12:25.244881 11176 ts_manager.cc:194] Registered new tserver with Master: 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:25.245217  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:25.245501  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:25.245801  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:25.246657 11176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59566
I20260709 12:12:25.247298  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/instance:
uuid: "20c40041a85147a0bc5000c1aa44343e"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:25.251888  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:25.254925 11389 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.255558  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:12:25.255816  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-2-root
uuid: "20c40041a85147a0bc5000c1aa44343e"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:25.256072  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:25.268273  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:25.269357  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:25.270694  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:25.272701  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:25.272919  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.273137  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:25.273275  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.311347  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.67:35889
I20260709 12:12:25.311443 11451 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.67:35889 every 8 connection(s)
I20260709 12:12:25.315956  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:25.321904 11455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:25.322614 11456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.326011  3725 server_base.cc:1061] running on GCE node
W20260709 12:12:25.326449 11458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:25.327325 11452 heartbeater.cc:344] Connected to a master server at 127.3.163.126:38385
I20260709 12:12:25.327446  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:25.327661 11452 heartbeater.cc:461] Registering TS with master...
W20260709 12:12:25.327766  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:25.328033  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599145328018 us; error 0 us; skew 500 ppm
I20260709 12:12:25.328495 11452 heartbeater.cc:507] Master 127.3.163.126:38385 requested a full tablet report, sending...
I20260709 12:12:25.328600  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:25.330474 11176 ts_manager.cc:194] Registered new tserver with Master: 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:25.330955  3725 webserver.cc:533] Webserver started at http://127.3.163.68:41669/ using document root <none> and password file <none>
I20260709 12:12:25.331439  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:25.331611  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:25.331852  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:25.331851 11176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59572
I20260709 12:12:25.333386  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-3-root/instance:
uuid: "8b6d95e83cd149f88775563c5514ba28"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:25.337515  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:25.340533 11463 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.341205  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:25.341461  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-3-root
uuid: "8b6d95e83cd149f88775563c5514ba28"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:25.341714  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:25.361179  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:25.362352  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:25.363701  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:25.365875  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:25.366101  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.366335  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:25.366488  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:25.405450  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.68:34547
I20260709 12:12:25.405541 11525 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.68:34547 every 8 connection(s)
I20260709 12:12:25.418176 11526 heartbeater.cc:344] Connected to a master server at 127.3.163.126:38385
I20260709 12:12:25.418545 11526 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:25.419234 11526 heartbeater.cc:507] Master 127.3.163.126:38385 requested a full tablet report, sending...
I20260709 12:12:25.420964 11176 ts_manager.cc:194] Registered new tserver with Master: 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:25.421893  3725 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013369537s
I20260709 12:12:25.422271 11176 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59582
I20260709 12:12:25.445876 11176 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59592:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:12:25.659862 11343 tablet_service.cc:1511] Processing CreateTablet for tablet e2512ccc1e8f45bab654f70492174d5e (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:25.661283 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2512ccc1e8f45bab654f70492174d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.662427 11342 tablet_service.cc:1511] Processing CreateTablet for tablet efc1dc6f02704e20829bc173c24d3725 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:25.663873 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc1dc6f02704e20829bc173c24d3725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.684437 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1d4b7cb4344bdc8344faf45dc2167f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:25.685833 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1d4b7cb4344bdc8344faf45dc2167f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.689713 11542 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:25.692988 11268 tablet_service.cc:1511] Processing CreateTablet for tablet e2512ccc1e8f45bab654f70492174d5e (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:25.693747 11266 tablet_service.cc:1511] Processing CreateTablet for tablet 8d75399439f14d43b801446067d46c8a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:25.694341 11268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2512ccc1e8f45bab654f70492174d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.695045 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d75399439f14d43b801446067d46c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.696084 11340 tablet_service.cc:1511] Processing CreateTablet for tablet 904deb919d4b42b290b40955d7eb0154 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:25.697424 11340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904deb919d4b42b290b40955d7eb0154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.698432 11265 tablet_service.cc:1511] Processing CreateTablet for tablet 904deb919d4b42b290b40955d7eb0154 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:25.699774 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904deb919d4b42b290b40955d7eb0154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.701581 11339 tablet_service.cc:1511] Processing CreateTablet for tablet 079d6cbc93b340bfb2dd2022db8bc00d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:25.696022 11267 tablet_service.cc:1511] Processing CreateTablet for tablet efc1dc6f02704e20829bc173c24d3725 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:25.702422 11264 tablet_service.cc:1511] Processing CreateTablet for tablet 079d6cbc93b340bfb2dd2022db8bc00d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:25.703454 11267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc1dc6f02704e20829bc173c24d3725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.702906 11339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079d6cbc93b340bfb2dd2022db8bc00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.705475 11264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079d6cbc93b340bfb2dd2022db8bc00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.709806 11338 tablet_service.cc:1511] Processing CreateTablet for tablet c614ce4bca814377bb079b966180edce (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:25.711122 11338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c614ce4bca814377bb079b966180edce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.714360 11263 tablet_service.cc:1511] Processing CreateTablet for tablet 10568811bd7a4972a6452da865f47f6c (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:25.715695 11263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10568811bd7a4972a6452da865f47f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.716265 11337 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc72ff56ccb4ae79079d36d4b125e0b (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:25.717564 11337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc72ff56ccb4ae79079d36d4b125e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.722329 11262 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc72ff56ccb4ae79079d36d4b125e0b (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:25.723621 11262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc72ff56ccb4ae79079d36d4b125e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.723344 11336 tablet_service.cc:1511] Processing CreateTablet for tablet 79fb7dfa5c3a47e4a1d57acd13660e0d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:25.724666 11336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fb7dfa5c3a47e4a1d57acd13660e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.729861 11542 tablet_bootstrap.cc:654] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:25.730737 11261 tablet_service.cc:1511] Processing CreateTablet for tablet 79fb7dfa5c3a47e4a1d57acd13660e0d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:25.732045 11261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fb7dfa5c3a47e4a1d57acd13660e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.731930 11260 tablet_service.cc:1511] Processing CreateTablet for tablet d0d5bebe45ea4b57b7ace8bb13073461 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:25.733461 11260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d5bebe45ea4b57b7ace8bb13073461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.738034 11259 tablet_service.cc:1511] Processing CreateTablet for tablet 92e0cc76fe3c414896806d01bdc14d60 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:25.739293 11259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e0cc76fe3c414896806d01bdc14d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.730707 11342 tablet_service.cc:1511] Processing CreateTablet for tablet e399427af66e44d79c315f13efd5c353 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:25.742414 11335 tablet_service.cc:1511] Processing CreateTablet for tablet 92e0cc76fe3c414896806d01bdc14d60 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:25.749576 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e0cc76fe3c414896806d01bdc14d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.760243 11343 tablet_service.cc:1511] Processing CreateTablet for tablet e41052c070b94d9eb8b24b2b57890c0a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:25.761579 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41052c070b94d9eb8b24b2b57890c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.766994 11416 tablet_service.cc:1511] Processing CreateTablet for tablet 8d75399439f14d43b801446067d46c8a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:25.767634 11417 tablet_service.cc:1511] Processing CreateTablet for tablet e2512ccc1e8f45bab654f70492174d5e (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:25.768369 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d75399439f14d43b801446067d46c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.769914 11415 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1d4b7cb4344bdc8344faf45dc2167f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:25.770802 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 8d75399439f14d43b801446067d46c8a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:25.772125 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d75399439f14d43b801446067d46c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.774168 11414 tablet_service.cc:1511] Processing CreateTablet for tablet 904deb919d4b42b290b40955d7eb0154 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:25.774358 11411 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc72ff56ccb4ae79079d36d4b125e0b (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:25.776361 11491 tablet_service.cc:1511] Processing CreateTablet for tablet efc1dc6f02704e20829bc173c24d3725 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:25.777729 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc1dc6f02704e20829bc173c24d3725. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.778368 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1d4b7cb4344bdc8344faf45dc2167f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:25.779644 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1d4b7cb4344bdc8344faf45dc2167f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.769914 11412 tablet_service.cc:1511] Processing CreateTablet for tablet c614ce4bca814377bb079b966180edce (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:25.772570 11413 tablet_service.cc:1511] Processing CreateTablet for tablet 10568811bd7a4972a6452da865f47f6c (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:25.776502 11410 tablet_service.cc:1511] Processing CreateTablet for tablet d0d5bebe45ea4b57b7ace8bb13073461 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:25.782053 11409 tablet_service.cc:1511] Processing CreateTablet for tablet e399427af66e44d79c315f13efd5c353 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:25.771191 11415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1d4b7cb4344bdc8344faf45dc2167f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.788493 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2512ccc1e8f45bab654f70492174d5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.789112 11414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904deb919d4b42b290b40955d7eb0154. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.790936 11411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc72ff56ccb4ae79079d36d4b125e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.792006 11413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10568811bd7a4972a6452da865f47f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.797106 11409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e399427af66e44d79c315f13efd5c353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.798326 11408 tablet_service.cc:1511] Processing CreateTablet for tablet 92e0cc76fe3c414896806d01bdc14d60 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:25.799628 11408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e0cc76fe3c414896806d01bdc14d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.802255 11412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c614ce4bca814377bb079b966180edce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.802543 11483 tablet_service.cc:1511] Processing CreateTablet for tablet e399427af66e44d79c315f13efd5c353 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:25.803846 11483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e399427af66e44d79c315f13efd5c353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.808269 11484 tablet_service.cc:1511] Processing CreateTablet for tablet d0d5bebe45ea4b57b7ace8bb13073461 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:25.809291 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e399427af66e44d79c315f13efd5c353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.809553 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d5bebe45ea4b57b7ace8bb13073461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.810670 11265 tablet_service.cc:1511] Processing CreateTablet for tablet e41052c070b94d9eb8b24b2b57890c0a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:25.811880 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41052c070b94d9eb8b24b2b57890c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.813833 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 10568811bd7a4972a6452da865f47f6c (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:25.815168 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10568811bd7a4972a6452da865f47f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.817838 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 079d6cbc93b340bfb2dd2022db8bc00d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:25.819114 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 079d6cbc93b340bfb2dd2022db8bc00d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.833832 11486 tablet_service.cc:1511] Processing CreateTablet for tablet c614ce4bca814377bb079b966180edce (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:25.835186 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c614ce4bca814377bb079b966180edce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.837937 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 79fb7dfa5c3a47e4a1d57acd13660e0d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:25.839318 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fb7dfa5c3a47e4a1d57acd13660e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.849325 11410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d5bebe45ea4b57b7ace8bb13073461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.875288 11544 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:25.875131 11489 tablet_service.cc:1511] Processing CreateTablet for tablet e41052c070b94d9eb8b24b2b57890c0a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:25.876366 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41052c070b94d9eb8b24b2b57890c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.886914 11482 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcf2221d70d421fa3aa00ebd33d3a58 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:25.888265 11482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcf2221d70d421fa3aa00ebd33d3a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.902379 11542 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:25.902907 11542 ts_tablet_manager.cc:1403] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.214s	user 0.011s	sys 0.017s
I20260709 12:12:25.905396 11544 tablet_bootstrap.cc:654] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:25.937464 11545 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:25.942498 11546 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:25.948236 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 7db72482cd1247f689e8f82c76c75e27 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:25.949579 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db72482cd1247f689e8f82c76c75e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.949689 11416 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcf2221d70d421fa3aa00ebd33d3a58 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:25.950899 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcf2221d70d421fa3aa00ebd33d3a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.953910 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 7db72482cd1247f689e8f82c76c75e27 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:25.955122 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db72482cd1247f689e8f82c76c75e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.960379 11266 tablet_service.cc:1511] Processing CreateTablet for tablet 91bec71eba2d41c6929bdff648f3d1a0 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:25.961660 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bec71eba2d41c6929bdff648f3d1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:25.962622 11339 tablet_service.cc:1511] Processing CreateTablet for tablet 91bec71eba2d41c6929bdff648f3d1a0 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:25.961685 11267 tablet_service.cc:1511] Processing CreateTablet for tablet 6fcf2221d70d421fa3aa00ebd33d3a58 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:25.964463 11267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fcf2221d70d421fa3aa00ebd33d3a58. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:25.967681 11224 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:26.034128 11546 tablet_bootstrap.cc:654] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.034390 11542 raft_consensus.cc:359] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.035267 11544 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:26.035794 11544 ts_tablet_manager.cc:1403] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.161s	user 0.019s	sys 0.017s
I20260709 12:12:26.036126 11545 tablet_bootstrap.cc:654] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.038939 11544 raft_consensus.cc:359] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.040184 11417 tablet_service.cc:1511] Processing CreateTablet for tablet 7db72482cd1247f689e8f82c76c75e27 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:26.061659 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db72482cd1247f689e8f82c76c75e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.062198 11266 tablet_service.cc:1511] Processing CreateTablet for tablet 79fff2a7419a4b29aa70e7b89e5d734f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:26.063607 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fff2a7419a4b29aa70e7b89e5d734f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.035218 11542 raft_consensus.cc:385] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.048095 11337 tablet_service.cc:1511] Processing CreateTablet for tablet 34c01bb891f44a2990eb8b9b41aa3e1a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:26.049620 11339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bec71eba2d41c6929bdff648f3d1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.070302 11337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c01bb891f44a2990eb8b9b41aa3e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.051244 11265 tablet_service.cc:1511] Processing CreateTablet for tablet 34c01bb891f44a2990eb8b9b41aa3e1a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:26.071226 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c01bb891f44a2990eb8b9b41aa3e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.072533 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 5963410c1ae543ee83abf42430c2ac10 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:26.049625 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 34c01bb891f44a2990eb8b9b41aa3e1a (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:26.053005 11412 tablet_service.cc:1511] Processing CreateTablet for tablet 79fff2a7419a4b29aa70e7b89e5d734f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:26.060084 11482 tablet_service.cc:1511] Processing CreateTablet for tablet 79fff2a7419a4b29aa70e7b89e5d734f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:26.069528 11544 raft_consensus.cc:385] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.050201 11414 tablet_service.cc:1511] Processing CreateTablet for tablet 91bec71eba2d41c6929bdff648f3d1a0 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:26.077505 11412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fff2a7419a4b29aa70e7b89e5d734f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.076293 11409 tablet_service.cc:1511] Processing CreateTablet for tablet 5963410c1ae543ee83abf42430c2ac10 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:26.079396 11409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5963410c1ae543ee83abf42430c2ac10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.077430 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c01bb891f44a2990eb8b9b41aa3e1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.077611 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 5963410c1ae543ee83abf42430c2ac10 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:26.081766 11414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91bec71eba2d41c6929bdff648f3d1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.083154 11259 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f0383cd364797b2fd1e3a1c3ce300 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:26.083918 11546 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:26.084398 11546 ts_tablet_manager.cc:1403] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.000s
I20260709 12:12:26.078265 11544 raft_consensus.cc:740] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.084478 11335 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f0383cd364797b2fd1e3a1c3ce300 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:26.084316 11259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f0383cd364797b2fd1e3a1c3ce300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.085544 11544 consensus_queue.cc:260] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.088272 11546 raft_consensus.cc:359] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.090449 11546 raft_consensus.cc:385] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.089039 11408 tablet_service.cc:1511] Processing CreateTablet for tablet 8e3f0383cd364797b2fd1e3a1c3ce300 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:26.089602 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0efa61df04448da748e040931fad71 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:26.091784 11546 raft_consensus.cc:740] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.093510 11408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f0383cd364797b2fd1e3a1c3ce300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.097115 11482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fff2a7419a4b29aa70e7b89e5d734f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.098315 11261 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0efa61df04448da748e040931fad71 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:26.098868 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0efa61df04448da748e040931fad71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.099478 11261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0efa61df04448da748e040931fad71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.101408 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5963410c1ae543ee83abf42430c2ac10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.080195 11542 raft_consensus.cc:740] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.107765 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e3f0383cd364797b2fd1e3a1c3ce300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.107573 11542 consensus_queue.cc:260] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.111766 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 9b0efa61df04448da748e040931fad71 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:26.118675 11410 tablet_service.cc:1511] Processing CreateTablet for tablet 9e553b4d23b3451ea8801cd6f0e0ab7f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:26.132581 11410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e553b4d23b3451ea8801cd6f0e0ab7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.134989 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5963410c1ae543ee83abf42430c2ac10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.105916 11546 consensus_queue.cc:260] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.138909 11303 heartbeater.cc:499] Master 127.3.163.126:38385 was elected leader, sending a full tablet report...
W20260709 12:12:26.139238 11304 tablet.cc:2406] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:26.138813 11544 ts_tablet_manager.cc:1434] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.103s	user 0.011s	sys 0.011s
I20260709 12:12:26.155084 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b0efa61df04448da748e040931fad71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.156468 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 9e553b4d23b3451ea8801cd6f0e0ab7f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:26.157227 11259 tablet_service.cc:1511] Processing CreateTablet for tablet 9e553b4d23b3451ea8801cd6f0e0ab7f (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:26.164968 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e553b4d23b3451ea8801cd6f0e0ab7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.170003 11544 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:26.173439 11259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e553b4d23b3451ea8801cd6f0e0ab7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.178869 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 64b54d6d44664c4a8f2fcc8d66288fe8 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:26.181166 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 64b54d6d44664c4a8f2fcc8d66288fe8 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:26.182044 11267 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddbedffb2a547f09b0683e1b8e90e69 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:26.183215 11267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddbedffb2a547f09b0683e1b8e90e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.183250 11417 tablet_service.cc:1511] Processing CreateTablet for tablet 64b54d6d44664c4a8f2fcc8d66288fe8 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:26.184635 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b54d6d44664c4a8f2fcc8d66288fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.182480 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b54d6d44664c4a8f2fcc8d66288fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.193475 11336 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddbedffb2a547f09b0683e1b8e90e69 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:26.194962 11542 ts_tablet_manager.cc:1434] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.292s	user 0.034s	sys 0.008s
I20260709 12:12:26.198362 11416 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddbedffb2a547f09b0683e1b8e90e69 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:26.201529 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddbedffb2a547f09b0683e1b8e90e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.208827 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b54d6d44664c4a8f2fcc8d66288fe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.210644 11545 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:26.211133 11545 ts_tablet_manager.cc:1403] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.274s	user 0.016s	sys 0.021s
I20260709 12:12:26.212967 11378 heartbeater.cc:499] Master 127.3.163.126:38385 was elected leader, sending a full tablet report...
I20260709 12:12:26.214485 11336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddbedffb2a547f09b0683e1b8e90e69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.222748 11545 raft_consensus.cc:359] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.229836 11545 raft_consensus.cc:385] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.230160 11545 raft_consensus.cc:740] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.224013 11552 raft_consensus.cc:493] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.224901 11452 heartbeater.cc:499] Master 127.3.163.126:38385 was elected leader, sending a full tablet report...
I20260709 12:12:26.230463 11265 tablet_service.cc:1511] Processing CreateTablet for tablet ad441508cb3d4912a21a23a55b982ae3 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:26.231660 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad441508cb3d4912a21a23a55b982ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.232072 11335 tablet_service.cc:1511] Processing CreateTablet for tablet ad441508cb3d4912a21a23a55b982ae3 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:26.233351 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad441508cb3d4912a21a23a55b982ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.234982 11552 raft_consensus.cc:515] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.246515 11552 leader_election.cc:290] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:26.247362 11542 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:26.247176 11545 consensus_queue.cc:260] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.227967 11544 tablet_bootstrap.cc:654] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.201426 11486 tablet_service.cc:1511] Processing CreateTablet for tablet ad441508cb3d4912a21a23a55b982ae3 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:26.269729 11546 ts_tablet_manager.cc:1434] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.185s	user 0.020s	sys 0.003s
I20260709 12:12:26.270906 11546 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:26.274259 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad441508cb3d4912a21a23a55b982ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.274515 11542 tablet_bootstrap.cc:654] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.281988 11546 tablet_bootstrap.cc:654] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.291721 11544 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:26.292253 11544 ts_tablet_manager.cc:1403] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.122s	user 0.008s	sys 0.003s
I20260709 12:12:26.257834 11412 tablet_service.cc:1511] Processing CreateTablet for tablet 893e5c43cf564bd59d9f25fa8f9f0fbf (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:26.307643 11412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893e5c43cf564bd59d9f25fa8f9f0fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.321903 11545 ts_tablet_manager.cc:1434] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.110s	user 0.017s	sys 0.018s
I20260709 12:12:26.322752 11526 heartbeater.cc:499] Master 127.3.163.126:38385 was elected leader, sending a full tablet report...
I20260709 12:12:26.326946 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 893e5c43cf564bd59d9f25fa8f9f0fbf (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:26.331440 11266 tablet_service.cc:1511] Processing CreateTablet for tablet 893e5c43cf564bd59d9f25fa8f9f0fbf (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:26.332662 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893e5c43cf564bd59d9f25fa8f9f0fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.340467 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 893e5c43cf564bd59d9f25fa8f9f0fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.345995 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc1dc6f02704e20829bc173c24d3725" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:26.346737 11278 raft_consensus.cc:2468] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:26.330345 11545 tablet_bootstrap.cc:492] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:26.350108 11542 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:26.355103 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc1dc6f02704e20829bc173c24d3725" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:26.328367 11544 raft_consensus.cc:359] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.362459 11416 tablet_service.cc:1511] Processing CreateTablet for tablet 8b687d036fd54d868cb28b2308d0d689 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:26.368752 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b687d036fd54d868cb28b2308d0d689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.369817 11545 tablet_bootstrap.cc:654] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.373677 11417 tablet_service.cc:1511] Processing CreateTablet for tablet 8b90ac113f32492b8af9dee4c36614cd (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:26.374891 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b90ac113f32492b8af9dee4c36614cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.379210 11544 raft_consensus.cc:385] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.379547 11544 raft_consensus.cc:740] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.380551 11553 raft_consensus.cc:493] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.380331 11544 consensus_queue.cc:260] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.380719 11486 tablet_service.cc:1511] Processing CreateTablet for tablet f6536bd733514fbb927281bf18c6fa23 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:26.381083 11553 raft_consensus.cc:515] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.382058 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6536bd733514fbb927281bf18c6fa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.382788 11542 ts_tablet_manager.cc:1403] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.011s
I20260709 12:12:26.385838 11542 raft_consensus.cc:359] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.386526 11542 raft_consensus.cc:385] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.386808 11542 raft_consensus.cc:740] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.387537 11542 consensus_queue.cc:260] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.362728 11335 tablet_service.cc:1511] Processing CreateTablet for tablet 8b90ac113f32492b8af9dee4c36614cd (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:26.361608 11318 leader_election.cc:304] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
W20260709 12:12:26.388878 11317 leader_election.cc:343] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.389350 11544 ts_tablet_manager.cc:1434] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.097s	user 0.010s	sys 0.000s
I20260709 12:12:26.390377 11544 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:26.391963 11266 tablet_service.cc:1511] Processing CreateTablet for tablet f6536bd733514fbb927281bf18c6fa23 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:26.392668 11545 tablet_bootstrap.cc:492] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:26.393268 11545 ts_tablet_manager.cc:1403] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.010s
I20260709 12:12:26.394807 11553 leader_election.cc:290] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:26.363675 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 8b90ac113f32492b8af9dee4c36614cd (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:26.396158 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b90ac113f32492b8af9dee4c36614cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.397342 11546 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:26.365903 11259 tablet_service.cc:1511] Processing CreateTablet for tablet 8b687d036fd54d868cb28b2308d0d689 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:26.389055 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b90ac113f32492b8af9dee4c36614cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.406188 11546 ts_tablet_manager.cc:1403] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.135s	user 0.022s	sys 0.008s
I20260709 12:12:26.406538 11551 raft_consensus.cc:2804] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.408759 11551 raft_consensus.cc:493] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.409140 11551 raft_consensus.cc:3060] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.404727 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 8b687d036fd54d868cb28b2308d0d689 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:26.410308 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b687d036fd54d868cb28b2308d0d689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.405728 11342 tablet_service.cc:1511] Processing CreateTablet for tablet f6536bd733514fbb927281bf18c6fa23 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:26.413506 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6536bd733514fbb927281bf18c6fa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.414100 11545 raft_consensus.cc:359] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.421644 11545 raft_consensus.cc:385] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.421998 11545 raft_consensus.cc:740] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.422788 11545 consensus_queue.cc:260] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.424024 11412 tablet_service.cc:1511] Processing CreateTablet for tablet 229f7766e18a403594735eac02aebb69 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:26.425289 11412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229f7766e18a403594735eac02aebb69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.417142 11546 raft_consensus.cc:359] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.393170 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6536bd733514fbb927281bf18c6fa23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.428149 11546 raft_consensus.cc:385] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.430974 11546 raft_consensus.cc:740] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.429764 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d75399439f14d43b801446067d46c8a" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:26.430383 11259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b687d036fd54d868cb28b2308d0d689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.427488 11552 raft_consensus.cc:493] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:26.432706 11392 leader_election.cc:343] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.433050 11552 raft_consensus.cc:515] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.431917 11545 ts_tablet_manager.cc:1434] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:12:26.433905 11546 consensus_queue.cc:260] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.432448 11551 raft_consensus.cc:515] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.437836 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:26.435441 11552 leader_election.cc:290] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:26.439730 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc1dc6f02704e20829bc173c24d3725" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
W20260709 12:12:26.441037 11317 leader_election.cc:343] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:26.441363 11318 leader_election.cc:343] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.440693 11265 tablet_service.cc:1511] Processing CreateTablet for tablet 229f7766e18a403594735eac02aebb69 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:26.442914 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229f7766e18a403594735eac02aebb69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.444063 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc1dc6f02704e20829bc173c24d3725" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:26.444633 11278 raft_consensus.cc:3060] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.435451 11545 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:26.447006 11551 leader_election.cc:290] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:26.442759 11542 ts_tablet_manager.cc:1434] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.004s
I20260709 12:12:26.451386 11278 raft_consensus.cc:2468] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:26.452466 11318 leader_election.cc:304] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:26.452019 11542 tablet_bootstrap.cc:492] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:26.456934 11551 raft_consensus.cc:2804] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.465092 11551 raft_consensus.cc:697] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:26.465889 11551 consensus_queue.cc:237] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.466230 11336 tablet_service.cc:1511] Processing CreateTablet for tablet f2299ef9f6f241bbbb8cb5faf9e7c384 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:26.467389 11336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2299ef9f6f241bbbb8cb5faf9e7c384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.469718 11488 tablet_service.cc:1511] Processing CreateTablet for tablet f2299ef9f6f241bbbb8cb5faf9e7c384 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:26.469862 11267 tablet_service.cc:1511] Processing CreateTablet for tablet c66055995f9841a4b9356659c6ff082c (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:26.470877 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2299ef9f6f241bbbb8cb5faf9e7c384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.471057 11267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66055995f9841a4b9356659c6ff082c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.458355 11546 ts_tablet_manager.cc:1434] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:12:26.473634 11546 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:26.474685 11416 tablet_service.cc:1511] Processing CreateTablet for tablet f2299ef9f6f241bbbb8cb5faf9e7c384 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:26.475407 11341 tablet_service.cc:1511] Processing CreateTablet for tablet c66055995f9841a4b9356659c6ff082c (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:26.476637 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66055995f9841a4b9356659c6ff082c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.477778 11550 raft_consensus.cc:493] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.478231 11550 raft_consensus.cc:515] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.479709 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 229f7766e18a403594735eac02aebb69 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:26.475875 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2299ef9f6f241bbbb8cb5faf9e7c384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.460165 11544 tablet_bootstrap.cc:654] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.451893 11545 tablet_bootstrap.cc:654] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.481520 11550 leader_election.cc:290] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:26.484447 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 229f7766e18a403594735eac02aebb69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.486339 11417 tablet_service.cc:1511] Processing CreateTablet for tablet c66055995f9841a4b9356659c6ff082c (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:26.502164 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66055995f9841a4b9356659c6ff082c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.514199 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 0a75c00695f64bd1bf842779b19211c0 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:26.515477 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a75c00695f64bd1bf842779b19211c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.518824 11546 tablet_bootstrap.cc:654] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.523590 11266 tablet_service.cc:1511] Processing CreateTablet for tablet 0a75c00695f64bd1bf842779b19211c0 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:26.524906 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a75c00695f64bd1bf842779b19211c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.529309 11542 tablet_bootstrap.cc:654] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.536888 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 0a75c00695f64bd1bf842779b19211c0 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:26.537220 11410 tablet_service.cc:1511] Processing CreateTablet for tablet c6743232edbd4f6997be3eb0f234a8b5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:26.537458 11489 tablet_service.cc:1511] Processing CreateTablet for tablet c6743232edbd4f6997be3eb0f234a8b5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:26.538143 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a75c00695f64bd1bf842779b19211c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.538396 11410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6743232edbd4f6997be3eb0f234a8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.538691 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6743232edbd4f6997be3eb0f234a8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.539762 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d75399439f14d43b801446067d46c8a" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:26.540378 11501 raft_consensus.cc:2468] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:26.541690 11391 leader_election.cc:304] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:26.546346 11553 raft_consensus.cc:2804] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.546705 11553 raft_consensus.cc:493] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.547027 11553 raft_consensus.cc:3060] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.555081 11553 raft_consensus.cc:515] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.556982 11553 leader_election.cc:290] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:26.557711 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d75399439f14d43b801446067d46c8a" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:26.558326 11501 raft_consensus.cc:3060] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.561672 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d75399439f14d43b801446067d46c8a" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:26.566366 11545 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:26.567056 11545 ts_tablet_manager.cc:1403] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.008s
I20260709 12:12:26.567582 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:26.568245 11427 raft_consensus.cc:2468] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
W20260709 12:12:26.569271 11392 leader_election.cc:343] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.568939 11174 catalog_manager.cc:5697] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:26.570298 11319 leader_election.cc:304] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:26.571508 11551 raft_consensus.cc:2804] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.571853 11551 raft_consensus.cc:493] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.572634 11551 raft_consensus.cc:3060] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.574909 11336 tablet_service.cc:1511] Processing CreateTablet for tablet 7f12446f58fb4e5a867bb73ea759e3cd (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:26.576179 11336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f12446f58fb4e5a867bb73ea759e3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.578895 11551 raft_consensus.cc:515] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.580449 11412 tablet_service.cc:1511] Processing CreateTablet for tablet 7f12446f58fb4e5a867bb73ea759e3cd (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:26.581498 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:26.581802 11412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f12446f58fb4e5a867bb73ea759e3cd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:26.589673 11318 leader_election.cc:343] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.589947 11551 leader_election.cc:290] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:26.573298 11545 raft_consensus.cc:359] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.590487 11545 raft_consensus.cc:385] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.590780 11545 raft_consensus.cc:740] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.591463 11545 consensus_queue.cc:260] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.595593 11545 ts_tablet_manager.cc:1434] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.003s
I20260709 12:12:26.596563 11545 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:26.591960 11259 tablet_service.cc:1511] Processing CreateTablet for tablet c6743232edbd4f6997be3eb0f234a8b5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:26.602730 11259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6743232edbd4f6997be3eb0f234a8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.604733 11542 tablet_bootstrap.cc:492] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:26.605237 11542 ts_tablet_manager.cc:1403] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.153s	user 0.006s	sys 0.010s
I20260709 12:12:26.608114 11542 raft_consensus.cc:359] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.608793 11542 raft_consensus.cc:385] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.609092 11542 raft_consensus.cc:740] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.609894 11542 consensus_queue.cc:260] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.612130 11542 ts_tablet_manager.cc:1434] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:26.613041 11542 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:26.617588 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904deb919d4b42b290b40955d7eb0154" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:26.619068 11542 tablet_bootstrap.cc:654] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.622704 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 7f12446f58fb4e5a867bb73ea759e3cd (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:26.623636 11265 tablet_service.cc:1511] Processing CreateTablet for tablet 64e5700fed174a83ac83c3d104965013 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:12:26.624672 11244 leader_election.cc:343] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.625001 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e5700fed174a83ac83c3d104965013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.623944 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:26.625511 11427 raft_consensus.cc:3060] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.629724 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 64e5700fed174a83ac83c3d104965013 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:26.630956 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e5700fed174a83ac83c3d104965013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.632282 11427 raft_consensus.cc:2468] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:26.633415 11319 leader_election.cc:304] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:26.634508 11551 raft_consensus.cc:2804] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.634959 11551 raft_consensus.cc:697] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:26.635705 11551 consensus_queue.cc:237] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.633638 11544 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:26.643064 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f12446f58fb4e5a867bb73ea759e3cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.644068 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904deb919d4b42b290b40955d7eb0154" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:26.645684 11241 leader_election.cc:343] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.646122 11241 leader_election.cc:304] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:26.647579 11550 raft_consensus.cc:2749] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.648202 11501 raft_consensus.cc:2468] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:26.649432 11544 ts_tablet_manager.cc:1403] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.259s	user 0.017s	sys 0.001s
I20260709 12:12:26.655108 11391 leader_election.cc:304] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:26.655932 11553 raft_consensus.cc:2804] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:26.657552 11410 tablet_service.cc:1511] Processing CreateTablet for tablet 64e5700fed174a83ac83c3d104965013 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:26.658782 11410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e5700fed174a83ac83c3d104965013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.662858 11486 tablet_service.cc:1511] Processing CreateTablet for tablet aab0de38956343e09d4f85cdd0797ead (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:26.667909 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab0de38956343e09d4f85cdd0797ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.670900 11546 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:26.671168 11266 tablet_service.cc:1511] Processing CreateTablet for tablet aab0de38956343e09d4f85cdd0797ead (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:26.680334 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab0de38956343e09d4f85cdd0797ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.681932 11545 tablet_bootstrap.cc:654] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.685195 11546 ts_tablet_manager.cc:1403] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.212s	user 0.018s	sys 0.043s
I20260709 12:12:26.686352 11542 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:26.686841 11542 ts_tablet_manager.cc:1403] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.074s	user 0.004s	sys 0.008s
I20260709 12:12:26.674116 11544 raft_consensus.cc:359] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.688575 11546 raft_consensus.cc:359] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.696352 11546 raft_consensus.cc:385] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.694707 11542 raft_consensus.cc:359] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.691742 11544 raft_consensus.cc:385] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.696699 11546 raft_consensus.cc:740] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.697000 11544 raft_consensus.cc:740] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.697916 11544 consensus_queue.cc:260] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.698262 11335 tablet_service.cc:1511] Processing CreateTablet for tablet aab0de38956343e09d4f85cdd0797ead (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:26.699448 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aab0de38956343e09d4f85cdd0797ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.700187 11542 raft_consensus.cc:385] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.700551 11542 raft_consensus.cc:740] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.702471 11544 ts_tablet_manager.cc:1434] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.004s
I20260709 12:12:26.701349 11542 consensus_queue.cc:260] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.708513 11544 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:26.716897 11267 tablet_service.cc:1511] Processing CreateTablet for tablet f5328e5b3864423ca644295147703ecb (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:26.718067 11267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5328e5b3864423ca644295147703ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.709020 11546 consensus_queue.cc:260] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.708568 11416 tablet_service.cc:1511] Processing CreateTablet for tablet f5328e5b3864423ca644295147703ecb (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:26.712522 11542 ts_tablet_manager.cc:1434] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 12:12:26.713496 11489 tablet_service.cc:1511] Processing CreateTablet for tablet f5328e5b3864423ca644295147703ecb (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:26.722715 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5328e5b3864423ca644295147703ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.726591 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5328e5b3864423ca644295147703ecb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.723583 11553 raft_consensus.cc:697] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:26.732612 11553 consensus_queue.cc:237] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.733935 11542 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:26.744414 11542 tablet_bootstrap.cc:654] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.749168 11417 tablet_service.cc:1511] Processing CreateTablet for tablet 6b43b6a73ce34d7297843d8f7ebc611e (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:26.750330 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b43b6a73ce34d7297843d8f7ebc611e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.751786 11545 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:26.752291 11545 ts_tablet_manager.cc:1403] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.156s	user 0.020s	sys 0.015s
I20260709 12:12:26.754325 11259 tablet_service.cc:1511] Processing CreateTablet for tablet 320ba867e2f0452ea522852c10247484 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:26.756295 11259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320ba867e2f0452ea522852c10247484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.756531 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 6b43b6a73ce34d7297843d8f7ebc611e (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:26.757802 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b43b6a73ce34d7297843d8f7ebc611e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.762727 11546 ts_tablet_manager.cc:1434] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.009s
I20260709 12:12:26.762872 11544 tablet_bootstrap.cc:654] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.763156 11336 tablet_service.cc:1511] Processing CreateTablet for tablet 320ba867e2f0452ea522852c10247484 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:26.763440 11545 raft_consensus.cc:359] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.764236 11545 raft_consensus.cc:385] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.764412 11336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320ba867e2f0452ea522852c10247484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.763733 11546 tablet_bootstrap.cc:492] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:26.766844 11555 raft_consensus.cc:493] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.767359 11555 raft_consensus.cc:515] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.770143 11555 leader_election.cc:290] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:26.774667 11545 raft_consensus.cc:740] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.775431 11545 consensus_queue.cc:260] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.782251 11555 raft_consensus.cc:493] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.782460 11416 tablet_service.cc:1511] Processing CreateTablet for tablet 320ba867e2f0452ea522852c10247484 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:26.788341 11542 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:26.784046 11545 ts_tablet_manager.cc:1434] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.005s
I20260709 12:12:26.782712 11555 raft_consensus.cc:515] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.793910 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320ba867e2f0452ea522852c10247484. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.794214 11542 ts_tablet_manager.cc:1403] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.005s
I20260709 12:12:26.798604 11545 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:26.804852 11544 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:26.805320 11544 ts_tablet_manager.cc:1403] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.010s
I20260709 12:12:26.806116 11555 leader_election.cc:290] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:26.807610 11266 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbf184e378748efab2caeabdb1d91b2 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:26.808082 11544 raft_consensus.cc:359] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.808827 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbf184e378748efab2caeabdb1d91b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.810218 11546 tablet_bootstrap.cc:654] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.808830 11544 raft_consensus.cc:385] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.810972 11544 raft_consensus.cc:740] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.811769 11544 consensus_queue.cc:260] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.812254 11412 tablet_service.cc:1511] Processing CreateTablet for tablet e0c6b4483ba043e6a4a5871e772e01ed (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:26.817005 11412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c6b4483ba043e6a4a5871e772e01ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.817421 11550 raft_consensus.cc:493] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.817860 11550 raft_consensus.cc:515] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.818255 11544 ts_tablet_manager.cc:1434] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:12:26.819236 11544 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:26.820135 11550 leader_election.cc:290] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:26.821236 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbf184e378748efab2caeabdb1d91b2 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:26.822438 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbf184e378748efab2caeabdb1d91b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.823695 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10568811bd7a4972a6452da865f47f6c" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:26.825348 11544 tablet_bootstrap.cc:654] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:26.826748 11244 leader_election.cc:343] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.826865 11265 tablet_service.cc:1511] Processing CreateTablet for tablet e0c6b4483ba043e6a4a5871e772e01ed (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:26.830279 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c6b4483ba043e6a4a5871e772e01ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.830749 11342 tablet_service.cc:1511] Processing CreateTablet for tablet ac6ca7e153ce4227bb8917fb38574ec5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:26.831996 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6ca7e153ce4227bb8917fb38574ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.843416 11545 tablet_bootstrap.cc:654] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.844188 11335 tablet_service.cc:1511] Processing CreateTablet for tablet 6b43b6a73ce34d7297843d8f7ebc611e (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:26.851312 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b43b6a73ce34d7297843d8f7ebc611e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.855299 11417 tablet_service.cc:1511] Processing CreateTablet for tablet ac6ca7e153ce4227bb8917fb38574ec5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:26.856498 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6ca7e153ce4227bb8917fb38574ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.862965 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 4bbf184e378748efab2caeabdb1d91b2 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:26.863451 11489 tablet_service.cc:1511] Processing CreateTablet for tablet e0c6b4483ba043e6a4a5871e772e01ed (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:26.864202 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bbf184e378748efab2caeabdb1d91b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.864779 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c6b4483ba043e6a4a5871e772e01ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.872390 11542 raft_consensus.cc:359] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.873730 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10568811bd7a4972a6452da865f47f6c" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:26.878377 11542 raft_consensus.cc:385] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:26.879177 11242 leader_election.cc:343] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.879650 11242 leader_election.cc:304] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:26.880740 11550 raft_consensus.cc:2749] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.886312 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:26.887622 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1d4b7cb4344bdc8344faf45dc2167f" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:26.889277 11464 leader_election.cc:343] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:26.889941 11464 leader_election.cc:343] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.894304 11546 tablet_bootstrap.cc:492] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:26.894855 11546 ts_tablet_manager.cc:1403] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.005s
I20260709 12:12:26.908110 11546 raft_consensus.cc:359] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.908869 11546 raft_consensus.cc:385] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.909160 11546 raft_consensus.cc:740] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.909423 11551 raft_consensus.cc:493] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.909898 11551 raft_consensus.cc:515] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.910019 11546 consensus_queue.cc:260] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.912034 11551 leader_election.cc:290] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:26.914072 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c614ce4bca814377bb079b966180edce" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
W20260709 12:12:26.915373 11317 leader_election.cc:343] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.895823 11542 raft_consensus.cc:740] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.914393 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c614ce4bca814377bb079b966180edce" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:26.916153 11427 raft_consensus.cc:2468] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:26.916288 11542 consensus_queue.cc:260] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.917268 11319 leader_election.cc:304] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:26.918260 11542 ts_tablet_manager.cc:1434] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.000s
I20260709 12:12:26.918527 11552 raft_consensus.cc:2804] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.918876 11552 raft_consensus.cc:493] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.919178 11552 raft_consensus.cc:3060] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.919257 11542 tablet_bootstrap.cc:492] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:26.919060 11546 ts_tablet_manager.cc:1434] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:12:26.922576 11546 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:26.925531 11486 tablet_service.cc:1511] Processing CreateTablet for tablet ac6ca7e153ce4227bb8917fb38574ec5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:26.932992 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac6ca7e153ce4227bb8917fb38574ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.927690 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 01c2239cec004da49f946e92b5d2ccf5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:26.926638 11265 tablet_service.cc:1511] Processing CreateTablet for tablet 01c2239cec004da49f946e92b5d2ccf5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:26.939306 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c2239cec004da49f946e92b5d2ccf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.942619 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c2239cec004da49f946e92b5d2ccf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.939199 11175 catalog_manager.cc:5697] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:26.947773 11546 tablet_bootstrap.cc:654] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.927448 11552 raft_consensus.cc:515] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:26.950757 11552 leader_election.cc:290] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:26.951746 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c614ce4bca814377bb079b966180edce" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:26.952297 11427 raft_consensus.cc:3060] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.955298 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1d4b7cb4344bdc8344faf45dc2167f" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
W20260709 12:12:26.956885 11467 leader_election.cc:343] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.957170 11553 raft_consensus.cc:493] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.957461 11467 leader_election.cc:304] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:26.958077 11553 raft_consensus.cc:515] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.958580 11586 raft_consensus.cc:2749] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.960232 11416 tablet_service.cc:1511] Processing CreateTablet for tablet 01c2239cec004da49f946e92b5d2ccf5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:26.960572 11553 leader_election.cc:290] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:26.961056 11545 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:26.961467 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c2239cec004da49f946e92b5d2ccf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.965189 11544 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:26.965667 11544 ts_tablet_manager.cc:1403] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.147s	user 0.017s	sys 0.003s
I20260709 12:12:26.966051 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904deb919d4b42b290b40955d7eb0154" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:26.961642 11545 ts_tablet_manager.cc:1403] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.003s
I20260709 12:12:26.966672 11278 raft_consensus.cc:2468] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:26.967800 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:26.968593 11544 raft_consensus.cc:359] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.969314 11544 raft_consensus.cc:385] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.971246 11486 tablet_service.cc:1511] Processing CreateTablet for tablet f3531bc235ff4e12b0d7be22a7b2d978 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:26.969110 11542 tablet_bootstrap.cc:654] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.972311 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3531bc235ff4e12b0d7be22a7b2d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.969515 11545 raft_consensus.cc:359] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.974395 11545 raft_consensus.cc:385] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:26.974864 11545 raft_consensus.cc:740] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.975701 11545 consensus_queue.cc:260] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:26.978901 11545 ts_tablet_manager.cc:1434] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
W20260709 12:12:26.979372 11466 leader_election.cc:343] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.981048 11466 leader_election.cc:304] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:26.982020 11545 tablet_bootstrap.cc:492] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:26.979923 11265 tablet_service.cc:1511] Processing CreateTablet for tablet f3531bc235ff4e12b0d7be22a7b2d978 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:26.980036 11392 leader_election.cc:304] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:26.985867 11553 raft_consensus.cc:2804] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:26.986225 11553 raft_consensus.cc:493] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.986550 11553 raft_consensus.cc:3060] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:26.989173 11266 tablet_service.cc:1511] Processing CreateTablet for tablet e04d1e1c941c46aa8589a0821e76d830 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:26.989773 11544 raft_consensus.cc:740] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:26.990247 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04d1e1c941c46aa8589a0821e76d830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.990650 11544 consensus_queue.cc:260] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:26.979187 11412 tablet_service.cc:1511] Processing CreateTablet for tablet e04d1e1c941c46aa8589a0821e76d830 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:26.992213 11417 tablet_service.cc:1511] Processing CreateTablet for tablet dc00a1ea01644d14b64b6826164bf7e5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:26.991185 11489 tablet_service.cc:1511] Processing CreateTablet for tablet e04d1e1c941c46aa8589a0821e76d830 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:26.993309 11412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04d1e1c941c46aa8589a0821e76d830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.993491 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04d1e1c941c46aa8589a0821e76d830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.994262 11544 ts_tablet_manager.cc:1434] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:12:26.982268 11586 raft_consensus.cc:2749] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:26.997570 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc00a1ea01644d14b64b6826164bf7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.998093 11490 tablet_service.cc:1511] Processing CreateTablet for tablet dc00a1ea01644d14b64b6826164bf7e5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:26.998807 11553 raft_consensus.cc:515] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:26.990276 11335 tablet_service.cc:1511] Processing CreateTablet for tablet dc00a1ea01644d14b64b6826164bf7e5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:26.996513 11545 tablet_bootstrap.cc:654] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:26.999269 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc00a1ea01644d14b64b6826164bf7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.000157 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc00a1ea01644d14b64b6826164bf7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:26.961102 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c614ce4bca814377bb079b966180edce" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:27.004236 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904deb919d4b42b290b40955d7eb0154" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:27.004901 11352 raft_consensus.cc:2468] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
W20260709 12:12:27.007495 11317 leader_election.cc:343] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:26.980032 11341 tablet_service.cc:1511] Processing CreateTablet for tablet f3531bc235ff4e12b0d7be22a7b2d978 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:27.013535 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3531bc235ff4e12b0d7be22a7b2d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.016726 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904deb919d4b42b290b40955d7eb0154" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:27.017346 11352 raft_consensus.cc:3060] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:27.019923 11224 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:27.021229 11259 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40b4b0fb044dd893a3a58ce7749e98 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:27.022230 11553 leader_election.cc:290] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:27.026973 11427 raft_consensus.cc:2468] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:27.026424 11174 catalog_manager.cc:5697] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.032528 11336 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40b4b0fb044dd893a3a58ce7749e98 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:27.033694 11336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40b4b0fb044dd893a3a58ce7749e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.034647 11352 raft_consensus.cc:2468] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:27.035907 11390 leader_election.cc:304] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:27.036677 11553 raft_consensus.cc:2804] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.037144 11553 raft_consensus.cc:697] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:27.037861 11553 consensus_queue.cc:237] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.039956 11410 tablet_service.cc:1511] Processing CreateTablet for tablet 6c40b4b0fb044dd893a3a58ce7749e98 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:27.041554 11319 leader_election.cc:304] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:27.042662 11552 raft_consensus.cc:2804] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.042891 11410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40b4b0fb044dd893a3a58ce7749e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.043145 11552 raft_consensus.cc:697] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:27.044025 11552 consensus_queue.cc:237] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.045949 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 969c64b986d444c19757cf5ce94bb8bc (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:27.047264 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969c64b986d444c19757cf5ce94bb8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.051625 11267 tablet_service.cc:1511] Processing CreateTablet for tablet 969c64b986d444c19757cf5ce94bb8bc (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:27.057250 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 969c64b986d444c19757cf5ce94bb8bc (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:27.058434 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969c64b986d444c19757cf5ce94bb8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.061266 11501 raft_consensus.cc:3060] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.066332 11416 tablet_service.cc:1511] Processing CreateTablet for tablet a761f8e443864779b5216933f3dfe795 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:27.069594 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a761f8e443864779b5216933f3dfe795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.070046 11551 consensus_queue.cc:1048] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.073364 11552 consensus_queue.cc:1048] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.074869 11545 tablet_bootstrap.cc:492] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:27.075376 11545 ts_tablet_manager.cc:1403] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.002s
I20260709 12:12:27.078433 11545 raft_consensus.cc:359] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.079085 11545 raft_consensus.cc:385] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.079350 11545 raft_consensus.cc:740] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.079761 11489 tablet_service.cc:1511] Processing CreateTablet for tablet a761f8e443864779b5216933f3dfe795 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:27.080034 11545 consensus_queue.cc:260] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.080987 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a761f8e443864779b5216933f3dfe795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.091574 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904deb919d4b42b290b40955d7eb0154" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:27.092208 11278 raft_consensus.cc:3060] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.098817 11545 ts_tablet_manager.cc:1434] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:12:27.098482 11261 tablet_service.cc:1511] Processing CreateTablet for tablet a761f8e443864779b5216933f3dfe795 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:27.098542 11267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 969c64b986d444c19757cf5ce94bb8bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.102432 11261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a761f8e443864779b5216933f3dfe795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.103529 11259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c40b4b0fb044dd893a3a58ce7749e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.104149 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3531bc235ff4e12b0d7be22a7b2d978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.103494 11552 consensus_queue.cc:1048] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:27.118685 11550 raft_consensus.cc:493] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.119335 11545 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:27.119156 11550 raft_consensus.cc:515] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.126318 11550 leader_election.cc:290] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:27.128041 11545 tablet_bootstrap.cc:654] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.134671 11278 raft_consensus.cc:2468] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:27.136648 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:27.137337 11501 raft_consensus.cc:2468] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:27.138428 11242 leader_election.cc:304] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:27.139249 11550 raft_consensus.cc:2804] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.139631 11550 raft_consensus.cc:493] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.139930 11550 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.140969 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:27.142349 11241 leader_election.cc:343] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.147255 11550 raft_consensus.cc:515] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.151069 11544 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:27.153455 11278 raft_consensus.cc:3060] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.157160 11408 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed543b345014451bd60ddfb0b548dd6 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:27.158489 11408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed543b345014451bd60ddfb0b548dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.158318 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed543b345014451bd60ddfb0b548dd6 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:27.159596 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed543b345014451bd60ddfb0b548dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.161752 11335 tablet_service.cc:1511] Processing CreateTablet for tablet 3ed543b345014451bd60ddfb0b548dd6 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:27.167084 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ed543b345014451bd60ddfb0b548dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.199285 11546 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.199875 11546 ts_tablet_manager.cc:1403] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.278s	user 0.006s	sys 0.005s
I20260709 12:12:27.203085 11546 raft_consensus.cc:359] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.203920 11586 raft_consensus.cc:493] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.204715 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:27.216568 11500 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:27.221910 11392 consensus_peers.cc:597] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:27.215095 11586 raft_consensus.cc:515] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.224483 11586 leader_election.cc:290] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:27.226055 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5bebe45ea4b57b7ace8bb13073461" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:27.226935 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5bebe45ea4b57b7ace8bb13073461" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:27.231856 11500 raft_consensus.cc:2468] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:27.209262 11546 raft_consensus.cc:385] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.237468 11417 tablet_service.cc:1511] Processing CreateTablet for tablet a7182aba132c4c0c8c8d9a45d8a2b978 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:27.238289 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7182aba132c4c0c8c8d9a45d8a2b978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.235512 11544 tablet_bootstrap.cc:654] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.239743 11335 tablet_service.cc:1511] Processing CreateTablet for tablet a7182aba132c4c0c8c8d9a45d8a2b978 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:27.241355 11335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7182aba132c4c0c8c8d9a45d8a2b978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.244135 11242 leader_election.cc:304] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
W20260709 12:12:27.239539 11467 leader_election.cc:343] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.245675 11261 tablet_service.cc:1511] Processing CreateTablet for tablet a7182aba132c4c0c8c8d9a45d8a2b978 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:12:27.246292 11466 leader_election.cc:343] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.246380 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 805b5febce314019a60dc7fe2f77b2cf (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:27.246901 11261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7182aba132c4c0c8c8d9a45d8a2b978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.246709 11466 leader_election.cc:304] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:27.247471 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805b5febce314019a60dc7fe2f77b2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.248129 11586 raft_consensus.cc:2749] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:27.234673 11546 raft_consensus.cc:740] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.250509 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 805b5febce314019a60dc7fe2f77b2cf (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:27.257465 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805b5febce314019a60dc7fe2f77b2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.252678 11550 leader_election.cc:290] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:27.259284 11550 raft_consensus.cc:493] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.259739 11550 raft_consensus.cc:515] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.262161 11341 tablet_service.cc:1511] Processing CreateTablet for tablet c68a9fb3e63a45119c4c6ebf7623679d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:27.263331 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68a9fb3e63a45119c4c6ebf7623679d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.264599 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 2e442d52cd804d5fb247d09bf369c51d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:27.265671 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e442d52cd804d5fb247d09bf369c51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.270351 11408 tablet_service.cc:1511] Processing CreateTablet for tablet c68a9fb3e63a45119c4c6ebf7623679d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:27.270887 11486 tablet_service.cc:1511] Processing CreateTablet for tablet c68a9fb3e63a45119c4c6ebf7623679d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:27.271603 11408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68a9fb3e63a45119c4c6ebf7623679d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.271982 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68a9fb3e63a45119c4c6ebf7623679d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.260571 11174 catalog_manager.cc:5697] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.279419 11336 tablet_service.cc:1511] Processing CreateTablet for tablet a4ab1731cb8c4d9b91d8b33ada1a7e55 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:27.280597 11336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ab1731cb8c4d9b91d8b33ada1a7e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.280422 11416 tablet_service.cc:1511] Processing CreateTablet for tablet a4ab1731cb8c4d9b91d8b33ada1a7e55 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:27.281512 11416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ab1731cb8c4d9b91d8b33ada1a7e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.282490 11546 consensus_queue.cc:260] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.286293 11545 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:27.286765 11545 ts_tablet_manager.cc:1403] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.025s
I20260709 12:12:27.289678 11545 raft_consensus.cc:359] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.289526 11173 catalog_manager.cc:5697] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.290400 11545 raft_consensus.cc:385] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.290735 11545 raft_consensus.cc:740] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.263381 11410 tablet_service.cc:1511] Processing CreateTablet for tablet 2e442d52cd804d5fb247d09bf369c51d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:27.284724 11546 ts_tablet_manager.cc:1434] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.001s
I20260709 12:12:27.314375 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:27.315347 11605 raft_consensus.cc:493] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.315790 11605 raft_consensus.cc:515] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.317835 11605 leader_election.cc:290] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:27.318501 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:27.319672 11542 tablet_bootstrap.cc:492] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
W20260709 12:12:27.320258 11317 leader_election.cc:343] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.320166 11542 ts_tablet_manager.cc:1403] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.401s	user 0.038s	sys 0.066s
I20260709 12:12:27.310070 11545 consensus_queue.cc:260] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.323009 11489 tablet_service.cc:1511] Processing CreateTablet for tablet ca875d67c8364f99b00734f80028f1ff (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:27.324101 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca875d67c8364f99b00734f80028f1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.323743 11542 raft_consensus.cc:359] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.324462 11542 raft_consensus.cc:385] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.324800 11542 raft_consensus.cc:740] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.327373 11267 tablet_service.cc:1511] Processing CreateTablet for tablet 805b5febce314019a60dc7fe2f77b2cf (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:27.328058 11550 leader_election.cc:290] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:27.328258 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:27.333177 11266 tablet_service.cc:1511] Processing CreateTablet for tablet 2e442d52cd804d5fb247d09bf369c51d (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:27.335903 11265 tablet_service.cc:1511] Processing CreateTablet for tablet a4ab1731cb8c4d9b91d8b33ada1a7e55 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:27.322968 11545 ts_tablet_manager.cc:1434] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.004s
W20260709 12:12:27.299724 11242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 55684.7us
I20260709 12:12:27.328627 11606 raft_consensus.cc:2804] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.343375 11606 raft_consensus.cc:697] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:27.344237 11606 consensus_queue.cc:237] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.344566 11553 consensus_queue.cc:1048] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.343375 11336 tablet_service.cc:1511] Processing CreateTablet for tablet ca875d67c8364f99b00734f80028f1ff (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:27.347069 11490 tablet_service.cc:1511] Processing CreateTablet for tablet cf819e5fabb44ecb9cb0235c718d87d5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:27.328573 11267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805b5febce314019a60dc7fe2f77b2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.350595 11417 tablet_service.cc:1511] Processing CreateTablet for tablet cf819e5fabb44ecb9cb0235c718d87d5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:27.352092 11545 tablet_bootstrap.cc:492] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:27.354013 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf819e5fabb44ecb9cb0235c718d87d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.354293 11546 tablet_bootstrap.cc:492] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:27.355793 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:27.357126 11604 consensus_queue.cc:1048] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.357975 11410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e442d52cd804d5fb247d09bf369c51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.348418 11336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca875d67c8364f99b00734f80028f1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.328992 11542 consensus_queue.cc:260] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.357880 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:27.381315 11266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e442d52cd804d5fb247d09bf369c51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.383311 11417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf819e5fabb44ecb9cb0235c718d87d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.384495 11544 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:27.385047 11544 ts_tablet_manager.cc:1403] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.007s
I20260709 12:12:27.385211 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4ab1731cb8c4d9b91d8b33ada1a7e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.380151 11586 raft_consensus.cc:493] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.411851 11546 tablet_bootstrap.cc:654] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:27.406407 11318 leader_election.cc:343] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:27.408209 11241 leader_election.cc:343] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.429262 11261 tablet_service.cc:1511] Processing CreateTablet for tablet ca875d67c8364f99b00734f80028f1ff (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:27.430557 11261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca875d67c8364f99b00734f80028f1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.433689 11542 ts_tablet_manager.cc:1434] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 12:12:27.434700 11542 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:27.422672 11318 leader_election.cc:304] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:27.440737 11604 raft_consensus.cc:2749] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:27.443838 11553 raft_consensus.cc:493] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.444306 11553 raft_consensus.cc:515] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.447074 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10568811bd7a4972a6452da865f47f6c" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:27.447670 11499 raft_consensus.cc:2468] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:27.449096 11391 leader_election.cc:304] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:27.449965 11579 raft_consensus.cc:2804] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.450347 11579 raft_consensus.cc:493] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.450647 11579 raft_consensus.cc:3060] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.453193 11545 tablet_bootstrap.cc:654] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.408073 11586 raft_consensus.cc:515] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
W20260709 12:12:27.460994 11317 consensus_peers.cc:597] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Couldn't send request to peer 8b6d95e83cd149f88775563c5514ba28. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:27.470737 11553 leader_election.cc:290] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:27.472292 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db72482cd1247f689e8f82c76c75e27" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:27.475313 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db72482cd1247f689e8f82c76c75e27" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:27.476133 11467 leader_election.cc:343] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:27.477074 11464 leader_election.cc:343] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.477545 11464 leader_election.cc:304] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
W20260709 12:12:27.471099 11241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 63922.1us
I20260709 12:12:27.478230 11579 raft_consensus.cc:515] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.478457 11611 raft_consensus.cc:2749] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:27.479553 11241 leader_election.cc:304] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:27.480788 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10568811bd7a4972a6452da865f47f6c" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:27.481360 11499 raft_consensus.cc:3060] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.485905 11265 tablet_service.cc:1511] Processing CreateTablet for tablet cf819e5fabb44ecb9cb0235c718d87d5 (DEFAULT_TABLE table=test-workload [id=b1cf97cc386242009aed8a05b15bcb8c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:27.485337 11550 raft_consensus.cc:2749] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:27.491863 11579 leader_election.cc:290] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:27.492654 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10568811bd7a4972a6452da865f47f6c" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:27.493271 11277 raft_consensus.cc:2468] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:27.495705 11265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf819e5fabb44ecb9cb0235c718d87d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:27.499038 11176 catalog_manager.cc:5697] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.470899 11586 leader_election.cc:290] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:27.506254 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10568811bd7a4972a6452da865f47f6c" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:27.454983 11544 raft_consensus.cc:359] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.509493 11277 raft_consensus.cc:3060] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.510758 11544 raft_consensus.cc:385] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.519345 11544 raft_consensus.cc:740] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.520113 11544 consensus_queue.cc:260] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.523072 11544 ts_tablet_manager.cc:1434] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.138s	user 0.008s	sys 0.000s
I20260709 12:12:27.524317 11544 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:27.525640 11542 tablet_bootstrap.cc:654] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.525823 11277 raft_consensus.cc:2468] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:27.528381 11392 leader_election.cc:304] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:27.529614 11553 raft_consensus.cc:2804] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.531455 11544 tablet_bootstrap.cc:654] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.518880 11499 raft_consensus.cc:2468] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:27.534881 11546 tablet_bootstrap.cc:492] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.535365 11546 ts_tablet_manager.cc:1403] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.181s	user 0.023s	sys 0.020s
I20260709 12:12:27.537168 11604 raft_consensus.cc:493] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.538720 11545 tablet_bootstrap.cc:492] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:27.539271 11545 ts_tablet_manager.cc:1403] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.187s	user 0.024s	sys 0.006s
I20260709 12:12:27.539007 11604 raft_consensus.cc:515] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.540992 11604 leader_election.cc:290] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:27.542966 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1d4b7cb4344bdc8344faf45dc2167f" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:27.544226 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1d4b7cb4344bdc8344faf45dc2167f" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:27.544916 11499 raft_consensus.cc:2468] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:27.546042 11317 leader_election.cc:304] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
W20260709 12:12:27.546556 11319 leader_election.cc:343] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.547101 11604 raft_consensus.cc:2804] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.547472 11604 raft_consensus.cc:493] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.547497 11546 raft_consensus.cc:359] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.547988 11604 raft_consensus.cc:3060] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.548346 11546 raft_consensus.cc:385] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.547984 11542 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:27.548717 11546 raft_consensus.cc:740] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.548774 11553 raft_consensus.cc:697] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:27.549675 11546 consensus_queue.cc:260] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.549860 11553 consensus_queue.cc:237] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.549713 11545 raft_consensus.cc:359] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.551002 11545 raft_consensus.cc:385] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.551275 11545 raft_consensus.cc:740] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.552126 11546 ts_tablet_manager.cc:1434] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:12:27.552013 11545 consensus_queue.cc:260] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.553131 11546 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:27.553977 11545 ts_tablet_manager.cc:1434] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:12:27.556798 11604 raft_consensus.cc:515] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.557618 11542 ts_tablet_manager.cc:1403] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.123s	user 0.008s	sys 0.012s
I20260709 12:12:27.558806 11604 leader_election.cc:290] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:27.559626 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1d4b7cb4344bdc8344faf45dc2167f" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:27.560302 11545 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:27.560192 11427 raft_consensus.cc:3060] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.561077 11544 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:27.561568 11544 ts_tablet_manager.cc:1403] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:12:27.565075 11546 tablet_bootstrap.cc:654] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.565778 11545 tablet_bootstrap.cc:654] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.560078 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1d4b7cb4344bdc8344faf45dc2167f" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:27.567880 11427 raft_consensus.cc:2468] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:27.567843 11499 raft_consensus.cc:3060] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.569092 11319 leader_election.cc:304] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:27.571774 11542 raft_consensus.cc:359] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.572479 11542 raft_consensus.cc:385] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.572746 11542 raft_consensus.cc:740] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.573191 11604 raft_consensus.cc:2804] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.573693 11604 raft_consensus.cc:697] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:27.573474 11542 consensus_queue.cc:260] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.574483 11604 consensus_queue.cc:237] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.570256 11544 raft_consensus.cc:359] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.576042 11544 raft_consensus.cc:385] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.576330 11544 raft_consensus.cc:740] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.576498 11499 raft_consensus.cc:2468] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:27.577049 11544 consensus_queue.cc:260] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.579252 11544 ts_tablet_manager.cc:1434] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 12:12:27.579815 11542 ts_tablet_manager.cc:1434] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:12:27.580873 11542 tablet_bootstrap.cc:492] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:27.581691 11176 catalog_manager.cc:5697] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.587169 11542 tablet_bootstrap.cc:654] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.589550 11544 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:27.593595 11175 catalog_manager.cc:5697] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.595858 11546 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.596061 11544 tablet_bootstrap.cc:654] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.600600 11553 consensus_queue.cc:1048] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.602113 11546 ts_tablet_manager.cc:1403] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 12:12:27.605206 11546 raft_consensus.cc:359] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.605973 11546 raft_consensus.cc:385] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.606309 11546 raft_consensus.cc:740] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.607223 11546 consensus_queue.cc:260] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.608415 11619 consensus_queue.cc:1048] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.609524 11546 ts_tablet_manager.cc:1434] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:12:27.610529 11546 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:27.616601 11546 tablet_bootstrap.cc:654] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.640784 11545 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:27.641263 11545 ts_tablet_manager.cc:1403] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.081s	user 0.028s	sys 0.043s
I20260709 12:12:27.643931 11545 raft_consensus.cc:359] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.644578 11545 raft_consensus.cc:385] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.644886 11545 raft_consensus.cc:740] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.645663 11545 consensus_queue.cc:260] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.654414 11546 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.654477 11545 ts_tablet_manager.cc:1434] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.005s
I20260709 12:12:27.655048 11546 ts_tablet_manager.cc:1403] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.017s
I20260709 12:12:27.656672 11542 tablet_bootstrap.cc:492] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:27.657182 11542 ts_tablet_manager.cc:1403] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.004s
I20260709 12:12:27.657660 11544 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:27.658118 11544 ts_tablet_manager.cc:1403] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.011s
I20260709 12:12:27.660260 11545 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:27.660897 11544 raft_consensus.cc:359] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.661551 11544 raft_consensus.cc:385] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.659938 11542 raft_consensus.cc:359] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.661828 11544 raft_consensus.cc:740] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.661710 11546 raft_consensus.cc:359] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.662556 11546 raft_consensus.cc:385] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.662842 11546 raft_consensus.cc:740] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.662791 11544 consensus_queue.cc:260] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.663689 11546 consensus_queue.cc:260] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.665444 11544 ts_tablet_manager.cc:1434] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:27.665709 11546 ts_tablet_manager.cc:1434] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:27.666309 11544 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:27.666412 11545 tablet_bootstrap.cc:654] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.666590 11546 tablet_bootstrap.cc:492] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:27.667567 11542 raft_consensus.cc:385] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.667873 11542 raft_consensus.cc:740] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.668579 11542 consensus_queue.cc:260] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.670542 11542 ts_tablet_manager.cc:1434] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:12:27.672199 11542 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:27.680071 11546 tablet_bootstrap.cc:654] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.682586 11604 consensus_queue.cc:1048] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.685006 11542 tablet_bootstrap.cc:654] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.689705 11606 raft_consensus.cc:493] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.690171 11606 raft_consensus.cc:515] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.691258 11604 raft_consensus.cc:493] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.691555 11544 tablet_bootstrap.cc:654] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.691799 11604 raft_consensus.cc:515] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.692179 11606 leader_election.cc:290] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:27.694111 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:27.694509 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:27.694736 11499 raft_consensus.cc:2468] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:27.694902 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc72ff56ccb4ae79079d36d4b125e0b" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:27.695235 11352 raft_consensus.cc:2468] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:27.695489 11604 leader_election.cc:290] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:27.696288 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc72ff56ccb4ae79079d36d4b125e0b" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:27.696741 11242 leader_election.cc:304] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:27.697955 11606 raft_consensus.cc:2804] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.698380 11606 raft_consensus.cc:493] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.698766 11606 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.695541 11277 raft_consensus.cc:2468] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:27.701056 11318 leader_election.cc:304] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:27.701915 11605 raft_consensus.cc:2804] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.702289 11605 raft_consensus.cc:493] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.702612 11605 raft_consensus.cc:3060] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.698553 11426 raft_consensus.cc:2468] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:27.705832 11586 raft_consensus.cc:493] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.706328 11586 raft_consensus.cc:515] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.708257 11586 leader_election.cc:290] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:27.710484 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e399427af66e44d79c315f13efd5c353" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:27.711097 11352 raft_consensus.cc:2468] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:27.711627 11605 raft_consensus.cc:515] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.712329 11464 leader_election.cc:304] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:27.713439 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e399427af66e44d79c315f13efd5c353" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:27.714358 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc72ff56ccb4ae79079d36d4b125e0b" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:27.714955 11277 raft_consensus.cc:3060] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.715267 11586 raft_consensus.cc:2804] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.715675 11586 raft_consensus.cc:493] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.715981 11586 raft_consensus.cc:3060] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:27.714847 11467 leader_election.cc:343] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.722213 11277 raft_consensus.cc:2468] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:27.723376 11318 leader_election.cc:304] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:27.724213 11604 raft_consensus.cc:2804] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.724725 11604 raft_consensus.cc:697] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:27.725001 11586 raft_consensus.cc:515] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.726338 11604 consensus_queue.cc:237] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.728879 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e399427af66e44d79c315f13efd5c353" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:27.729439 11352 raft_consensus.cc:3060] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.731707 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc72ff56ccb4ae79079d36d4b125e0b" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:27.732306 11426 raft_consensus.cc:3060] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.736313 11352 raft_consensus.cc:2468] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:27.737532 11464 leader_election.cc:304] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:27.738364 11611 raft_consensus.cc:2804] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.739459 11426 raft_consensus.cc:2468] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:27.726023 11606 raft_consensus.cc:515] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.740732 11605 leader_election.cc:290] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:27.754400 11542 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:27.754881 11542 ts_tablet_manager.cc:1403] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.021s
I20260709 12:12:27.755484 11611 raft_consensus.cc:697] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:27.758781 11546 tablet_bootstrap.cc:492] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.759238 11546 ts_tablet_manager.cc:1403] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.019s
I20260709 12:12:27.761835 11546 raft_consensus.cc:359] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.762457 11546 raft_consensus.cc:385] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.762727 11546 raft_consensus.cc:740] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.762986 11545 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:27.763523 11546 consensus_queue.cc:260] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.754091 11586 leader_election.cc:290] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:27.764580 11606 leader_election.cc:290] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:27.764917 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:27.765926 11546 ts_tablet_manager.cc:1434] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:27.763691 11542 raft_consensus.cc:359] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.763456 11545 ts_tablet_manager.cc:1403] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.015s
I20260709 12:12:27.765497 11499 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.766897 11546 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:27.767433 11544 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:27.767899 11544 ts_tablet_manager.cc:1403] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.010s
I20260709 12:12:27.768846 11545 raft_consensus.cc:359] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.769500 11545 raft_consensus.cc:385] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.756242 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e399427af66e44d79c315f13efd5c353" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:27.770093 11542 raft_consensus.cc:385] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.770686 11542 raft_consensus.cc:740] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.769753 11545 raft_consensus.cc:740] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.771462 11542 consensus_queue.cc:260] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.771607 11545 consensus_queue.cc:260] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.772994 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:27.773588 11352 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.773699 11545 ts_tablet_manager.cc:1434] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:27.774675 11545 tablet_bootstrap.cc:492] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:27.780157 11352 raft_consensus.cc:2468] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:27.787249 11241 leader_election.cc:304] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:27.788179 11606 raft_consensus.cc:2804] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.788980 11606 raft_consensus.cc:697] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:27.789840 11606 consensus_queue.cc:237] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.781081 11545 tablet_bootstrap.cc:654] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.781083 11544 raft_consensus.cc:359] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.781883 11499 raft_consensus.cc:2468] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:27.776515 11175 catalog_manager.cc:5697] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.784366 11546 tablet_bootstrap.cc:654] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.784829 11426 raft_consensus.cc:3060] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.800922 11550 consensus_queue.cc:1048] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.785845 11542 ts_tablet_manager.cc:1434] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:12:27.785440 11611 consensus_queue.cc:237] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.802309 11542 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:27.807008 11546 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.809069 11546 ts_tablet_manager.cc:1403] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 12:12:27.809660 11542 tablet_bootstrap.cc:654] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.811494 11544 raft_consensus.cc:385] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.811565 11546 raft_consensus.cc:359] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.811775 11426 raft_consensus.cc:2468] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:27.812152 11544 raft_consensus.cc:740] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.816529 11352 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.820168 11544 consensus_queue.cc:260] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.822186 11544 ts_tablet_manager.cc:1434] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 12:12:27.823081 11544 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:27.818563 11176 catalog_manager.cc:5697] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:27.828459 11544 tablet_bootstrap.cc:654] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.824702 11545 tablet_bootstrap.cc:492] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:27.832441 11545 ts_tablet_manager.cc:1403] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 12:12:27.835034 11545 raft_consensus.cc:359] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.838161 11545 raft_consensus.cc:385] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.838517 11545 raft_consensus.cc:740] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.839313 11545 consensus_queue.cc:260] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.842525 11544 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:27.843010 11544 ts_tablet_manager.cc:1403] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 12:12:27.845623 11544 raft_consensus.cc:359] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.846228 11544 raft_consensus.cc:385] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.846483 11544 raft_consensus.cc:740] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.847221 11606 consensus_queue.cc:1048] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.847499 11544 consensus_queue.cc:260] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.819386 11546 raft_consensus.cc:385] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.850085 11544 ts_tablet_manager.cc:1434] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:27.849261 11175 catalog_manager.cc:5697] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.851011 11542 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:27.851480 11542 ts_tablet_manager.cc:1403] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.021s
I20260709 12:12:27.848357 11545 ts_tablet_manager.cc:1434] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:12:27.849316 11546 raft_consensus.cc:740] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.853196 11546 consensus_queue.cc:260] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.854463 11544 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:27.854249 11542 raft_consensus.cc:359] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.854895 11542 raft_consensus.cc:385] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.855150 11542 raft_consensus.cc:740] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.855896 11542 consensus_queue.cc:260] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.857378 11611 raft_consensus.cc:493] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.857837 11611 raft_consensus.cc:515] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.858265 11542 ts_tablet_manager.cc:1434] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:12:27.860330 11611 leader_election.cc:290] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:27.860713 11542 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:27.860775 11546 ts_tablet_manager.cc:1434] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:12:27.861943 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:27.863950 11544 tablet_bootstrap.cc:654] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.866293 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
W20260709 12:12:27.866572 11466 leader_election.cc:343] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.867353 11545 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:27.867429 11542 tablet_bootstrap.cc:654] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.861882 11546 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
W20260709 12:12:27.872422 11467 leader_election.cc:343] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:27.873976 11467 leader_election.cc:304] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:27.876447 11545 tablet_bootstrap.cc:654] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.876963 11611 raft_consensus.cc:2749] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:27.880450 11542 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:27.880896 11542 ts_tablet_manager.cc:1403] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.005s
I20260709 12:12:27.884892 11546 tablet_bootstrap.cc:654] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.893049 11544 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:27.893520 11544 ts_tablet_manager.cc:1403] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.008s
I20260709 12:12:27.893803 11542 raft_consensus.cc:359] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.894532 11542 raft_consensus.cc:385] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.894797 11542 raft_consensus.cc:740] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.895483 11542 consensus_queue.cc:260] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.896301 11544 raft_consensus.cc:359] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.897202 11544 raft_consensus.cc:385] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.897481 11544 raft_consensus.cc:740] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.897840 11542 ts_tablet_manager.cc:1434] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:27.898257 11544 consensus_queue.cc:260] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.898873 11542 tablet_bootstrap.cc:492] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:27.901201 11546 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.901647 11546 ts_tablet_manager.cc:1403] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.002s
I20260709 12:12:27.902874 11544 ts_tablet_manager.cc:1434] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:27.903731 11544 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:27.904171 11546 raft_consensus.cc:359] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.904844 11546 raft_consensus.cc:385] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.905139 11542 tablet_bootstrap.cc:654] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.905104 11546 raft_consensus.cc:740] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.906164 11545 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:27.905961 11546 consensus_queue.cc:260] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.907091 11545 ts_tablet_manager.cc:1403] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.012s
I20260709 12:12:27.907814 11619 raft_consensus.cc:493] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.908280 11619 raft_consensus.cc:515] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.910332 11619 leader_election.cc:290] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:27.910742 11546 ts_tablet_manager.cc:1434] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:27.911638 11546 tablet_bootstrap.cc:492] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:27.912137 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5bebe45ea4b57b7ace8bb13073461" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:27.912765 11499 raft_consensus.cc:2468] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:27.915472 11545 raft_consensus.cc:359] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.916363 11544 tablet_bootstrap.cc:654] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.916113 11391 leader_election.cc:304] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:27.916778 11546 tablet_bootstrap.cc:654] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.917510 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5bebe45ea4b57b7ace8bb13073461" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:27.918246 11277 raft_consensus.cc:2468] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:27.918288 11619 raft_consensus.cc:2804] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:27.918843 11619 raft_consensus.cc:493] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.920127 11619 raft_consensus.cc:3060] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.920925 11545 raft_consensus.cc:385] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.921262 11545 raft_consensus.cc:740] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.921952 11545 consensus_queue.cc:260] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:27.923884 11545 ts_tablet_manager.cc:1434] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 12:12:27.938936 11545 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:27.947006 11545 tablet_bootstrap.cc:654] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.950099 11619 raft_consensus.cc:515] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.953017 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5bebe45ea4b57b7ace8bb13073461" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:27.953567 11499 raft_consensus.cc:3060] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.953789 11546 tablet_bootstrap.cc:492] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.954291 11546 ts_tablet_manager.cc:1403] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.026s
I20260709 12:12:27.954854 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5bebe45ea4b57b7ace8bb13073461" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:27.955441 11277 raft_consensus.cc:3060] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:27.955628 11619 leader_election.cc:290] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:27.962924 11277 raft_consensus.cc:2468] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:27.964109 11392 leader_election.cc:304] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:27.964936 11619 raft_consensus.cc:2804] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:27.966056 11619 raft_consensus.cc:697] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:27.967006 11546 raft_consensus.cc:359] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.967636 11546 raft_consensus.cc:385] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.967259 11619 consensus_queue.cc:237] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.967901 11546 raft_consensus.cc:740] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.969249 11546 consensus_queue.cc:260] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:27.969823 11545 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:27.970343 11545 ts_tablet_manager.cc:1403] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.009s
I20260709 12:12:27.971421 11546 ts_tablet_manager.cc:1434] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:27.972489 11546 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:27.973757 11544 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:27.974315 11544 ts_tablet_manager.cc:1403] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.023s
I20260709 12:12:27.978015 11546 tablet_bootstrap.cc:654] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:27.971319 11499 raft_consensus.cc:2468] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:27.980928 11552 consensus_queue.cc:1048] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.983175 11545 raft_consensus.cc:359] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.983814 11545 raft_consensus.cc:385] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.983939 11546 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:27.984162 11545 raft_consensus.cc:740] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.984453 11546 ts_tablet_manager.cc:1403] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:12:27.985023 11545 consensus_queue.cc:260] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:27.987344 11546 raft_consensus.cc:359] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.988003 11546 raft_consensus.cc:385] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:27.990090 11545 ts_tablet_manager.cc:1434] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:12:27.988246 11546 raft_consensus.cc:740] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:27.991115 11545 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:27.991549 11546 consensus_queue.cc:260] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:27.993769 11546 ts_tablet_manager.cc:1434] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:12:27.994588 11546 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:27.998178 11552 consensus_queue.cc:1048] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:27.998091 11545 tablet_bootstrap.cc:654] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.002539 11542 tablet_bootstrap.cc:492] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:27.994632 11544 raft_consensus.cc:359] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.003002 11544 raft_consensus.cc:385] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.003340 11544 raft_consensus.cc:740] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.003005 11542 ts_tablet_manager.cc:1403] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.104s	user 0.007s	sys 0.015s
I20260709 12:12:28.006623 11542 raft_consensus.cc:359] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.008834 11542 raft_consensus.cc:385] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.007808 11544 consensus_queue.cc:260] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.009660 11175 catalog_manager.cc:5697] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.010970 11544 ts_tablet_manager.cc:1434] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 12:12:28.012058 11544 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:28.015462 11542 raft_consensus.cc:740] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.016283 11542 consensus_queue.cc:260] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.023296 11542 ts_tablet_manager.cc:1434] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 12:12:28.025524 11542 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:28.027370 11544 tablet_bootstrap.cc:654] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.036242 11542 tablet_bootstrap.cc:654] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.037995 11606 raft_consensus.cc:493] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.038523 11606 raft_consensus.cc:515] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.042026 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d75399439f14d43b801446067d46c8a" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:28.040652 11606 leader_election.cc:290] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:28.045079 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d75399439f14d43b801446067d46c8a" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.046626 11244 leader_election.cc:304] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:28.047747 11606 raft_consensus.cc:2749] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.063535 11544 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:28.064118 11544 ts_tablet_manager.cc:1403] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.003s
I20260709 12:12:28.003592 11546 tablet_bootstrap.cc:654] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.059413 11542 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:28.070154 11542 ts_tablet_manager.cc:1403] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.002s
I20260709 12:12:28.067045 11544 raft_consensus.cc:359] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.072130 11544 raft_consensus.cc:385] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.072476 11500 raft_consensus.cc:3060] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:28.074337 11224 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:28.075677 11544 raft_consensus.cc:740] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.076378 11544 consensus_queue.cc:260] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.074013 11542 raft_consensus.cc:359] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.077080 11546 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:28.077419 11545 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:28.077560 11546 ts_tablet_manager.cc:1403] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 12:12:28.080588 11546 raft_consensus.cc:359] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.077884 11545 ts_tablet_manager.cc:1403] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.087s	user 0.034s	sys 0.036s
I20260709 12:12:28.085240 11619 raft_consensus.cc:493] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.085723 11619 raft_consensus.cc:515] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.087626 11545 raft_consensus.cc:359] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.088299 11545 raft_consensus.cc:385] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.088485 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bec71eba2d41c6929bdff648f3d1a0" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.088562 11545 raft_consensus.cc:740] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.088877 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bec71eba2d41c6929bdff648f3d1a0" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:28.089308 11277 raft_consensus.cc:2468] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.089578 11545 consensus_queue.cc:260] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
W20260709 12:12:28.090231 11390 leader_election.cc:343] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.091611 11545 ts_tablet_manager.cc:1434] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:28.091923 11392 leader_election.cc:304] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:28.092552 11545 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:28.092763 11579 raft_consensus.cc:2804] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.093181 11579 raft_consensus.cc:493] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.093500 11579 raft_consensus.cc:3060] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.087769 11619 leader_election.cc:290] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.090072 11611 raft_consensus.cc:493] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.095160 11611 raft_consensus.cc:515] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.097993 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41052c070b94d9eb8b24b2b57890c0a" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.098569 11277 raft_consensus.cc:2468] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:28.099712 11466 leader_election.cc:304] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:28.100100 11579 raft_consensus.cc:515] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.100529 11586 raft_consensus.cc:2804] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.100916 11586 raft_consensus.cc:493] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.101238 11586 raft_consensus.cc:3060] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.102238 11542 raft_consensus.cc:385] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.102530 11542 raft_consensus.cc:740] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.103746 11579 leader_election.cc:290] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.104708 11542 consensus_queue.cc:260] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.105149 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bec71eba2d41c6929bdff648f3d1a0" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:28.106276 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41052c070b94d9eb8b24b2b57890c0a" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:28.106618 11390 leader_election.cc:343] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.105165 11611 leader_election.cc:290] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.108282 11542 ts_tablet_manager.cc:1434] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:12:28.106572 11544 ts_tablet_manager.cc:1434] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:12:28.081516 11546 raft_consensus.cc:385] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.109771 11546 raft_consensus.cc:740] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.110101 11544 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:28.110777 11353 raft_consensus.cc:2468] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:28.108997 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bec71eba2d41c6929bdff648f3d1a0" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:28.111819 11277 raft_consensus.cc:3060] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.114090 11552 consensus_queue.cc:1048] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.122013 11545 tablet_bootstrap.cc:654] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.122363 11277 raft_consensus.cc:2468] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:28.123515 11392 leader_election.cc:304] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:28.124715 11579 raft_consensus.cc:2804] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.125213 11579 raft_consensus.cc:697] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:28.125798 11586 raft_consensus.cc:515] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.126004 11579 consensus_queue.cc:237] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.128316 11544 tablet_bootstrap.cc:654] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.110512 11546 consensus_queue.cc:260] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.133534 11619 raft_consensus.cc:493] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.133587 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41052c070b94d9eb8b24b2b57890c0a" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:28.134275 11278 raft_consensus.cc:3060] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.134049 11619 raft_consensus.cc:515] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.138049 11546 ts_tablet_manager.cc:1434] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.003s
I20260709 12:12:28.138957 11546 tablet_bootstrap.cc:492] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:28.141209 11278 raft_consensus.cc:2468] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:28.141749 11619 leader_election.cc:290] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.142320 11466 leader_election.cc:304] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:28.143213 11611 raft_consensus.cc:2804] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.143649 11611 raft_consensus.cc:697] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:28.144586 11586 leader_election.cc:290] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.144402 11611 consensus_queue.cc:237] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.145848 11542 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:28.147008 11579 consensus_queue.cc:1048] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.148970 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41052c070b94d9eb8b24b2b57890c0a" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:28.149555 11352 raft_consensus.cc:3060] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.156023 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f0383cd364797b2fd1e3a1c3ce300" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:28.157029 11546 tablet_bootstrap.cc:654] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:28.157449 11390 leader_election.cc:343] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.159520 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f0383cd364797b2fd1e3a1c3ce300" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.159786 11619 consensus_queue.cc:1048] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:28.160676 11392 leader_election.cc:343] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.161144 11392 leader_election.cc:304] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.161978 11579 raft_consensus.cc:2749] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.163880 11352 raft_consensus.cc:2468] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:28.167676 11545 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:28.177793 11545 ts_tablet_manager.cc:1403] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.018s
I20260709 12:12:28.181473 11278 raft_consensus.cc:3060] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.180714 11545 raft_consensus.cc:359] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.194060 11605 consensus_queue.cc:1048] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.194093 11545 raft_consensus.cc:385] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.196411 11545 raft_consensus.cc:740] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.169773 11542 tablet_bootstrap.cc:654] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.197069 11545 consensus_queue.cc:260] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.199077 11545 ts_tablet_manager.cc:1434] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 12:12:28.199909 11545 tablet_bootstrap.cc:492] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:28.199806 11553 raft_consensus.cc:493] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.200433 11553 raft_consensus.cc:515] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.201292 11173 catalog_manager.cc:5697] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:28.201635 11175 catalog_manager.cc:5697] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.202440 11553 leader_election.cc:290] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:28.204696 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db72482cd1247f689e8f82c76c75e27" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:28.205380 11500 raft_consensus.cc:2468] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.206645 11391 leader_election.cc:304] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:28.207732 11553 raft_consensus.cc:2804] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.208084 11553 raft_consensus.cc:493] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.208395 11553 raft_consensus.cc:3060] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.211699 11545 tablet_bootstrap.cc:654] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.215788 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db72482cd1247f689e8f82c76c75e27" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:28.216470 11352 raft_consensus.cc:2468] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.218954 11553 raft_consensus.cc:515] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
W20260709 12:12:28.219942 11667 log.cc:927] Time spent T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:12:28.224673 11546 tablet_bootstrap.cc:492] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:28.236279 11546 ts_tablet_manager.cc:1403] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.098s	user 0.006s	sys 0.004s
I20260709 12:12:28.224980 11553 leader_election.cc:290] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:28.229122 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db72482cd1247f689e8f82c76c75e27" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:28.229140 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db72482cd1247f689e8f82c76c75e27" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:28.239732 11353 raft_consensus.cc:3060] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.241818 11546 raft_consensus.cc:359] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.242503 11546 raft_consensus.cc:385] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.242753 11546 raft_consensus.cc:740] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.243106 11608 consensus_queue.cc:1048] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:28.246475 11546 consensus_queue.cc:260] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.245707 11500 raft_consensus.cc:3060] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.248500 11546 ts_tablet_manager.cc:1434] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:12:28.253100 11546 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:28.258814 11546 tablet_bootstrap.cc:654] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.261922 11611 consensus_queue.cc:1048] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.277772 11606 consensus_queue.cc:1048] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.295127 11544 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:28.295657 11544 ts_tablet_manager.cc:1403] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.186s	user 0.044s	sys 0.039s
I20260709 12:12:28.289485 11500 raft_consensus.cc:2468] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:28.300050 11544 raft_consensus.cc:359] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.300459 11353 raft_consensus.cc:2468] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:28.300698 11553 raft_consensus.cc:493] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.300765 11544 raft_consensus.cc:385] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.301371 11544 raft_consensus.cc:740] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.301352 11553 raft_consensus.cc:515] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.302203 11390 leader_election.cc:304] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:28.302551 11544 consensus_queue.cc:260] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.303026 11619 raft_consensus.cc:2804] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.303623 11619 raft_consensus.cc:697] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:28.304411 11553 leader_election.cc:290] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:28.304780 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:28.305084 11553 raft_consensus.cc:493] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.305461 11498 raft_consensus.cc:2468] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.312263 11545 tablet_bootstrap.cc:492] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:28.312745 11545 ts_tablet_manager.cc:1403] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.028s
I20260709 12:12:28.304412 11619 consensus_queue.cc:237] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.313330 11391 leader_election.cc:304] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:28.314083 11579 raft_consensus.cc:2804] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.314456 11579 raft_consensus.cc:493] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.314757 11579 raft_consensus.cc:3060] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.314837 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.315505 11542 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:28.315673 11276 raft_consensus.cc:2468] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.315987 11542 ts_tablet_manager.cc:1403] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.170s	user 0.028s	sys 0.023s
I20260709 12:12:28.318553 11542 raft_consensus.cc:359] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.319173 11542 raft_consensus.cc:385] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.319413 11542 raft_consensus.cc:740] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.321033 11544 ts_tablet_manager.cc:1434] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.006s
I20260709 12:12:28.320047 11542 consensus_queue.cc:260] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.311547 11604 raft_consensus.cc:493] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.321995 11544 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:28.305564 11553 raft_consensus.cc:515] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.323135 11542 ts_tablet_manager.cc:1434] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:28.323802 11553 leader_election.cc:290] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.324429 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e0cc76fe3c414896806d01bdc14d60" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.321956 11604 raft_consensus.cc:515] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.325122 11276 raft_consensus.cc:2468] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.326324 11604 leader_election.cc:290] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.326135 11579 raft_consensus.cc:515] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.327368 11392 leader_election.cc:304] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:28.327754 11546 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:28.328238 11546 ts_tablet_manager.cc:1403] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.003s
I20260709 12:12:28.328347 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e0cc76fe3c414896806d01bdc14d60" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.328920 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:28.329442 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e0cc76fe3c414896806d01bdc14d60" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.329622 11499 raft_consensus.cc:3060] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.329712 11545 raft_consensus.cc:359] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.330492 11545 raft_consensus.cc:385] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.330765 11545 raft_consensus.cc:740] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.331396 11545 consensus_queue.cc:260] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.330984 11546 raft_consensus.cc:359] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.332624 11546 raft_consensus.cc:385] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.332906 11546 raft_consensus.cc:740] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.333534 11546 consensus_queue.cc:260] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.335455 11546 ts_tablet_manager.cc:1434] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:12:28.335901 11544 tablet_bootstrap.cc:654] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.332973 11579 leader_election.cc:290] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:28.337044 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:28.337646 11275 raft_consensus.cc:3060] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.338367 11545 ts_tablet_manager.cc:1434] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:12:28.337047 11611 consensus_queue.cc:1048] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:28.336035 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e0cc76fe3c414896806d01bdc14d60" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:28.340741 11351 raft_consensus.cc:2468] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.339272 11545 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:28.329003 11427 raft_consensus.cc:2468] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:28.346069 11579 raft_consensus.cc:2804] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.346837 11542 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:28.347602 11545 tablet_bootstrap.cc:654] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.330077 11276 raft_consensus.cc:2468] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:28.353293 11499 raft_consensus.cc:2468] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:28.353930 11319 leader_election.cc:304] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:28.358058 11604 raft_consensus.cc:2804] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.358397 11604 raft_consensus.cc:493] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.358705 11604 raft_consensus.cc:3060] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.362004 11636 raft_consensus.cc:493] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.351357 11579 raft_consensus.cc:493] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.362594 11579 raft_consensus.cc:3060] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.362493 11636 raft_consensus.cc:515] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.365130 11391 leader_election.cc:304] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:28.336253 11546 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:28.383786 11542 tablet_bootstrap.cc:654] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.383730 11553 raft_consensus.cc:2804] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.402999 11619 raft_consensus.cc:493] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.403461 11619 raft_consensus.cc:515] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.407896 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e553b4d23b3451ea8801cd6f0e0ab7f" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.399927 11636 leader_election.cc:290] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:28.398859 11553 raft_consensus.cc:697] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
W20260709 12:12:28.425444 11391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 60404.1us
I20260709 12:12:28.427978 11275 raft_consensus.cc:2468] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:28.428787 11545 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:28.430295 11545 ts_tablet_manager.cc:1403] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.020s
W20260709 12:12:28.437101 11466 leader_election.cc:343] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.440142 11553 consensus_queue.cc:237] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.441666 11544 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:28.442067 11544 ts_tablet_manager.cc:1403] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.120s	user 0.005s	sys 0.015s
I20260709 12:12:28.444391 11546 tablet_bootstrap.cc:654] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.446105 11545 raft_consensus.cc:359] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.447283 11545 raft_consensus.cc:385] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.447482 11545 raft_consensus.cc:740] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.447933 11545 consensus_queue.cc:260] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.449764 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e553b4d23b3451ea8801cd6f0e0ab7f" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.454303 11636 raft_consensus.cc:493] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:28.454988 11467 leader_election.cc:343] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.454782 11636 raft_consensus.cc:515] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.455472 11467 leader_election.cc:304] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.456683 11619 leader_election.cc:290] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:28.457285 11636 leader_election.cc:290] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.459429 11544 raft_consensus.cc:359] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.460071 11544 raft_consensus.cc:385] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.459915 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c01bb891f44a2990eb8b9b41aa3e1a" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.460829 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5963410c1ae543ee83abf42430c2ac10" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:28.460179 11636 raft_consensus.cc:2749] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.461880 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c01bb891f44a2990eb8b9b41aa3e1a" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:28.462554 11351 raft_consensus.cc:2468] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:28.463967 11604 raft_consensus.cc:515] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:28.464104 11390 leader_election.cc:343] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.464900 11464 leader_election.cc:304] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:28.465761 11636 raft_consensus.cc:2804] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.465963 11604 leader_election.cc:290] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.466182 11636 raft_consensus.cc:493] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.467480 11636 raft_consensus.cc:3060] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.466997 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e0cc76fe3c414896806d01bdc14d60" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:28.469854 11545 ts_tablet_manager.cc:1434] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.001s
I20260709 12:12:28.470891 11545 tablet_bootstrap.cc:492] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:28.472445 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e0cc76fe3c414896806d01bdc14d60" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:28.460381 11544 raft_consensus.cc:740] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.475219 11586 raft_consensus.cc:493] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.475847 11586 raft_consensus.cc:515] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.475997 11544 consensus_queue.cc:260] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.476890 11278 raft_consensus.cc:2468] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:28.477882 11586 leader_election.cc:290] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.477994 11544 ts_tablet_manager.cc:1434] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:12:28.479174 11544 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:28.481006 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:28.482435 11464 leader_election.cc:343] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.483664 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
W20260709 12:12:28.485008 11466 leader_election.cc:343] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.485414 11466 leader_election.cc:304] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.486588 11611 raft_consensus.cc:2749] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.487504 11579 raft_consensus.cc:515] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.491963 11276 raft_consensus.cc:3060] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.503775 11544 tablet_bootstrap.cc:654] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.508136 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e0cc76fe3c414896806d01bdc14d60" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:28.508987 11351 raft_consensus.cc:2393] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in this term.
I20260709 12:12:28.510608 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e0cc76fe3c414896806d01bdc14d60" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:28.511658 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5963410c1ae543ee83abf42430c2ac10" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:28.513479 11545 tablet_bootstrap.cc:654] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.521327 11392 leader_election.cc:304] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.511703 11579 leader_election.cc:290] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.522102 11619 consensus_queue.cc:1048] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:28.526423 11542 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:28.532974 11542 ts_tablet_manager.cc:1403] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.186s	user 0.009s	sys 0.005s
I20260709 12:12:28.534986 11276 raft_consensus.cc:2468] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:28.535760 11542 raft_consensus.cc:359] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.536011 11318 leader_election.cc:304] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:28.536455 11542 raft_consensus.cc:385] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.536980 11604 raft_consensus.cc:2804] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.522656 11426 raft_consensus.cc:2393] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 20c40041a85147a0bc5000c1aa44343e in this term.
I20260709 12:12:28.536769 11542 raft_consensus.cc:740] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.543434 11542 consensus_queue.cc:260] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.537535 11604 raft_consensus.cc:697] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:28.545786 11604 consensus_queue.cc:237] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.542259 11553 raft_consensus.cc:2749] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.560537 11175 catalog_manager.cc:5697] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:28.561275 11391 leader_election.cc:343] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.561935 11391 leader_election.cc:304] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:28.562424 11175 catalog_manager.cc:5697] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.565960 11636 raft_consensus.cc:515] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.571512 11579 raft_consensus.cc:2749] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.574708 11619 consensus_queue.cc:1048] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.584102 11173 catalog_manager.cc:5697] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.591238 11542 ts_tablet_manager.cc:1434] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.001s
I20260709 12:12:28.592185 11542 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:28.599874 11546 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:28.599889 11544 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:28.600535 11544 ts_tablet_manager.cc:1403] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.000s
I20260709 12:12:28.600996 11636 leader_election.cc:290] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:28.601750 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c01bb891f44a2990eb8b9b41aa3e1a" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:28.602097 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34c01bb891f44a2990eb8b9b41aa3e1a" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:28.602653 11353 raft_consensus.cc:3060] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.600514 11546 ts_tablet_manager.cc:1403] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.264s	user 0.029s	sys 0.013s
I20260709 12:12:28.605340 11545 tablet_bootstrap.cc:492] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:28.605722 11545 ts_tablet_manager.cc:1403] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.001s
I20260709 12:12:28.605607 11546 raft_consensus.cc:359] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.606307 11546 raft_consensus.cc:385] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.606578 11546 raft_consensus.cc:740] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.607191 11546 consensus_queue.cc:260] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.607702 11545 raft_consensus.cc:359] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.608325 11545 raft_consensus.cc:385] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.608573 11545 raft_consensus.cc:740] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.608973 11278 raft_consensus.cc:3060] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.609257 11545 consensus_queue.cc:260] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.610080 11353 raft_consensus.cc:2468] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:28.611196 11464 leader_election.cc:304] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:28.611545 11545 ts_tablet_manager.cc:1434] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:28.613880 11542 tablet_bootstrap.cc:654] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.615088 11546 ts_tablet_manager.cc:1434] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:28.613045 11544 raft_consensus.cc:359] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.613356 11636 raft_consensus.cc:2804] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.616439 11636 raft_consensus.cc:697] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:28.615383 11278 raft_consensus.cc:2468] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:28.617327 11546 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:28.623126 11636 consensus_queue.cc:237] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.617918 11545 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:28.627290 11546 tablet_bootstrap.cc:654] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.629916 11545 tablet_bootstrap.cc:654] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.617359 11544 raft_consensus.cc:385] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.632385 11544 raft_consensus.cc:740] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.635185 11544 consensus_queue.cc:260] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.639086 11605 raft_consensus.cc:493] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.639550 11605 raft_consensus.cc:515] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.640125 11544 ts_tablet_manager.cc:1434] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 12:12:28.641044 11544 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:28.643088 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f0383cd364797b2fd1e3a1c3ce300" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.641610 11605 leader_election.cc:290] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.644151 11542 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:28.643703 11278 raft_consensus.cc:2468] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:28.646090 11318 leader_election.cc:304] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:28.646912 11605 raft_consensus.cc:2804] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.647253 11605 raft_consensus.cc:493] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.647576 11605 raft_consensus.cc:3060] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.649551 11545 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:28.650010 11545 ts_tablet_manager.cc:1403] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 12:12:28.647266 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f0383cd364797b2fd1e3a1c3ce300" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.652786 11545 raft_consensus.cc:359] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.653577 11545 raft_consensus.cc:385] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.653576 11426 raft_consensus.cc:2468] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:28.654081 11545 raft_consensus.cc:740] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.654824 11545 consensus_queue.cc:260] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.655166 11353 raft_consensus.cc:3060] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.655121 11544 tablet_bootstrap.cc:654] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.657101 11545 ts_tablet_manager.cc:1434] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:12:28.644955 11542 ts_tablet_manager.cc:1403] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.003s
I20260709 12:12:28.658193 11545 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:28.658830 11605 raft_consensus.cc:515] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.663997 11545 tablet_bootstrap.cc:654] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.663978 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f0383cd364797b2fd1e3a1c3ce300" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:28.666775 11278 raft_consensus.cc:3060] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.652933 11553 raft_consensus.cc:493] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.668612 11553 raft_consensus.cc:515] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.670630 11553 leader_election.cc:290] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:28.671974 11544 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:28.672428 11544 ts_tablet_manager.cc:1403] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.007s
I20260709 12:12:28.672258 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fff2a7419a4b29aa70e7b89e5d734f" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.673640 11278 raft_consensus.cc:2468] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:28.674314 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fff2a7419a4b29aa70e7b89e5d734f" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:28.674752 11318 leader_election.cc:304] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:28.675002 11499 raft_consensus.cc:2468] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.675585 11604 raft_consensus.cc:2804] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.675100 11544 raft_consensus.cc:359] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.676002 11544 raft_consensus.cc:385] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.676347 11544 raft_consensus.cc:740] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.676047 11604 raft_consensus.cc:697] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:28.677124 11544 consensus_queue.cc:260] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.677657 11604 consensus_queue.cc:237] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:28.676172 11392 leader_election.cc:343] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.683533 11391 leader_election.cc:304] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.683955 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e3f0383cd364797b2fd1e3a1c3ce300" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:28.684361 11544 ts_tablet_manager.cc:1434] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:12:28.684644 11426 raft_consensus.cc:3060] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.685325 11544 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:28.686893 11553 raft_consensus.cc:2804] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.687323 11553 raft_consensus.cc:493] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.687645 11553 raft_consensus.cc:3060] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.688372 11608 raft_consensus.cc:493] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.688870 11608 raft_consensus.cc:515] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.690848 11608 leader_election.cc:290] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.691761 11426 raft_consensus.cc:2468] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:28.692283 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddbedffb2a547f09b0683e1b8e90e69" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:28.695169 11605 leader_election.cc:290] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
W20260709 12:12:28.695245 11241 leader_election.cc:343] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.695430 11636 consensus_queue.cc:1048] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.661568 11542 raft_consensus.cc:359] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.696830 11542 raft_consensus.cc:385] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.697674 11542 raft_consensus.cc:740] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.699082 11542 consensus_queue.cc:260] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.699517 11679 raft_consensus.cc:493] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.710237 11679 raft_consensus.cc:515] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.712275 11679 leader_election.cc:290] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:28.705405 11685 consensus_queue.cc:1048] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.713266 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e553b4d23b3451ea8801cd6f0e0ab7f" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.705687 11173 catalog_manager.cc:5697] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.714109 11685 consensus_queue.cc:1048] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.706131 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddbedffb2a547f09b0683e1b8e90e69" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.708237 11638 raft_consensus.cc:493] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.717054 11638 raft_consensus.cc:515] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.719069 11542 ts_tablet_manager.cc:1434] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.000s
I20260709 12:12:28.709571 11544 tablet_bootstrap.cc:654] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.721530 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bec71eba2d41c6929bdff648f3d1a0" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.707609 11174 catalog_manager.cc:5697] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.736161 11542 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
W20260709 12:12:28.723608 11392 leader_election.cc:343] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:28.724453 11244 leader_election.cc:343] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.728823 11636 consensus_queue.cc:1048] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.741731 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91bec71eba2d41c6929bdff648f3d1a0" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.730218 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e553b4d23b3451ea8801cd6f0e0ab7f" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:28.731120 11638 leader_election.cc:290] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.746107 11501 raft_consensus.cc:2468] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:28.744451 11244 leader_election.cc:304] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:28.747786 11391 leader_election.cc:304] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.748028 11608 raft_consensus.cc:2749] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.752993 11679 raft_consensus.cc:2804] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.749163 11545 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:28.749964 11319 leader_election.cc:304] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.753463 11679 raft_consensus.cc:493] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.754033 11545 ts_tablet_manager.cc:1403] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.096s	user 0.038s	sys 0.038s
I20260709 12:12:28.758802 11679 raft_consensus.cc:3060] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.758821 11604 raft_consensus.cc:2749] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:28.761312 11545 raft_consensus.cc:359] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.762020 11545 raft_consensus.cc:385] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.762337 11545 raft_consensus.cc:740] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.763062 11545 consensus_queue.cc:260] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.747136 11546 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:28.764413 11546 ts_tablet_manager.cc:1403] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.149s	user 0.004s	sys 0.011s
I20260709 12:12:28.770569 11545 ts_tablet_manager.cc:1434] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:28.771289 11545 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:28.773034 11553 raft_consensus.cc:515] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.783787 11553 leader_election.cc:290] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:28.785192 11636 raft_consensus.cc:493] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.785642 11636 raft_consensus.cc:515] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.786696 11545 tablet_bootstrap.cc:654] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.787520 11636 leader_election.cc:290] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:28.789027 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
W20260709 12:12:28.790452 11466 leader_election.cc:343] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.793704 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.794010 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fff2a7419a4b29aa70e7b89e5d734f" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:28.794602 11501 raft_consensus.cc:3060] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.796331 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fff2a7419a4b29aa70e7b89e5d734f" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
W20260709 12:12:28.798246 11467 leader_election.cc:343] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.798942 11467 leader_election.cc:304] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.798717 11636 raft_consensus.cc:493] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:28.800644 11392 leader_election.cc:343] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.801906 11586 raft_consensus.cc:2749] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.808362 11636 raft_consensus.cc:515] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.811280 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:28.812914 11464 leader_election.cc:343] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.813946 11636 leader_election.cc:290] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.814950 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
W20260709 12:12:28.816324 11467 leader_election.cc:343] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.816725 11467 leader_election.cc:304] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:28.817802 11636 raft_consensus.cc:2749] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:28.815145 11542 tablet_bootstrap.cc:654] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.818650 11501 raft_consensus.cc:2468] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:28.819720 11391 leader_election.cc:304] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.820830 11553 raft_consensus.cc:2804] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.821278 11553 raft_consensus.cc:697] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:28.821941 11685 consensus_queue.cc:1048] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.822046 11553 consensus_queue.cc:237] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.827215 11546 raft_consensus.cc:359] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.827930 11546 raft_consensus.cc:385] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.828193 11546 raft_consensus.cc:740] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.829836 11546 consensus_queue.cc:260] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.839547 11679 raft_consensus.cc:515] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.845499 11546 ts_tablet_manager.cc:1434] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.081s	user 0.003s	sys 0.003s
I20260709 12:12:28.846400 11546 tablet_bootstrap.cc:492] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:28.851424 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e553b4d23b3451ea8801cd6f0e0ab7f" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:28.851987 11501 raft_consensus.cc:3060] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.863461 11679 leader_election.cc:290] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:28.863592 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e553b4d23b3451ea8801cd6f0e0ab7f" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
W20260709 12:12:28.865370 11392 leader_election.cc:343] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.867933 11501 raft_consensus.cc:2468] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:28.869082 11391 leader_election.cc:304] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:28.869889 11685 raft_consensus.cc:2804] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.870332 11685 raft_consensus.cc:697] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:28.871093 11685 consensus_queue.cc:237] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.873111 11579 consensus_queue.cc:1048] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.874264 11544 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:28.875129 11544 ts_tablet_manager.cc:1403] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.000s
I20260709 12:12:28.878018 11544 raft_consensus.cc:359] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.878990 11544 raft_consensus.cc:385] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.879313 11544 raft_consensus.cc:740] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.880118 11544 consensus_queue.cc:260] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:28.884469 11173 catalog_manager.cc:5697] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.889644 11619 consensus_queue.cc:1048] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.895509 11544 ts_tablet_manager.cc:1434] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.003s
I20260709 12:12:28.896368 11542 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:28.896867 11542 ts_tablet_manager.cc:1403] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.161s	user 0.010s	sys 0.005s
I20260709 12:12:28.896492 11544 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:28.899642 11542 raft_consensus.cc:359] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.900240 11542 raft_consensus.cc:385] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.900631 11542 raft_consensus.cc:740] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.901381 11542 consensus_queue.cc:260] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.903283 11545 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:28.906123 11545 ts_tablet_manager.cc:1403] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.135s	user 0.013s	sys 0.015s
I20260709 12:12:28.912716 11619 consensus_queue.cc:1048] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:28.915381 11544 tablet_bootstrap.cc:654] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.916285 11546 tablet_bootstrap.cc:654] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.919335 11542 ts_tablet_manager.cc:1434] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:12:28.924685 11542 tablet_bootstrap.cc:492] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:28.933403 11611 raft_consensus.cc:493] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.933904 11611 raft_consensus.cc:515] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.934028 11173 catalog_manager.cc:5697] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.931206 11545 raft_consensus.cc:359] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.935204 11545 raft_consensus.cc:385] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.935480 11545 raft_consensus.cc:740] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.937458 11611 leader_election.cc:290] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.939459 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5963410c1ae543ee83abf42430c2ac10" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:28.941180 11464 leader_election.cc:343] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.944108 11545 consensus_queue.cc:260] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
W20260709 12:12:28.943817 11390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 71208.5us
I20260709 12:12:28.941190 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5963410c1ae543ee83abf42430c2ac10" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.945837 11427 raft_consensus.cc:2468] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:28.948978 11467 leader_election.cc:304] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:28.950956 11611 raft_consensus.cc:2804] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.951318 11611 raft_consensus.cc:493] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.951630 11611 raft_consensus.cc:3060] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.953155 11544 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:28.953588 11544 ts_tablet_manager.cc:1403] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.011s
I20260709 12:12:28.955610 11542 tablet_bootstrap.cc:654] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.956447 11545 ts_tablet_manager.cc:1434] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.003s
I20260709 12:12:28.958873 11545 tablet_bootstrap.cc:492] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:28.960304 11544 raft_consensus.cc:359] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.960397 11611 raft_consensus.cc:515] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.960973 11544 raft_consensus.cc:385] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.961277 11544 raft_consensus.cc:740] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.961970 11544 consensus_queue.cc:260] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.963469 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5963410c1ae543ee83abf42430c2ac10" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:28.963915 11544 ts_tablet_manager.cc:1434] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:12:28.964135 11604 raft_consensus.cc:493] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.964876 11544 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:28.964614 11604 raft_consensus.cc:515] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:28.965749 11464 leader_election.cc:343] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:28.966787 11604 leader_election.cc:290] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.967389 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddbedffb2a547f09b0683e1b8e90e69" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:28.967989 11278 raft_consensus.cc:2468] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:28.968293 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddbedffb2a547f09b0683e1b8e90e69" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:28.968441 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5963410c1ae543ee83abf42430c2ac10" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:28.968904 11427 raft_consensus.cc:2468] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:28.969189 11426 raft_consensus.cc:3060] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.969323 11318 leader_election.cc:304] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:28.970592 11604 raft_consensus.cc:2804] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.970937 11604 raft_consensus.cc:493] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.971244 11604 raft_consensus.cc:3060] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.973009 11542 tablet_bootstrap.cc:492] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:28.973459 11542 ts_tablet_manager.cc:1403] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:12:28.974704 11544 tablet_bootstrap.cc:654] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.975983 11542 raft_consensus.cc:359] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.976603 11542 raft_consensus.cc:385] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:28.976884 11542 raft_consensus.cc:740] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:28.977620 11542 consensus_queue.cc:260] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.979934 11542 ts_tablet_manager.cc:1434] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:28.980159 11611 leader_election.cc:290] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.979931 11426 raft_consensus.cc:2468] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:28.981061 11542 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:28.982148 11467 leader_election.cc:304] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:28.983294 11611 raft_consensus.cc:2804] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:28.984331 11611 raft_consensus.cc:697] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:28.985162 11611 consensus_queue.cc:237] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:28.986820 11608 raft_consensus.cc:493] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.987505 11542 tablet_bootstrap.cc:654] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:28.987300 11608 raft_consensus.cc:515] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:28.980167 11604 raft_consensus.cc:515] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:28.990146 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:28.990798 11501 raft_consensus.cc:2468] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:28.991194 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:28.991816 11352 raft_consensus.cc:2468] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:28.992677 11242 leader_election.cc:304] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:28.992930 11604 leader_election.cc:290] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:28.994082 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddbedffb2a547f09b0683e1b8e90e69" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:28.994647 11278 raft_consensus.cc:3060] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:28.996529 11544 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:28.997006 11606 raft_consensus.cc:2804] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:28.997156 11544 ts_tablet_manager.cc:1403] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.012s
I20260709 12:12:28.998775 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddbedffb2a547f09b0683e1b8e90e69" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:28.999434 11426 raft_consensus.cc:3060] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.000202 11544 raft_consensus.cc:359] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.000890 11542 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:29.000890 11544 raft_consensus.cc:385] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.001343 11542 ts_tablet_manager.cc:1403] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.001s
I20260709 12:12:29.001564 11544 raft_consensus.cc:740] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.002475 11544 consensus_queue.cc:260] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.004076 11542 raft_consensus.cc:359] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.004727 11542 raft_consensus.cc:385] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.004997 11542 raft_consensus.cc:740] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.005134 11544 ts_tablet_manager.cc:1434] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:29.005724 11542 consensus_queue.cc:260] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.006103 11544 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:29.007915 11542 ts_tablet_manager.cc:1434] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:29.008771 11542 tablet_bootstrap.cc:492] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:29.008905 11606 raft_consensus.cc:493] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.009415 11606 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.012290 11544 tablet_bootstrap.cc:654] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.016434 11604 raft_consensus.cc:493] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.990653 11608 leader_election.cc:290] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:29.017311 11604 raft_consensus.cc:515] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.027920 11604 leader_election.cc:290] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:29.017861 11552 consensus_queue.cc:1048] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:12:29.029659 11545 tablet_bootstrap.cc:654] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.031262 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
W20260709 12:12:29.032662 11319 leader_election.cc:343] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.033252 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:29.033895 11501 raft_consensus.cc:2468] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:29.018983 11542 tablet_bootstrap.cc:654] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.035250 11317 leader_election.cc:304] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:29.037014 11604 raft_consensus.cc:2804] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.037350 11604 raft_consensus.cc:493] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.037657 11604 raft_consensus.cc:3060] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.022491 11544 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:29.025868 11278 raft_consensus.cc:2468] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:29.037665 11546 tablet_bootstrap.cc:492] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:29.045833 11544 ts_tablet_manager.cc:1403] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.002s
I20260709 12:12:29.046337 11546 ts_tablet_manager.cc:1403] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.200s	user 0.012s	sys 0.000s
I20260709 12:12:29.048460 11544 raft_consensus.cc:359] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.048661 11546 raft_consensus.cc:359] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.049139 11544 raft_consensus.cc:385] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.049283 11546 raft_consensus.cc:385] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.049458 11544 raft_consensus.cc:740] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.016798 11426 raft_consensus.cc:2468] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:29.050170 11546 raft_consensus.cc:740] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.044600 11604 raft_consensus.cc:515] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.050881 11546 consensus_queue.cc:260] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.049489 11318 leader_election.cc:304] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:29.051935 11604 leader_election.cc:290] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:29.052945 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:29.053543 11501 raft_consensus.cc:3060] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.057437 11552 consensus_queue.cc:1048] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.053100 11546 ts_tablet_manager.cc:1434] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:29.058740 11546 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:29.050203 11544 consensus_queue.cc:260] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.062065 11687 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.062471 11544 ts_tablet_manager.cc:1434] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:12:29.063506 11544 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:29.063642 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:29.064206 11426 raft_consensus.cc:3060] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.052474 11604 raft_consensus.cc:2804] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.062534 11687 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.068583 11546 tablet_bootstrap.cc:654] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.020622 11606 raft_consensus.cc:515] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.075934 11426 raft_consensus.cc:2468] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:29.076455 11544 tablet_bootstrap.cc:654] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.075704 11174 catalog_manager.cc:5697] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.067828 11604 raft_consensus.cc:697] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:29.084086 11604 consensus_queue.cc:237] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.086802 11319 leader_election.cc:304] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:29.078502 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:29.087352 11687 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:29.087749 11499 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.091087 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:29.091696 11498 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:29.092882 11242 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:29.095359 11552 raft_consensus.cc:2804] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.095615 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:29.096206 11351 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:29.065902 11501 raft_consensus.cc:2468] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:29.098851 11687 raft_consensus.cc:2804] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.104502 11687 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.104871 11687 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.105137 11606 leader_election.cc:290] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:29.109494 11544 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:29.110009 11544 ts_tablet_manager.cc:1403] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.003s
I20260709 12:12:29.110896 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:29.111465 11351 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.112820 11544 raft_consensus.cc:359] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.113492 11544 raft_consensus.cc:385] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:29.113734 11224 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:29.113811 11544 raft_consensus.cc:740] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.114667 11544 consensus_queue.cc:260] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.100103 11552 raft_consensus.cc:697] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:29.116969 11544 ts_tablet_manager.cc:1434] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:29.117950 11544 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:29.124349 11542 tablet_bootstrap.cc:492] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:29.124833 11542 ts_tablet_manager.cc:1403] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.008s
I20260709 12:12:29.126292 11499 raft_consensus.cc:2468] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:29.127663 11242 leader_election.cc:304] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:29.128183 11544 tablet_bootstrap.cc:654] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.130932 11608 raft_consensus.cc:493] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.129659 11689 raft_consensus.cc:2804] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.129825 11606 raft_consensus.cc:493] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.138393 11606 raft_consensus.cc:515] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.134668 11608 raft_consensus.cc:515] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.142315 11608 leader_election.cc:290] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:29.143736 11545 tablet_bootstrap.cc:492] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:29.144287 11545 ts_tablet_manager.cc:1403] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.186s	user 0.020s	sys 0.024s
I20260709 12:12:29.145732 11606 leader_election.cc:290] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:29.145874 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:29.146849 11545 raft_consensus.cc:359] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.144565 11687 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.145571 11552 consensus_queue.cc:237] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
W20260709 12:12:29.151286 11244 leader_election.cc:343] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.151957 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:29.153151 11501 raft_consensus.cc:2468] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:29.155287 11242 leader_election.cc:304] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:29.155843 11545 raft_consensus.cc:385] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.156301 11545 raft_consensus.cc:740] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.147698 11351 raft_consensus.cc:2468] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:29.159179 11545 consensus_queue.cc:260] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.143718 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e553b4d23b3451ea8801cd6f0e0ab7f" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:29.155860 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e553b4d23b3451ea8801cd6f0e0ab7f" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:29.162863 11499 raft_consensus.cc:2393] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8cd91ce67df74245a4fcfd0c7c799002 in current term 1: Already voted for candidate 20c40041a85147a0bc5000c1aa44343e in this term.
I20260709 12:12:29.168357 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:29.168910 11352 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.169225 11545 ts_tablet_manager.cc:1434] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:12:29.171742 11545 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:29.172467 11687 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:29.175001 11606 raft_consensus.cc:2804] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.174224 11542 raft_consensus.cc:359] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.175895 11542 raft_consensus.cc:385] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.176154 11542 raft_consensus.cc:740] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.175384 11606 raft_consensus.cc:493] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.177878 11606 raft_consensus.cc:3060] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.180363 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:29.180931 11499 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.161964 11689 raft_consensus.cc:697] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:29.184844 11689 consensus_queue.cc:237] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.176702 11542 consensus_queue.cc:260] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.194479 11606 raft_consensus.cc:515] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.195816 11244 leader_election.cc:304] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:29.200742 11687 raft_consensus.cc:3060] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.199488 11611 consensus_queue.cc:1048] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.199681 11732 raft_consensus.cc:493] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.202092 11732 raft_consensus.cc:515] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.204587 11604 consensus_queue.cc:1048] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:12:29.209720 11542 ts_tablet_manager.cc:1434] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
I20260709 12:12:29.210477 11542 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:29.217123 11544 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:29.217582 11544 ts_tablet_manager.cc:1403] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.003s
I20260709 12:12:29.221271 11687 raft_consensus.cc:2749] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:29.222069 11542 tablet_bootstrap.cc:654] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.222344 11172 catalog_manager.cc:5697] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.223682 11544 raft_consensus.cc:359] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.224123 11172 catalog_manager.cc:5697] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.226281 11499 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:29.227566 11242 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:29.228298 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:29.229212 11687 raft_consensus.cc:2804] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.229724 11687 raft_consensus.cc:697] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
W20260709 12:12:29.230242 11244 leader_election.cc:343] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.230516 11687 consensus_queue.cc:237] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.231405 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:29.232079 11501 raft_consensus.cc:2468] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:29.211117 11352 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:29.233260 11242 leader_election.cc:304] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:29.234154 11608 raft_consensus.cc:2804] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.234519 11608 raft_consensus.cc:493] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.227676 11606 leader_election.cc:290] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:29.234902 11544 raft_consensus.cc:385] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.235592 11544 raft_consensus.cc:740] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.239624 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:29.235227 11608 raft_consensus.cc:3060] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.241736 11544 consensus_queue.cc:260] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.233224 11604 consensus_queue.cc:1048] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:12:29.245810 11544 ts_tablet_manager.cc:1434] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:12:29.247910 11545 tablet_bootstrap.cc:654] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.243296 11499 raft_consensus.cc:3060] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.253522 11611 consensus_queue.cc:1048] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.255290 11499 raft_consensus.cc:2468] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:29.255707 11608 raft_consensus.cc:515] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.257436 11242 leader_election.cc:304] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:29.258656 11608 leader_election.cc:290] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:29.259670 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:29.258889 11687 raft_consensus.cc:2804] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.260308 11499 raft_consensus.cc:3060] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.260591 11687 raft_consensus.cc:697] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:29.261902 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:29.261672 11687 consensus_queue.cc:237] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
W20260709 12:12:29.263204 11241 leader_election.cc:343] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.265674 11542 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:29.266213 11542 ts_tablet_manager.cc:1403] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.056s	user 0.004s	sys 0.005s
I20260709 12:12:29.267352 11499 raft_consensus.cc:2468] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:29.269747 11242 leader_election.cc:304] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:29.270632 11689 raft_consensus.cc:2804] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.270885 11546 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:29.271078 11689 raft_consensus.cc:697] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:29.271413 11732 leader_election.cc:290] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:29.272603 11689 consensus_queue.cc:237] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.271318 11546 ts_tablet_manager.cc:1403] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.213s	user 0.012s	sys 0.018s
I20260709 12:12:29.269790 11542 raft_consensus.cc:359] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.280915 11542 raft_consensus.cc:385] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.281204 11542 raft_consensus.cc:740] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.283595 11542 consensus_queue.cc:260] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.284684 11552 raft_consensus.cc:493] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.285171 11552 raft_consensus.cc:515] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.286073 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:29.287118 11552 leader_election.cc:290] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:29.287267 11546 raft_consensus.cc:359] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.288225 11546 raft_consensus.cc:385] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.288527 11546 raft_consensus.cc:740] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
W20260709 12:12:29.288407 11241 leader_election.cc:343] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.289263 11546 consensus_queue.cc:260] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.289343 11544 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:29.293941 11542 ts_tablet_manager.cc:1434] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:12:29.296463 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5963410c1ae543ee83abf42430c2ac10" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:29.297310 11426 raft_consensus.cc:2393] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:29.300745 11546 ts_tablet_manager.cc:1434] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:12:29.304738 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5963410c1ae543ee83abf42430c2ac10" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:29.305281 11542 tablet_bootstrap.cc:492] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:29.323776 11542 tablet_bootstrap.cc:654] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.325531 11546 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:29.320909 11276 raft_consensus.cc:3060] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.321764 11319 leader_election.cc:304] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:29.331272 11552 raft_consensus.cc:3060] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.335872 11546 tablet_bootstrap.cc:654] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.308759 11172 catalog_manager.cc:5697] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.346194 11714 consensus_queue.cc:1048] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.346635 11552 raft_consensus.cc:2749] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:29.357581 11545 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:29.358080 11545 ts_tablet_manager.cc:1403] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.006s
I20260709 12:12:29.360589 11545 raft_consensus.cc:359] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.361241 11545 raft_consensus.cc:385] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.361487 11545 raft_consensus.cc:740] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.362110 11545 consensus_queue.cc:260] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.365406 11685 consensus_queue.cc:1048] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.365803 11544 tablet_bootstrap.cc:654] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.372077 11545 ts_tablet_manager.cc:1434] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:12:29.373090 11545 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:29.378489 11545 tablet_bootstrap.cc:654] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.389241 11542 tablet_bootstrap.cc:492] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:29.389906 11542 ts_tablet_manager.cc:1403] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.008s
I20260709 12:12:29.391486 11546 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:29.391928 11546 ts_tablet_manager.cc:1403] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.006s
I20260709 12:12:29.392442 11542 raft_consensus.cc:359] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.393113 11542 raft_consensus.cc:385] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.393357 11542 raft_consensus.cc:740] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.394054 11542 consensus_queue.cc:260] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.400251 11542 ts_tablet_manager.cc:1434] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:29.401131 11542 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:29.402235 11544 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:29.402730 11544 ts_tablet_manager.cc:1403] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.011s
I20260709 12:12:29.405323 11544 raft_consensus.cc:359] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.407889 11544 raft_consensus.cc:385] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.408237 11544 raft_consensus.cc:740] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.408998 11544 consensus_queue.cc:260] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.410907 11544 ts_tablet_manager.cc:1434] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:29.411839 11544 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:29.413754 11545 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:29.415050 11545 ts_tablet_manager.cc:1403] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 12:12:29.414943 11173 catalog_manager.cc:5697] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.417626 11544 tablet_bootstrap.cc:654] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.417747 11545 raft_consensus.cc:359] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.418387 11545 raft_consensus.cc:385] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.418646 11545 raft_consensus.cc:740] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.419317 11545 consensus_queue.cc:260] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.410248 11546 raft_consensus.cc:359] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.420915 11546 raft_consensus.cc:385] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.421212 11546 raft_consensus.cc:740] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.421911 11546 consensus_queue.cc:260] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.424015 11546 ts_tablet_manager.cc:1434] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:12:29.407228 11542 tablet_bootstrap.cc:654] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.416617 11173 catalog_manager.cc:5697] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.425573 11173 catalog_manager.cc:5697] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.430817 11545 ts_tablet_manager.cc:1434] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:29.431811 11545 tablet_bootstrap.cc:492] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:29.442574 11546 tablet_bootstrap.cc:492] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:29.444643 11604 raft_consensus.cc:493] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.445219 11604 raft_consensus.cc:515] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.447372 11604 leader_election.cc:290] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:29.447763 11553 consensus_queue.cc:1048] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.449587 11546 tablet_bootstrap.cc:654] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.452193 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:29.453130 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:29.454411 11544 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
W20260709 12:12:29.454327 11317 leader_election.cc:343] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.454981 11544 ts_tablet_manager.cc:1403] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.017s
W20260709 12:12:29.456317 11319 leader_election.cc:343] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.456751 11319 leader_election.cc:304] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:29.457149 11636 consensus_queue.cc:1048] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.457444 11545 tablet_bootstrap.cc:654] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.457777 11604 raft_consensus.cc:2749] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:29.463879 11542 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:29.464349 11542 ts_tablet_manager.cc:1403] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.006s
I20260709 12:12:29.467181 11546 tablet_bootstrap.cc:492] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:29.467609 11546 ts_tablet_manager.cc:1403] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.004s
I20260709 12:12:29.467715 11542 raft_consensus.cc:359] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.468422 11542 raft_consensus.cc:385] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.468676 11542 raft_consensus.cc:740] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.469372 11544 raft_consensus.cc:359] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.469343 11542 consensus_queue.cc:260] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.471879 11546 raft_consensus.cc:359] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.472002 11544 raft_consensus.cc:385] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.473068 11544 raft_consensus.cc:740] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.472561 11546 raft_consensus.cc:385] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.473620 11542 ts_tablet_manager.cc:1434] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:29.473978 11546 raft_consensus.cc:740] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.474599 11542 tablet_bootstrap.cc:492] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:29.475181 11546 consensus_queue.cc:260] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.479131 11546 ts_tablet_manager.cc:1434] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:29.482560 11542 tablet_bootstrap.cc:654] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.476099 11544 consensus_queue.cc:260] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.480580 11553 consensus_queue.cc:1048] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.484740 11544 ts_tablet_manager.cc:1434] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.005s
I20260709 12:12:29.486289 11546 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:29.491360 11636 raft_consensus.cc:493] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.491837 11636 raft_consensus.cc:515] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.492583 11546 tablet_bootstrap.cc:654] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.486635 11544 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:29.494227 11586 raft_consensus.cc:493] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.494693 11586 raft_consensus.cc:515] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.495321 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229f7766e18a403594735eac02aebb69" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:29.495991 11275 raft_consensus.cc:2468] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:29.496781 11586 leader_election.cc:290] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:29.497802 11466 leader_election.cc:304] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:29.494239 11636 leader_election.cc:290] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:29.497833 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b90ac113f32492b8af9dee4c36614cd" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:29.498406 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b90ac113f32492b8af9dee4c36614cd" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:29.500164 11426 raft_consensus.cc:2468] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:29.497848 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229f7766e18a403594735eac02aebb69" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
W20260709 12:12:29.500675 11464 leader_election.cc:343] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.500110 11636 raft_consensus.cc:2804] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.509232 11544 tablet_bootstrap.cc:654] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.513211 11636 raft_consensus.cc:493] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.514870 11636 raft_consensus.cc:3060] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.510057 11467 leader_election.cc:304] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:29.522596 11586 raft_consensus.cc:2804] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.530069 11586 raft_consensus.cc:493] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.530375 11586 raft_consensus.cc:3060] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:29.533939 11467 leader_election.cc:343] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.547024 11542 tablet_bootstrap.cc:492] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:29.547490 11542 ts_tablet_manager.cc:1403] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.026s
I20260709 12:12:29.548645 11760 consensus_queue.cc:1048] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.554710 11545 tablet_bootstrap.cc:492] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:29.555142 11545 ts_tablet_manager.cc:1403] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.010s
I20260709 12:12:29.565490 11636 raft_consensus.cc:515] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.567036 11586 raft_consensus.cc:515] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.568107 11545 raft_consensus.cc:359] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.568907 11545 raft_consensus.cc:385] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.569169 11545 raft_consensus.cc:740] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.569936 11545 consensus_queue.cc:260] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.570752 11636 leader_election.cc:290] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:29.571426 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229f7766e18a403594735eac02aebb69" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:29.571914 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b90ac113f32492b8af9dee4c36614cd" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:29.571977 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229f7766e18a403594735eac02aebb69" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:29.572162 11542 raft_consensus.cc:359] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.573508 11542 raft_consensus.cc:385] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.573719 11542 raft_consensus.cc:740] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.574867 11542 consensus_queue.cc:260] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.575951 11352 raft_consensus.cc:3060] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.576998 11542 ts_tablet_manager.cc:1434] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:12:29.577899 11542 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:29.578302 11275 raft_consensus.cc:3060] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.582839 11352 raft_consensus.cc:2468] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
W20260709 12:12:29.583107 11467 leader_election.cc:343] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.583307 11542 tablet_bootstrap.cc:654] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.587587 11545 ts_tablet_manager.cc:1434] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:12:29.588387 11545 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:29.589422 11544 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:29.589802 11544 ts_tablet_manager.cc:1403] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.015s
I20260709 12:12:29.586024 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b90ac113f32492b8af9dee4c36614cd" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:29.585971 11586 leader_election.cc:290] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:29.593377 11426 raft_consensus.cc:3060] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.608273 11545 tablet_bootstrap.cc:654] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.610682 11275 raft_consensus.cc:2468] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:29.612265 11546 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:29.612746 11546 ts_tablet_manager.cc:1403] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.009s
I20260709 12:12:29.613802 11466 leader_election.cc:304] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:29.614753 11604 consensus_queue.cc:1048] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.615552 11464 leader_election.cc:304] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:29.615993 11604 raft_consensus.cc:493] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.616377 11611 raft_consensus.cc:2804] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.616988 11611 raft_consensus.cc:697] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:29.616750 11546 raft_consensus.cc:359] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.617518 11546 raft_consensus.cc:385] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.618268 11761 raft_consensus.cc:2804] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.617792 11546 raft_consensus.cc:740] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.618784 11761 raft_consensus.cc:697] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:29.619277 11546 consensus_queue.cc:260] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.619629 11761 consensus_queue.cc:237] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.621660 11546 ts_tablet_manager.cc:1434] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:29.622639 11546 tablet_bootstrap.cc:492] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:29.622484 11544 raft_consensus.cc:359] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.623184 11544 raft_consensus.cc:385] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.617807 11611 consensus_queue.cc:237] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.623473 11544 raft_consensus.cc:740] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.624128 11544 consensus_queue.cc:260] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.616423 11604 raft_consensus.cc:515] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.635140 11604 leader_election.cc:290] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:29.635823 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b687d036fd54d868cb28b2308d0d689" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:29.636438 11424 raft_consensus.cc:2468] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:29.637674 11319 leader_election.cc:304] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:29.638762 11552 raft_consensus.cc:2804] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.639122 11552 raft_consensus.cc:493] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.639262 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b687d036fd54d868cb28b2308d0d689" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:29.639863 11275 raft_consensus.cc:2468] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:29.639884 11426 raft_consensus.cc:2468] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:29.641747 11544 ts_tablet_manager.cc:1434] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.002s
I20260709 12:12:29.642656 11544 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:29.644901 11552 raft_consensus.cc:3060] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.645939 11638 consensus_queue.cc:1048] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:12:29.666909 11544 tablet_bootstrap.cc:654] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.674436 11638 raft_consensus.cc:493] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.675472 11638 raft_consensus.cc:515] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.676394 11689 consensus_queue.cc:1048] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.677513 11638 leader_election.cc:290] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:29.678658 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:29.680748 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:29.680425 11552 raft_consensus.cc:515] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.698567 11761 raft_consensus.cc:493] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.699019 11761 raft_consensus.cc:515] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.700026 11552 leader_election.cc:290] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:29.701395 11317 leader_election.cc:304] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:29.701759 11761 leader_election.cc:290] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:29.706154 11175 catalog_manager.cc:5697] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.707871 11175 catalog_manager.cc:5697] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.710922 11546 tablet_bootstrap.cc:654] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.711055 11638 raft_consensus.cc:2749] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:29.713167 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b687d036fd54d868cb28b2308d0d689" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:29.715840 11278 raft_consensus.cc:3060] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.713294 11604 consensus_queue.cc:1048] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:29.717273 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:29.722024 11275 raft_consensus.cc:2468] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:29.715396 11542 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:29.723016 11542 ts_tablet_manager.cc:1403] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.145s	user 0.042s	sys 0.022s
I20260709 12:12:29.723428 11466 leader_election.cc:304] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:29.724910 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b687d036fd54d868cb28b2308d0d689" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:29.725476 11426 raft_consensus.cc:3060] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.725958 11542 raft_consensus.cc:359] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.726709 11542 raft_consensus.cc:385] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.727008 11542 raft_consensus.cc:740] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.727679 11542 consensus_queue.cc:260] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.728981 11278 raft_consensus.cc:2468] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:29.729185 11552 consensus_queue.cc:1048] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.735908 11636 raft_consensus.cc:493] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.735805 11761 raft_consensus.cc:2804] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.741735 11761 raft_consensus.cc:493] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.742077 11761 raft_consensus.cc:3060] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.741493 11636 raft_consensus.cc:515] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.746711 11426 raft_consensus.cc:2468] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:29.747169 11636 leader_election.cc:290] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:29.732319 11352 raft_consensus.cc:3060] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.751247 11545 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:29.751706 11545 ts_tablet_manager.cc:1403] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.005s
I20260709 12:12:29.754281 11545 raft_consensus.cc:359] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.757331 11545 raft_consensus.cc:385] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.757617 11545 raft_consensus.cc:740] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.758333 11545 consensus_queue.cc:260] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.762849 11545 ts_tablet_manager.cc:1434] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:12:29.763708 11545 tablet_bootstrap.cc:492] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:29.741479 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:29.765329 11542 ts_tablet_manager.cc:1434] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.042s	user 0.025s	sys 0.012s
I20260709 12:12:29.766233 11542 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:29.770898 11553 raft_consensus.cc:493] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.765635 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:29.771371 11553 raft_consensus.cc:515] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.781390 11608 consensus_queue.cc:1048] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:29.782459 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:29.782850 11319 leader_election.cc:304] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:29.784268 11605 raft_consensus.cc:2804] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.784981 11553 leader_election.cc:290] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:29.788107 11605 raft_consensus.cc:697] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:29.797351 11544 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:29.798509 11544 ts_tablet_manager.cc:1403] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.003s
I20260709 12:12:29.803599 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:29.804229 11351 raft_consensus.cc:2468] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
W20260709 12:12:29.792043 11467 leader_election.cc:343] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.798823 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
W20260709 12:12:29.811579 11464 leader_election.cc:343] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.813596 11604 raft_consensus.cc:493] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.818449 11464 leader_election.cc:304] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:29.819783 11611 raft_consensus.cc:2804] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.820173 11611 raft_consensus.cc:493] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.820500 11611 raft_consensus.cc:3060] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.818599 11604 raft_consensus.cc:515] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.823748 11604 leader_election.cc:290] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:29.824255 11605 consensus_queue.cc:237] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:29.845877 11546 tablet_bootstrap.cc:492] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:29.846387 11546 ts_tablet_manager.cc:1403] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.224s	user 0.015s	sys 0.005s
I20260709 12:12:29.845745 11426 raft_consensus.cc:3060] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.847816 11499 raft_consensus.cc:2393] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 8cd91ce67df74245a4fcfd0c7c799002 in this term.
I20260709 12:12:29.853299 11611 raft_consensus.cc:515] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.856570 11391 leader_election.cc:304] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:29.860491 11546 raft_consensus.cc:359] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.864446 11545 tablet_bootstrap.cc:654] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.865679 11544 raft_consensus.cc:359] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.866732 11546 raft_consensus.cc:385] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.866925 11544 raft_consensus.cc:385] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.867306 11546 raft_consensus.cc:740] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.867324 11544 raft_consensus.cc:740] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.869319 11542 tablet_bootstrap.cc:654] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.868978 11546 consensus_queue.cc:260] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.872676 11579 raft_consensus.cc:2749] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:29.872977 11544 consensus_queue.cc:260] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:29.874459 11544 ts_tablet_manager.cc:1434] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.000s
I20260709 12:12:29.875296 11544 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:29.881465 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:29.882042 11425 raft_consensus.cc:3060] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.878388 11777 consensus_queue.cc:1048] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:12:29.883713 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66055995f9841a4b9356659c6ff082c" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:29.885295 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:29.885905 11352 raft_consensus.cc:3060] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.887641 11546 ts_tablet_manager.cc:1434] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:12:29.891081 11546 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:29.887241 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66055995f9841a4b9356659c6ff082c" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:29.896399 11276 raft_consensus.cc:2468] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:29.888314 11611 leader_election.cc:290] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:29.891724 11608 consensus_queue.cc:1048] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:12:29.892701 11777 consensus_queue.cc:1048] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:12:29.909665 11175 catalog_manager.cc:5697] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.910215 11687 consensus_queue.cc:1048] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:29.916471 11425 raft_consensus.cc:2468] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:29.904982 11761 raft_consensus.cc:515] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
W20260709 12:12:29.905546 11319 leader_election.cc:343] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:29.897886 11780 consensus_queue.cc:1048] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:12:29.926009 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:29.925383 11761 leader_election.cc:290] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:29.923449 11467 leader_election.cc:304] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:29.956115 11611 raft_consensus.cc:2804] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.934362 11276 raft_consensus.cc:3060] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.957612 11611 raft_consensus.cc:697] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:29.958442 11611 consensus_queue.cc:237] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.965294 11545 tablet_bootstrap.cc:492] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:29.965806 11545 ts_tablet_manager.cc:1403] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.202s	user 0.007s	sys 0.008s
I20260709 12:12:29.968217 11545 raft_consensus.cc:359] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.968765 11545 raft_consensus.cc:385] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:29.969120 11545 raft_consensus.cc:740] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:29.969383 11276 raft_consensus.cc:2468] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:29.969857 11545 consensus_queue.cc:260] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:29.970438 11466 leader_election.cc:304] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:29.971273 11636 raft_consensus.cc:2804] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:29.971772 11636 raft_consensus.cc:697] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:29.972033 11545 ts_tablet_manager.cc:1434] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:29.972914 11545 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:29.972570 11636 consensus_queue.cc:237] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:29.948428 11544 tablet_bootstrap.cc:654] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.980469 11545 tablet_bootstrap.cc:654] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.951469 11352 raft_consensus.cc:2468] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:29.933115 11318 leader_election.cc:304] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
W20260709 12:12:29.984259 11318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 72810.1us
I20260709 12:12:29.947674 11546 tablet_bootstrap.cc:654] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:29.984788 11779 raft_consensus.cc:2804] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:29.985231 11779 raft_consensus.cc:493] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.985529 11779 raft_consensus.cc:3060] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:29.995203 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
W20260709 12:12:29.996614 11464 leader_election.cc:343] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:29.997880 11319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:35889, user_credentials={real_user=slave}} blocked reactor thread for 94600.7us
I20260709 12:12:29.999085 11777 consensus_queue.cc:1048] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.011570 11542 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:30.012012 11542 ts_tablet_manager.cc:1403] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.246s	user 0.007s	sys 0.004s
I20260709 12:12:30.018656 11544 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:30.019145 11544 ts_tablet_manager.cc:1403] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.018s
I20260709 12:12:30.018668 11542 raft_consensus.cc:359] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.021589 11542 raft_consensus.cc:385] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.021831 11542 raft_consensus.cc:740] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.024621 11542 consensus_queue.cc:260] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.033361 11546 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:30.034008 11546 ts_tablet_manager.cc:1403] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.008s
I20260709 12:12:30.037170 11544 raft_consensus.cc:359] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.037889 11544 raft_consensus.cc:385] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.038152 11544 raft_consensus.cc:740] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.039888 11544 consensus_queue.cc:260] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.043552 11544 ts_tablet_manager.cc:1434] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:12:30.044013 11542 ts_tablet_manager.cc:1434] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:12:30.047359 11544 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:30.049679 11542 tablet_bootstrap.cc:492] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:30.063057 11546 raft_consensus.cc:359] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.063911 11546 raft_consensus.cc:385] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.064095 11546 raft_consensus.cc:740] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.057811 11779 raft_consensus.cc:515] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.067624 11545 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:30.068089 11545 ts_tablet_manager.cc:1403] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.003s
I20260709 12:12:30.069494 11779 leader_election.cc:290] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.070580 11545 raft_consensus.cc:359] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.071224 11545 raft_consensus.cc:385] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.071468 11545 raft_consensus.cc:740] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.072078 11545 consensus_queue.cc:260] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.073925 11546 consensus_queue.cc:260] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.076251 11545 ts_tablet_manager.cc:1434] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:12:30.077265 11545 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:30.078644 11546 ts_tablet_manager.cc:1434] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.002s
I20260709 12:12:30.079672 11546 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:30.082665 11545 tablet_bootstrap.cc:654] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.084446 11542 tablet_bootstrap.cc:654] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.085191 11546 tablet_bootstrap.cc:654] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.098456 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66055995f9841a4b9356659c6ff082c" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:30.099123 11278 raft_consensus.cc:3060] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.105764 11685 raft_consensus.cc:493] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.106266 11685 raft_consensus.cc:515] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.108204 11685 leader_election.cc:290] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.109592 11611 consensus_queue.cc:1048] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:30.113309 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229f7766e18a403594735eac02aebb69" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.114069 11276 raft_consensus.cc:2393] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:30.121371 11586 raft_consensus.cc:493] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.121872 11586 raft_consensus.cc:515] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.124008 11586 leader_election.cc:290] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:30.126472 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.128600 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229f7766e18a403594735eac02aebb69" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:30.131078 11636 raft_consensus.cc:493] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.138559 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66055995f9841a4b9356659c6ff082c" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:30.131577 11636 raft_consensus.cc:515] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.140951 11391 leader_election.cc:304] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:30.142077 11685 raft_consensus.cc:3060] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.143222 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:30.149271 11174 catalog_manager.cc:5697] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.143383 11636 leader_election.cc:290] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.153491 11174 catalog_manager.cc:5697] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.156247 11685 raft_consensus.cc:2749] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:30.130960 11466 leader_election.cc:343] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:30.162562 11464 leader_election.cc:343] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:30.163300 11789 log.cc:927] Time spent T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:30.163688 11464 leader_election.cc:304] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:30.166420 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6743232edbd4f6997be3eb0f234a8b5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.167095 11276 raft_consensus.cc:2468] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:30.168859 11278 raft_consensus.cc:2468] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:30.169680 11466 leader_election.cc:304] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:30.144438 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6743232edbd4f6997be3eb0f234a8b5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:30.170830 11426 raft_consensus.cc:2468] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:30.175791 11586 raft_consensus.cc:2749] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:30.176523 11586 raft_consensus.cc:2804] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.177843 11586 raft_consensus.cc:493] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.178215 11586 raft_consensus.cc:3060] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.180560 11542 tablet_bootstrap.cc:492] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:30.181545 11542 ts_tablet_manager.cc:1403] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.011s
I20260709 12:12:30.184613 11542 raft_consensus.cc:359] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.185303 11542 raft_consensus.cc:385] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.185557 11542 raft_consensus.cc:740] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.186131 11542 consensus_queue.cc:260] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.197520 11544 tablet_bootstrap.cc:654] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.199523 11542 ts_tablet_manager.cc:1434] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
W20260709 12:12:30.181216 11319 leader_election.cc:343] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.208456 11542 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:30.214745 11318 leader_election.cc:304] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:30.216087 11552 raft_consensus.cc:2804] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:30.216554 11552 raft_consensus.cc:697] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:30.217347 11552 consensus_queue.cc:237] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.220016 11546 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:30.220577 11546 ts_tablet_manager.cc:1403] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.029s
I20260709 12:12:30.228057 11611 consensus_queue.cc:1048] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.236490 11546 raft_consensus.cc:359] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.237128 11546 raft_consensus.cc:385] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.239502 11546 raft_consensus.cc:740] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.239931 11611 consensus_queue.cc:1048] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.243177 11546 consensus_queue.cc:260] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:30.243551 11224 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:30.252127 11546 ts_tablet_manager.cc:1434] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:12:30.253127 11546 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:30.260994 11611 consensus_queue.cc:1048] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:30.262099 11545 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:30.262560 11545 ts_tablet_manager.cc:1403] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.185s	user 0.034s	sys 0.046s
I20260709 12:12:30.260363 11586 raft_consensus.cc:515] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.268678 11545 raft_consensus.cc:359] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.280486 11545 raft_consensus.cc:385] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.280772 11545 raft_consensus.cc:740] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.281401 11545 consensus_queue.cc:260] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.285005 11546 tablet_bootstrap.cc:654] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.285727 11545 ts_tablet_manager.cc:1434] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.005s
I20260709 12:12:30.286633 11545 tablet_bootstrap.cc:492] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:30.306599 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6743232edbd4f6997be3eb0f234a8b5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:30.307170 11275 raft_consensus.cc:3060] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.310189 11586 leader_election.cc:290] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.314237 11542 tablet_bootstrap.cc:654] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.315322 11545 tablet_bootstrap.cc:654] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.310184 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6743232edbd4f6997be3eb0f234a8b5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:30.323302 11426 raft_consensus.cc:3060] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.333048 11426 raft_consensus.cc:2468] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:30.341871 11544 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:30.342417 11544 ts_tablet_manager.cc:1403] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.295s	user 0.008s	sys 0.010s
I20260709 12:12:30.344888 11173 catalog_manager.cc:5697] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.345947 11586 raft_consensus.cc:493] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.346419 11586 raft_consensus.cc:515] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.344825 11467 leader_election.cc:304] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:30.351264 11636 raft_consensus.cc:2804] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:30.351733 11636 raft_consensus.cc:697] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:30.352505 11636 consensus_queue.cc:237] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.353713 11275 raft_consensus.cc:2468] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:30.352507 11586 leader_election.cc:290] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.357265 11546 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:30.357836 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5328e5b3864423ca644295147703ecb" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:30.359320 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5328e5b3864423ca644295147703ecb" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
W20260709 12:12:30.359701 11467 leader_election.cc:343] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.358515 11546 ts_tablet_manager.cc:1403] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.010s
I20260709 12:12:30.360658 11545 tablet_bootstrap.cc:492] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:30.361153 11545 ts_tablet_manager.cc:1403] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.002s
I20260709 12:12:30.361308 11638 consensus_queue.cc:1048] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.363601 11545 raft_consensus.cc:359] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.364288 11545 raft_consensus.cc:385] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.363173 11546 raft_consensus.cc:359] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.358389 11544 raft_consensus.cc:359] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.364995 11546 raft_consensus.cc:385] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.365219 11544 raft_consensus.cc:385] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.365271 11546 raft_consensus.cc:740] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.365623 11544 raft_consensus.cc:740] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.366992 11544 consensus_queue.cc:260] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.364550 11545 raft_consensus.cc:740] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.369331 11546 consensus_queue.cc:260] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.373046 11546 ts_tablet_manager.cc:1434] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:12:30.373888 11546 tablet_bootstrap.cc:492] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:30.368402 11545 consensus_queue.cc:260] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.378348 11545 ts_tablet_manager.cc:1434] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 12:12:30.380577 11552 consensus_queue.cc:1048] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.381567 11545 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:30.387703 11545 tablet_bootstrap.cc:654] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.391886 11761 consensus_queue.cc:1048] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.395362 11586 consensus_queue.cc:1048] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.398310 11545 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:30.398782 11545 ts_tablet_manager.cc:1403] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:12:30.401633 11545 raft_consensus.cc:359] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.402225 11545 raft_consensus.cc:385] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.374481 11278 raft_consensus.cc:2468] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:30.374863 11784 raft_consensus.cc:493] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.403805 11784 raft_consensus.cc:515] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.405841 11784 leader_election.cc:290] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.374399 11544 ts_tablet_manager.cc:1434] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.002s
I20260709 12:12:30.407742 11544 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:30.408502 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:30.409442 11175 catalog_manager.cc:5697] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:30.411806 11241 leader_election.cc:343] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.414189 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:30.414806 11424 raft_consensus.cc:2468] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:30.376377 11542 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:30.416079 11542 ts_tablet_manager.cc:1403] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.209s	user 0.009s	sys 0.006s
I20260709 12:12:30.417879 11244 leader_election.cc:304] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:30.418278 11544 tablet_bootstrap.cc:654] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.426836 11784 raft_consensus.cc:2804] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.427201 11784 raft_consensus.cc:493] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.427515 11784 raft_consensus.cc:3060] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.438359 11466 leader_election.cc:304] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:30.439270 11636 raft_consensus.cc:2804] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.439631 11636 raft_consensus.cc:493] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.439955 11636 raft_consensus.cc:3060] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.458297 11586 raft_consensus.cc:493] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.458784 11586 raft_consensus.cc:515] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.460228 11636 raft_consensus.cc:515] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.491358 11546 tablet_bootstrap.cc:654] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.493140 11636 leader_election.cc:290] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.493989 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5328e5b3864423ca644295147703ecb" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:30.494472 11544 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:30.494969 11544 ts_tablet_manager.cc:1403] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.000s
W20260709 12:12:30.495385 11467 leader_election.cc:343] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:30.496203 11466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 57945.8us
I20260709 12:12:30.500532 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5328e5b3864423ca644295147703ecb" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:30.501101 11277 raft_consensus.cc:3060] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.492960 11638 raft_consensus.cc:493] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.503371 11638 raft_consensus.cc:515] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.402494 11545 raft_consensus.cc:740] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.506119 11545 consensus_queue.cc:260] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.512646 11638 leader_election.cc:290] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.514022 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.514698 11277 raft_consensus.cc:2468] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:30.516014 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:30.518060 11317 leader_election.cc:304] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:30.497785 11544 raft_consensus.cc:359] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.519327 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:30.519722 11544 raft_consensus.cc:385] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.519922 11352 raft_consensus.cc:2468] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:30.518962 11638 raft_consensus.cc:2749] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:30.522742 11464 leader_election.cc:304] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:30.524376 11636 raft_consensus.cc:2804] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.436374 11784 raft_consensus.cc:515] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.526855 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
W20260709 12:12:30.530817 11241 leader_election.cc:343] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.524765 11636 raft_consensus.cc:493] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.535883 11636 raft_consensus.cc:3060] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.540930 11544 raft_consensus.cc:740] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.541743 11544 consensus_queue.cc:260] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.543797 11466 leader_election.cc:304] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:30.544747 11545 ts_tablet_manager.cc:1434] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.146s	user 0.006s	sys 0.001s
I20260709 12:12:30.548394 11784 leader_election.cc:290] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.549444 11545 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:30.550745 11761 raft_consensus.cc:2804] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:30.551291 11761 raft_consensus.cc:697] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:30.552114 11761 consensus_queue.cc:237] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.560518 11544 ts_tablet_manager.cc:1434] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 12:12:30.562178 11544 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:30.562759 11611 raft_consensus.cc:493] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.566565 11611 raft_consensus.cc:515] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.573364 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:30.574698 11464 leader_election.cc:343] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.575619 11611 leader_election.cc:290] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.577427 11352 raft_consensus.cc:3060] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.490975 11542 raft_consensus.cc:359] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.580333 11542 raft_consensus.cc:385] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.580622 11542 raft_consensus.cc:740] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.586280 11545 tablet_bootstrap.cc:654] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.586066 11611 consensus_queue.cc:1048] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.562988 11586 leader_election.cc:290] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.588359 11636 raft_consensus.cc:515] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.589775 11544 tablet_bootstrap.cc:654] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.594861 11636 leader_election.cc:290] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.595494 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:30.596174 11351 raft_consensus.cc:3060] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.589610 11542 consensus_queue.cc:260] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.603161 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:30.603816 11542 ts_tablet_manager.cc:1434] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.187s	user 0.008s	sys 0.006s
I20260709 12:12:30.604676 11542 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:30.605309 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:30.610070 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
W20260709 12:12:30.611662 11467 leader_election.cc:343] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.611737 11176 catalog_manager.cc:5697] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:30.612669 11467 leader_election.cc:343] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.613099 11467 leader_election.cc:304] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
W20260709 12:12:30.614418 11467 leader_election.cc:343] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.625658 11542 tablet_bootstrap.cc:654] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.626600 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:30.627177 11424 raft_consensus.cc:3060] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.641705 11819 raft_consensus.cc:2749] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:30.643378 11819 consensus_queue.cc:1048] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:30.643527 11424 raft_consensus.cc:2468] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:30.655346 11244 leader_election.cc:304] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:30.656416 11784 raft_consensus.cc:2804] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:30.656920 11784 raft_consensus.cc:697] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:30.657706 11784 consensus_queue.cc:237] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.657733 11545 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:30.665520 11544 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:30.666018 11544 ts_tablet_manager.cc:1403] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.014s
I20260709 12:12:30.663661 11545 ts_tablet_manager.cc:1403] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.114s	user 0.006s	sys 0.020s
I20260709 12:12:30.669390 11544 raft_consensus.cc:359] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.670259 11544 raft_consensus.cc:385] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.670696 11544 raft_consensus.cc:740] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.671380 11544 consensus_queue.cc:260] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.677008 11351 raft_consensus.cc:2468] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:30.676525 11176 catalog_manager.cc:5697] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.678304 11464 leader_election.cc:304] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:30.679136 11546 tablet_bootstrap.cc:492] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:30.679541 11636 raft_consensus.cc:2804] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:30.679598 11546 ts_tablet_manager.cc:1403] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.306s	user 0.007s	sys 0.003s
I20260709 12:12:30.680166 11636 raft_consensus.cc:697] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:30.681073 11636 consensus_queue.cc:237] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.682885 11546 raft_consensus.cc:359] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.683511 11546 raft_consensus.cc:385] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.683779 11546 raft_consensus.cc:740] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.679901 11545 raft_consensus.cc:359] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.684900 11545 raft_consensus.cc:385] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.685570 11546 consensus_queue.cc:260] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.685153 11545 raft_consensus.cc:740] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.688221 11545 consensus_queue.cc:260] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.696033 11545 ts_tablet_manager.cc:1434] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:12:30.697311 11545 tablet_bootstrap.cc:492] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:30.698251 11819 raft_consensus.cc:493] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.698725 11819 raft_consensus.cc:515] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.700750 11544 ts_tablet_manager.cc:1434] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
I20260709 12:12:30.700932 11546 ts_tablet_manager.cc:1434] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:12:30.701655 11544 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:30.703025 11819 leader_election.cc:290] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:30.704130 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:30.702049 11546 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
W20260709 12:12:30.705832 11464 leader_election.cc:343] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.707820 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.708678 11542 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:30.709182 11542 ts_tablet_manager.cc:1403] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.017s
W20260709 12:12:30.709182 11466 leader_election.cc:343] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.709795 11466 leader_election.cc:304] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:30.710816 11820 raft_consensus.cc:2749] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:30.711990 11542 raft_consensus.cc:359] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.712639 11542 raft_consensus.cc:385] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.712913 11542 raft_consensus.cc:740] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.713554 11542 consensus_queue.cc:260] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.716095 11542 ts_tablet_manager.cc:1434] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:30.716948 11542 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:30.729426 11544 tablet_bootstrap.cc:654] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.735678 11545 tablet_bootstrap.cc:654] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.736433 11546 tablet_bootstrap.cc:654] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.738289 11542 tablet_bootstrap.cc:654] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.739449 11174 catalog_manager.cc:5697] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.749260 11542 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:30.749747 11542 ts_tablet_manager.cc:1403] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.005s
I20260709 12:12:30.751716 11638 raft_consensus.cc:493] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.752136 11638 raft_consensus.cc:515] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.752406 11542 raft_consensus.cc:359] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.753139 11542 raft_consensus.cc:385] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.753432 11542 raft_consensus.cc:740] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.754447 11638 leader_election.cc:290] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.755918 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:30.756685 11426 raft_consensus.cc:2393] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 8cd91ce67df74245a4fcfd0c7c799002 in this term.
I20260709 12:12:30.757119 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.760222 11544 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:30.758545 11542 consensus_queue.cc:260] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.760293 11545 tablet_bootstrap.cc:492] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:30.760838 11544 ts_tablet_manager.cc:1403] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.059s	user 0.002s	sys 0.010s
I20260709 12:12:30.761266 11545 ts_tablet_manager.cc:1403] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.005s
I20260709 12:12:30.763918 11545 raft_consensus.cc:359] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.764619 11545 raft_consensus.cc:385] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.764925 11545 raft_consensus.cc:740] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.765491 11545 consensus_queue.cc:260] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.758656 11318 leader_election.cc:304] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:30.763847 11544 raft_consensus.cc:359] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.767318 11544 raft_consensus.cc:385] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.767534 11544 raft_consensus.cc:740] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.768056 11544 consensus_queue.cc:260] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.769198 11685 raft_consensus.cc:493] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.769558 11552 raft_consensus.cc:3060] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.772051 11542 ts_tablet_manager.cc:1434] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:12:30.772949 11542 tablet_bootstrap.cc:492] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:30.774281 11545 ts_tablet_manager.cc:1434] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:12:30.775216 11545 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:30.783558 11545 tablet_bootstrap.cc:654] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.769668 11685 raft_consensus.cc:515] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.787573 11544 ts_tablet_manager.cc:1434] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:12:30.788307 11685 leader_election.cc:290] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:30.789120 11552 raft_consensus.cc:2749] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:30.790681 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66055995f9841a4b9356659c6ff082c" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:30.792860 11544 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:30.794039 11546 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:30.794489 11546 ts_tablet_manager.cc:1403] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.093s	user 0.019s	sys 0.005s
I20260709 12:12:30.799108 11552 consensus_queue.cc:1048] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.799889 11542 tablet_bootstrap.cc:654] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.801397 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66055995f9841a4b9356659c6ff082c" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.804100 11392 leader_election.cc:304] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:30.804982 11685 raft_consensus.cc:2749] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:30.805887 11544 tablet_bootstrap.cc:654] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.810401 11546 raft_consensus.cc:359] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.811115 11546 raft_consensus.cc:385] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.811369 11546 raft_consensus.cc:740] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.812001 11546 consensus_queue.cc:260] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.816155 11546 ts_tablet_manager.cc:1434] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:12:30.819113 11552 raft_consensus.cc:493] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.819623 11552 raft_consensus.cc:515] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.820628 11546 tablet_bootstrap.cc:492] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:30.830044 11552 leader_election.cc:290] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.833387 11546 tablet_bootstrap.cc:654] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.833619 11544 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:30.834175 11544 ts_tablet_manager.cc:1403] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.007s
I20260709 12:12:30.834879 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320ba867e2f0452ea522852c10247484" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:30.835345 11424 raft_consensus.cc:3060] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:30.836179 11319 leader_election.cc:343] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.837546 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320ba867e2f0452ea522852c10247484" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.837003 11544 raft_consensus.cc:359] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.838464 11276 raft_consensus.cc:2468] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:30.839732 11544 raft_consensus.cc:385] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.840075 11544 raft_consensus.cc:740] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.841192 11318 leader_election.cc:304] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:30.842635 11552 raft_consensus.cc:2804] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.842998 11552 raft_consensus.cc:493] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.844714 11552 raft_consensus.cc:3060] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.845319 11638 consensus_queue.cc:1048] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.850162 11544 consensus_queue.cc:260] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.853669 11685 raft_consensus.cc:493] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.854183 11685 raft_consensus.cc:515] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.854071 11545 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:30.855278 11545 ts_tablet_manager.cc:1403] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.005s
I20260709 12:12:30.856784 11552 raft_consensus.cc:515] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.858467 11544 ts_tablet_manager.cc:1434] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:12:30.860898 11544 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:30.857173 11685 leader_election.cc:290] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.861330 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5328e5b3864423ca644295147703ecb" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:30.860538 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320ba867e2f0452ea522852c10247484" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:30.865986 11275 raft_consensus.cc:3060] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.869026 11544 tablet_bootstrap.cc:654] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.870225 11542 tablet_bootstrap.cc:492] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:30.870748 11542 ts_tablet_manager.cc:1403] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.008s
I20260709 12:12:30.869555 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5328e5b3864423ca644295147703ecb" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.874094 11276 raft_consensus.cc:2393] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:30.884775 11636 consensus_queue.cc:1048] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:30.888726 11546 tablet_bootstrap.cc:492] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:30.889173 11392 leader_election.cc:304] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:30.889225 11546 ts_tablet_manager.cc:1403] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.011s
I20260709 12:12:30.891331 11714 raft_consensus.cc:3060] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.892900 11546 raft_consensus.cc:359] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.893575 11546 raft_consensus.cc:385] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.893831 11546 raft_consensus.cc:740] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.894440 11546 consensus_queue.cc:260] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.896472 11546 ts_tablet_manager.cc:1434] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:12:30.897315 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320ba867e2f0452ea522852c10247484" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
W20260709 12:12:30.898715 11319 leader_election.cc:343] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.889846 11545 raft_consensus.cc:359] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.899351 11714 raft_consensus.cc:2749] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:30.886409 11552 leader_election.cc:290] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:30.899848 11545 raft_consensus.cc:385] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.900291 11545 raft_consensus.cc:740] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.901042 11545 consensus_queue.cc:260] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.902120 11546 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:30.903860 11545 ts_tablet_manager.cc:1434] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 12:12:30.905000 11545 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:30.905205 11275 raft_consensus.cc:2468] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:30.906440 11318 leader_election.cc:304] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:30.907437 11552 raft_consensus.cc:2804] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:30.907943 11552 raft_consensus.cc:697] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:30.906533 11542 raft_consensus.cc:359] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.908704 11552 consensus_queue.cc:237] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.909364 11542 raft_consensus.cc:385] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.909646 11542 raft_consensus.cc:740] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.910231 11542 consensus_queue.cc:260] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.910874 11545 tablet_bootstrap.cc:654] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.912462 11542 ts_tablet_manager.cc:1434] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 12:12:30.913451 11542 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:30.935716 11544 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:30.935988 11542 tablet_bootstrap.cc:654] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.936203 11544 ts_tablet_manager.cc:1403] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.076s	user 0.022s	sys 0.017s
I20260709 12:12:30.941202 11714 raft_consensus.cc:493] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.941682 11714 raft_consensus.cc:515] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:30.941115 11544 raft_consensus.cc:359] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.942567 11544 raft_consensus.cc:385] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.942936 11544 raft_consensus.cc:740] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.943632 11714 leader_election.cc:290] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:30.943557 11544 consensus_queue.cc:260] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:30.945648 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:30.946275 11500 raft_consensus.cc:2468] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:30.947757 11391 leader_election.cc:304] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:30.948836 11714 raft_consensus.cc:2804] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.949280 11714 raft_consensus.cc:493] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.949954 11714 raft_consensus.cc:3060] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.949198 11820 raft_consensus.cc:493] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.952793 11820 raft_consensus.cc:515] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.954514 11544 ts_tablet_manager.cc:1434] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:12:30.955479 11544 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:30.964468 11545 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:30.965018 11545 ts_tablet_manager.cc:1403] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.006s
I20260709 12:12:30.966007 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:30.961243 11636 consensus_queue.cc:1048] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 12:12:30.967459 11390 leader_election.cc:343] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:30.968210 11545 raft_consensus.cc:359] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.968896 11545 raft_consensus.cc:385] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:30.969161 11545 raft_consensus.cc:740] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:30.961323 11820 leader_election.cc:290] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.971731 11779 raft_consensus.cc:493] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.972211 11779 raft_consensus.cc:515] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:30.974254 11779 leader_election.cc:290] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:30.975872 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:30.976053 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.976544 11499 raft_consensus.cc:2468] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:30.976773 11275 raft_consensus.cc:2468] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:30.977295 11777 raft_consensus.cc:493] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.979290 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c6b4483ba043e6a4a5871e772e01ed" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:30.982196 11174 catalog_manager.cc:5697] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.978739 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c6b4483ba043e6a4a5871e772e01ed" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:30.978883 11318 leader_election.cc:304] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:30.986279 11638 raft_consensus.cc:2804] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:30.986639 11638 raft_consensus.cc:493] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.986960 11638 raft_consensus.cc:3060] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:30.978794 11777 raft_consensus.cc:515] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:30.988796 11777 leader_election.cc:290] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:30.990077 11544 tablet_bootstrap.cc:654] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:30.990486 11277 raft_consensus.cc:2468] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:30.992865 11545 consensus_queue.cc:260] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.005791 11466 leader_election.cc:304] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
W20260709 12:12:31.006368 11467 leader_election.cc:343] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.007287 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c6b4483ba043e6a4a5871e772e01ed" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.009665 11817 raft_consensus.cc:2804] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.010046 11817 raft_consensus.cc:493] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.010368 11817 raft_consensus.cc:3060] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.020915 11545 ts_tablet_manager.cc:1434] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:12:31.018146 11714 raft_consensus.cc:515] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.033870 11545 tablet_bootstrap.cc:492] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:31.020221 11542 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:31.035552 11546 tablet_bootstrap.cc:654] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.035501 11542 ts_tablet_manager.cc:1403] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.021s
W20260709 12:12:31.016352 11244 leader_election.cc:343] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.047510 11819 consensus_queue.cc:1048] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.047910 11685 raft_consensus.cc:493] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.050189 11685 raft_consensus.cc:515] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.053907 11685 leader_election.cc:290] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:31.056308 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:31.022076 11638 raft_consensus.cc:515] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
W20260709 12:12:31.035142 11242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 53142.2us
I20260709 12:12:31.058197 11817 raft_consensus.cc:515] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.070853 11714 leader_election.cc:290] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:31.071631 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c6b4483ba043e6a4a5871e772e01ed" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:31.071864 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:31.058964 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.073932 11351 raft_consensus.cc:2393] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:31.075814 11638 leader_election.cc:290] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:31.078210 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:31.078778 11500 raft_consensus.cc:3060] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.079034 11542 raft_consensus.cc:359] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.079731 11542 raft_consensus.cc:385] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.079974 11542 raft_consensus.cc:740] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.081210 11542 consensus_queue.cc:260] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.082769 11542 ts_tablet_manager.cc:1434] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.047s	user 0.001s	sys 0.004s
I20260709 12:12:31.083688 11542 tablet_bootstrap.cc:492] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
W20260709 12:12:31.089584 11390 leader_election.cc:343] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.101342 11390 leader_election.cc:304] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:31.103241 11499 raft_consensus.cc:2393] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8cd91ce67df74245a4fcfd0c7c799002 in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:31.105289 11850 raft_consensus.cc:3060] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.098376 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:31.108996 11501 raft_consensus.cc:3060] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.113409 11819 raft_consensus.cc:493] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.113893 11819 raft_consensus.cc:515] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.114982 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c6b4483ba043e6a4a5871e772e01ed" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:31.115527 11277 raft_consensus.cc:3060] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.115865 11819 leader_election.cc:290] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:31.103180 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c6b4483ba043e6a4a5871e772e01ed" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:31.101284 11817 leader_election.cc:290] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:31.134230 11545 tablet_bootstrap.cc:654] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:31.131911 11467 leader_election.cc:343] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.128535 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:31.143558 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ca7e153ce4227bb8917fb38574ec5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.148368 11277 raft_consensus.cc:2468] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:31.145175 11276 raft_consensus.cc:3060] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.145066 11817 raft_consensus.cc:493] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.154224 11542 tablet_bootstrap.cc:654] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.155774 11501 raft_consensus.cc:2468] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:31.160120 11546 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:31.160607 11546 ts_tablet_manager.cc:1403] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.260s	user 0.016s	sys 0.024s
I20260709 12:12:31.162000 11544 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:31.163388 11546 raft_consensus.cc:359] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.164296 11848 consensus_queue.cc:1048] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.166440 11544 ts_tablet_manager.cc:1403] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.211s	user 0.022s	sys 0.006s
I20260709 12:12:31.167517 11546 raft_consensus.cc:385] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.167955 11546 raft_consensus.cc:740] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.165643 11466 leader_election.cc:304] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:31.168788 11636 raft_consensus.cc:2804] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.169387 11636 raft_consensus.cc:697] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:31.170158 11636 consensus_queue.cc:237] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.158962 11638 raft_consensus.cc:493] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.168900 11546 consensus_queue.cc:260] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.173754 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ca7e153ce4227bb8917fb38574ec5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.174276 11391 leader_election.cc:304] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:31.175117 11854 raft_consensus.cc:2804] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.175812 11854 raft_consensus.cc:697] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:31.178099 11854 consensus_queue.cc:237] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.157267 11242 leader_election.cc:304] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:31.181371 11848 raft_consensus.cc:2749] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.172425 11638 raft_consensus.cc:515] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.183631 11638 leader_election.cc:290] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
W20260709 12:12:31.178309 11467 leader_election.cc:343] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.157857 11350 raft_consensus.cc:2468] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:31.186872 11464 leader_election.cc:304] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:31.187736 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:31.188414 11278 raft_consensus.cc:2468] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:31.189257 11819 raft_consensus.cc:2804] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.189700 11819 raft_consensus.cc:493] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.190416 11850 raft_consensus.cc:2749] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.190084 11819 raft_consensus.cc:3060] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.191285 11318 leader_election.cc:304] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:31.158619 11817 raft_consensus.cc:515] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.193540 11552 raft_consensus.cc:2804] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.193931 11552 raft_consensus.cc:493] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.194254 11552 raft_consensus.cc:3060] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.194669 11817 leader_election.cc:290] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:31.196273 11500 raft_consensus.cc:2468] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:31.197042 11546 ts_tablet_manager.cc:1434] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:12:31.197633 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:31.198047 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3531bc235ff4e12b0d7be22a7b2d978" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.198426 11546 tablet_bootstrap.cc:492] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:31.198335 11501 raft_consensus.cc:2468] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:31.211463 11848 consensus_queue.cc:1048] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:31.200418 11464 leader_election.cc:343] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.202107 11544 raft_consensus.cc:359] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.217026 11544 raft_consensus.cc:385] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.218106 11544 raft_consensus.cc:740] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.205982 11817 consensus_queue.cc:1048] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.200233 11819 raft_consensus.cc:515] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.225349 11544 consensus_queue.cc:260] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.229306 11544 ts_tablet_manager.cc:1434] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.002s
I20260709 12:12:31.224243 11317 leader_election.cc:304] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:31.232040 11638 raft_consensus.cc:2804] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.232188 11276 raft_consensus.cc:2468] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:31.232573 11638 raft_consensus.cc:697] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:31.233619 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3531bc235ff4e12b0d7be22a7b2d978" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:31.233464 11638 consensus_queue.cc:237] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.234227 11278 raft_consensus.cc:2468] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:31.235114 11820 consensus_queue.cc:1048] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.236495 11552 raft_consensus.cc:515] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.238874 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ca7e153ce4227bb8917fb38574ec5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:31.239440 11350 raft_consensus.cc:3060] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.243196 11546 tablet_bootstrap.cc:654] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.243975 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:31.244539 11500 raft_consensus.cc:3060] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.248001 11466 leader_election.cc:304] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:31.249089 11855 raft_consensus.cc:2804] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.249464 11855 raft_consensus.cc:493] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.249789 11855 raft_consensus.cc:3060] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.253365 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ca7e153ce4227bb8917fb38574ec5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
W20260709 12:12:31.255825 11467 leader_election.cc:343] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.256500 11545 tablet_bootstrap.cc:492] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:31.254465 11819 leader_election.cc:290] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:31.256510 11817 raft_consensus.cc:493] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.257460 11817 raft_consensus.cc:515] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.259411 11545 ts_tablet_manager.cc:1403] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.226s	user 0.018s	sys 0.003s
I20260709 12:12:31.263042 11544 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:31.257668 11350 raft_consensus.cc:2468] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:31.269297 11552 leader_election.cc:290] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:31.286339 11464 leader_election.cc:304] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:31.266275 11500 raft_consensus.cc:2468] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:31.292672 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:31.295058 11173 catalog_manager.cc:5697] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:31.296590 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:31.277480 11817 leader_election.cc:290] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:31.296730 11819 raft_consensus.cc:2804] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.299305 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.300171 11542 tablet_bootstrap.cc:492] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:31.301815 11542 ts_tablet_manager.cc:1403] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.218s	user 0.013s	sys 0.006s
W20260709 12:12:31.303200 11466 leader_election.cc:343] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.297281 11276 raft_consensus.cc:3060] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.302067 11819 raft_consensus.cc:697] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:31.314976 11545 raft_consensus.cc:359] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.317878 11552 consensus_queue.cc:1048] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.321522 11545 raft_consensus.cc:385] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.321871 11545 raft_consensus.cc:740] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.322547 11545 consensus_queue.cc:260] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.319841 11175 catalog_manager.cc:5697] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.288224 11855 raft_consensus.cc:515] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.332404 11545 ts_tablet_manager.cc:1434] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 12:12:31.328377 11777 raft_consensus.cc:493] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.335438 11777 raft_consensus.cc:515] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.344051 11544 tablet_bootstrap.cc:654] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.345196 11317 leader_election.cc:304] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:31.345495 11819 consensus_queue.cc:237] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.347675 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.348413 11777 leader_election.cc:290] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:31.354965 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
W20260709 12:12:31.358462 11244 leader_election.cc:343] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.360016 11276 raft_consensus.cc:2468] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:31.363286 11855 leader_election.cc:290] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:31.367183 11552 raft_consensus.cc:2804] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.367687 11552 raft_consensus.cc:697] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:31.368419 11552 consensus_queue.cc:237] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
W20260709 12:12:31.372932 11241 leader_election.cc:343] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.373411 11241 leader_election.cc:304] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:31.374164 11777 raft_consensus.cc:2749] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.386494 11546 tablet_bootstrap.cc:492] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:31.387023 11546 ts_tablet_manager.cc:1403] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.189s	user 0.020s	sys 0.006s
W20260709 12:12:31.391898 11319 consensus_peers.cc:597] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:31.395367 11849 raft_consensus.cc:493] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.395841 11849 raft_consensus.cc:515] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.397862 11849 leader_election.cc:290] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:31.399641 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c6b4483ba043e6a4a5871e772e01ed" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:31.403944 11546 raft_consensus.cc:359] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.408512 11546 raft_consensus.cc:385] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.408829 11546 raft_consensus.cc:740] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.409492 11546 consensus_queue.cc:260] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.413273 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c6b4483ba043e6a4a5871e772e01ed" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:31.415633 11278 raft_consensus.cc:2393] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:31.417085 11392 leader_election.cc:304] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:31.418184 11849 raft_consensus.cc:3060] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:31.403067 11467 leader_election.cc:343] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.420074 11467 leader_election.cc:304] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:31.420953 11817 raft_consensus.cc:2749] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.424387 11546 ts_tablet_manager.cc:1434] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
W20260709 12:12:31.404318 11464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 74352.1us
I20260709 12:12:31.426249 11817 consensus_queue.cc:1048] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.426331 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3531bc235ff4e12b0d7be22a7b2d978" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:31.414537 11545 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
W20260709 12:12:31.428251 11464 leader_election.cc:343] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.380062 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3531bc235ff4e12b0d7be22a7b2d978" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:31.434219 11546 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:31.435398 11276 raft_consensus.cc:3060] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.448518 11849 raft_consensus.cc:2749] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.454614 11174 catalog_manager.cc:5697] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.457005 11544 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:31.457456 11544 ts_tablet_manager.cc:1403] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.198s	user 0.036s	sys 0.016s
I20260709 12:12:31.458551 11545 tablet_bootstrap.cc:654] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.458894 11542 raft_consensus.cc:359] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.459583 11542 raft_consensus.cc:385] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.459898 11542 raft_consensus.cc:740] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.459918 11544 raft_consensus.cc:359] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.461422 11544 raft_consensus.cc:385] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.461684 11544 raft_consensus.cc:740] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.462425 11544 consensus_queue.cc:260] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.469887 11276 raft_consensus.cc:2468] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:31.470968 11466 leader_election.cc:304] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:31.472007 11867 raft_consensus.cc:2804] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.472447 11867 raft_consensus.cc:697] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:31.473587 11544 ts_tablet_manager.cc:1434] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:12:31.473188 11867 consensus_queue.cc:237] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.475764 11544 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:31.480796 11542 consensus_queue.cc:260] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
W20260709 12:12:31.482438 11224 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:31.482152 11545 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:31.484164 11545 ts_tablet_manager.cc:1403] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.007s
I20260709 12:12:31.483096 11544 tablet_bootstrap.cc:654] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.485414 11542 ts_tablet_manager.cc:1434] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.183s	user 0.003s	sys 0.003s
I20260709 12:12:31.486373 11542 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:31.487223 11546 tablet_bootstrap.cc:654] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.491608 11545 raft_consensus.cc:359] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.492339 11542 tablet_bootstrap.cc:654] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.492316 11545 raft_consensus.cc:385] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.493872 11545 raft_consensus.cc:740] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.494521 11545 consensus_queue.cc:260] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.499534 11545 ts_tablet_manager.cc:1434] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 12:12:31.500536 11545 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:31.498998 11176 catalog_manager.cc:5697] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:31.514400 11544 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:31.514853 11544 ts_tablet_manager.cc:1403] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.003s
I20260709 12:12:31.518613 11545 tablet_bootstrap.cc:654] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.517328 11544 raft_consensus.cc:359] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.522526 11544 raft_consensus.cc:385] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.522835 11544 raft_consensus.cc:740] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.523793 11544 consensus_queue.cc:260] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.525861 11544 ts_tablet_manager.cc:1434] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:12:31.526943 11544 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:31.521404 11546 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:31.527595 11546 ts_tablet_manager.cc:1403] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.006s
I20260709 12:12:31.530038 11546 raft_consensus.cc:359] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.530622 11546 raft_consensus.cc:385] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.530880 11546 raft_consensus.cc:740] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.531080 11175 catalog_manager.cc:5697] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:31.532653 11175 catalog_manager.cc:5697] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.533860 11542 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:31.538072 11542 ts_tablet_manager.cc:1403] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 12:12:31.531455 11546 consensus_queue.cc:260] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.541932 11545 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:31.542378 11545 ts_tablet_manager.cc:1403] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 12:12:31.542373 11546 ts_tablet_manager.cc:1434] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:31.540647 11542 raft_consensus.cc:359] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.545971 11546 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:31.545892 11542 raft_consensus.cc:385] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.546502 11542 raft_consensus.cc:740] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.547400 11542 consensus_queue.cc:260] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.549659 11542 ts_tablet_manager.cc:1434] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:12:31.545133 11544 tablet_bootstrap.cc:654] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.551978 11542 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:31.544879 11545 raft_consensus.cc:359] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.558168 11545 raft_consensus.cc:385] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.558430 11545 raft_consensus.cc:740] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.564368 11545 consensus_queue.cc:260] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.566361 11545 ts_tablet_manager.cc:1434] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:12:31.567971 11545 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:31.569165 11542 tablet_bootstrap.cc:654] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.567101 11546 tablet_bootstrap.cc:654] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.573248 11545 tablet_bootstrap.cc:654] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.574508 11544 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:31.575001 11544 ts_tablet_manager.cc:1403] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.002s
I20260709 12:12:31.577507 11544 raft_consensus.cc:359] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.578168 11544 raft_consensus.cc:385] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.578467 11544 raft_consensus.cc:740] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.579335 11544 consensus_queue.cc:260] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.581279 11544 ts_tablet_manager.cc:1434] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:31.583470 11542 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:31.584851 11542 ts_tablet_manager.cc:1403] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:12:31.585291 11545 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:31.585736 11545 ts_tablet_manager.cc:1403] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 12:12:31.587286 11542 raft_consensus.cc:359] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.587939 11542 raft_consensus.cc:385] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.588187 11542 raft_consensus.cc:740] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.588531 11545 raft_consensus.cc:359] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.588773 11542 consensus_queue.cc:260] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.589180 11545 raft_consensus.cc:385] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.589582 11545 raft_consensus.cc:740] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.590260 11545 consensus_queue.cc:260] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.590860 11542 ts_tablet_manager.cc:1434] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:31.591104 11546 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:31.598423 11546 ts_tablet_manager.cc:1403] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.006s
I20260709 12:12:31.599809 11545 ts_tablet_manager.cc:1434] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:12:31.600742 11545 tablet_bootstrap.cc:492] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:31.595027 11542 tablet_bootstrap.cc:492] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:31.591528 11544 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:31.606485 11544 tablet_bootstrap.cc:654] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.601032 11546 raft_consensus.cc:359] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.616995 11544 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:31.617242 11545 tablet_bootstrap.cc:654] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.617421 11544 ts_tablet_manager.cc:1403] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.003s
I20260709 12:12:31.616569 11546 raft_consensus.cc:385] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.618953 11546 raft_consensus.cc:740] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.619992 11544 raft_consensus.cc:359] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.620621 11544 raft_consensus.cc:385] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.620761 11542 tablet_bootstrap.cc:654] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.619730 11546 consensus_queue.cc:260] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.620949 11544 raft_consensus.cc:740] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.621815 11544 consensus_queue.cc:260] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.623879 11544 ts_tablet_manager.cc:1434] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:31.624717 11544 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:31.626231 11777 raft_consensus.cc:493] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.626691 11777 raft_consensus.cc:515] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.628782 11777 leader_election.cc:290] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:31.633296 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.629791 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:31.634263 11500 raft_consensus.cc:2468] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:31.634524 11542 tablet_bootstrap.cc:492] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:31.634985 11542 ts_tablet_manager.cc:1403] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.007s
W20260709 12:12:31.634910 11244 leader_election.cc:343] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.633780 11545 tablet_bootstrap.cc:492] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:31.633107 11352 raft_consensus.cc:3060] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.635730 11242 leader_election.cc:304] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:31.637621 11542 raft_consensus.cc:359] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.638252 11542 raft_consensus.cc:385] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.638494 11542 raft_consensus.cc:740] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.639096 11542 consensus_queue.cc:260] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.632035 11544 tablet_bootstrap.cc:654] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.635746 11545 ts_tablet_manager.cc:1403] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.002s
I20260709 12:12:31.645299 11542 ts_tablet_manager.cc:1434] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:31.646162 11542 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:31.644188 11546 ts_tablet_manager.cc:1434] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
I20260709 12:12:31.653728 11817 raft_consensus.cc:493] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.654232 11817 raft_consensus.cc:515] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.659405 11817 leader_election.cc:290] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:31.659822 11849 consensus_queue.cc:1048] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.662930 11848 raft_consensus.cc:2804] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.663362 11848 raft_consensus.cc:493] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.663687 11848 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.664371 11546 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:31.665575 11867 consensus_queue.cc:1048] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.654386 11545 raft_consensus.cc:359] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.669860 11545 raft_consensus.cc:385] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.670130 11545 raft_consensus.cc:740] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.670900 11545 consensus_queue.cc:260] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.672943 11545 ts_tablet_manager.cc:1434] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:12:31.673867 11545 tablet_bootstrap.cc:492] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:31.677511 11546 tablet_bootstrap.cc:654] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.678133 11817 raft_consensus.cc:493] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.678646 11817 raft_consensus.cc:515] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.679481 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.680130 11352 raft_consensus.cc:2468] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:31.682655 11545 tablet_bootstrap.cc:654] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.687247 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969c64b986d444c19757cf5ce94bb8bc" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:31.687880 11278 raft_consensus.cc:2468] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:31.689821 11546 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:31.690276 11546 ts_tablet_manager.cc:1403] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:12:31.691118 11466 leader_election.cc:304] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:31.691987 11819 raft_consensus.cc:2804] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.692327 11819 raft_consensus.cc:493] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.692628 11819 raft_consensus.cc:3060] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.693023 11546 raft_consensus.cc:359] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.693647 11546 raft_consensus.cc:385] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.693887 11546 raft_consensus.cc:740] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.694448 11546 consensus_queue.cc:260] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.696973 11545 tablet_bootstrap.cc:492] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:31.697414 11545 ts_tablet_manager.cc:1403] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:12:31.699812 11545 raft_consensus.cc:359] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.700413 11545 raft_consensus.cc:385] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.700639 11867 raft_consensus.cc:493] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.701110 11867 raft_consensus.cc:515] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.703334 11867 leader_election.cc:290] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:31.705272 11819 raft_consensus.cc:515] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.708370 11817 leader_election.cc:290] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:31.710434 11817 raft_consensus.cc:493] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.713425 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68a9fb3e63a45119c4c6ebf7623679d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.712606 11464 leader_election.cc:304] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:31.715600 11866 raft_consensus.cc:2804] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.715986 11866 raft_consensus.cc:493] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.716135 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.710969 11819 leader_election.cc:290] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:31.716380 11866 raft_consensus.cc:3060] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.717147 11817 raft_consensus.cc:515] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.720146 11277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
W20260709 12:12:31.721484 11466 leader_election.cc:343] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.722102 11546 ts_tablet_manager.cc:1434] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:12:31.710306 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68a9fb3e63a45119c4c6ebf7623679d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.724407 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969c64b986d444c19757cf5ce94bb8bc" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.726122 11544 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:31.726689 11544 ts_tablet_manager.cc:1403] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.102s	user 0.040s	sys 0.032s
W20260709 12:12:31.731827 11467 leader_election.cc:343] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.732283 11542 tablet_bootstrap.cc:654] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.730278 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969c64b986d444c19757cf5ce94bb8bc" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
W20260709 12:12:31.732791 11467 leader_election.cc:343] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.733204 11278 raft_consensus.cc:3060] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.733772 11685 consensus_queue.cc:1048] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.735371 11817 leader_election.cc:290] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:31.735916 11840 consensus_queue.cc:1048] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.730177 11544 raft_consensus.cc:359] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.736723 11544 raft_consensus.cc:385] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.737910 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969c64b986d444c19757cf5ce94bb8bc" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:31.738343 11544 raft_consensus.cc:740] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
W20260709 12:12:31.739248 11464 leader_election.cc:343] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.739140 11544 consensus_queue.cc:260] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.739753 11546 tablet_bootstrap.cc:492] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:31.739714 11464 leader_election.cc:304] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:31.742094 11820 raft_consensus.cc:2749] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:31.742468 11464 leader_election.cc:343] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.735266 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
W20260709 12:12:31.743331 11464 leader_election.cc:343] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.747572 11866 raft_consensus.cc:515] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.748037 11544 ts_tablet_manager.cc:1434] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:12:31.762363 11544 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
W20260709 12:12:31.749575 11467 leader_election.cc:343] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.764017 11467 leader_election.cc:304] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:31.764828 11867 raft_consensus.cc:2749] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.765617 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:31.766332 11350 raft_consensus.cc:3060] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.767459 11544 tablet_bootstrap.cc:654] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.769829 11542 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:31.770272 11542 ts_tablet_manager.cc:1403] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.006s
I20260709 12:12:31.773504 11350 raft_consensus.cc:2468] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:31.774554 11464 leader_election.cc:304] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:31.774766 11685 raft_consensus.cc:493] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.775321 11685 raft_consensus.cc:515] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.775959 11866 leader_election.cc:290] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:31.777272 11278 raft_consensus.cc:2468] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:31.778028 11685 leader_election.cc:290] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:31.781611 11820 consensus_queue.cc:1048] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.782454 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ca7e153ce4227bb8917fb38574ec5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.783197 11350 raft_consensus.cc:2393] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:31.783107 11820 raft_consensus.cc:2804] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.783937 11820 raft_consensus.cc:697] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:31.781483 11542 raft_consensus.cc:359] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.785209 11542 raft_consensus.cc:385] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.755661 11546 tablet_bootstrap.cc:654] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.759624 11424 raft_consensus.cc:3060] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.700655 11545 raft_consensus.cc:740] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.784986 11820 consensus_queue.cc:237] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.750592 11848 raft_consensus.cc:515] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.787544 11542 raft_consensus.cc:740] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.788766 11545 consensus_queue.cc:260] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.792259 11466 leader_election.cc:304] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:31.795944 11542 consensus_queue.cc:260] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.797159 11545 ts_tablet_manager.cc:1434] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 12:12:31.798125 11545 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:31.800302 11542 ts_tablet_manager.cc:1434] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:12:31.802594 11542 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:31.805053 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:31.809516 11866 raft_consensus.cc:2804] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.810907 11840 raft_consensus.cc:493] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.821071 11777 raft_consensus.cc:493] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.825102 11777 raft_consensus.cc:515] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.827075 11777 leader_election.cc:290] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:31.827605 11840 raft_consensus.cc:515] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.830170 11848 leader_election.cc:290] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:31.830637 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7182aba132c4c0c8c8d9a45d8a2b978" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.831456 11840 leader_election.cc:290] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
W20260709 12:12:31.833190 11241 leader_election.cc:343] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.833794 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40b4b0fb044dd893a3a58ce7749e98" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:31.834358 11278 raft_consensus.cc:2468] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:31.835513 11318 leader_election.cc:304] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:31.839491 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:31.840078 11605 raft_consensus.cc:2804] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.840272 11501 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.840483 11605 raft_consensus.cc:493] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.841528 11423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40b4b0fb044dd893a3a58ce7749e98" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.841902 11605 raft_consensus.cc:3060] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.843341 11499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac6ca7e153ce4227bb8917fb38574ec5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:31.844702 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
W20260709 12:12:31.845108 11319 leader_election.cc:343] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.840493 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7182aba132c4c0c8c8d9a45d8a2b978" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.846912 11777 raft_consensus.cc:493] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:31.847877 11244 leader_election.cc:343] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.849305 11425 raft_consensus.cc:3060] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.850543 11777 raft_consensus.cc:515] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.863363 11542 tablet_bootstrap.cc:654] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.864220 11777 leader_election.cc:290] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:31.847538 11391 leader_election.cc:304] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28
W20260709 12:12:31.853935 11244 leader_election.cc:343] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:31.845301 11467 leader_election.cc:343] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.866750 11244 leader_election.cc:304] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:31.867012 11544 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:31.867594 11544 ts_tablet_manager.cc:1403] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.028s
I20260709 12:12:31.868489 11844 raft_consensus.cc:2749] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.868829 11552 consensus_queue.cc:1048] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.870499 11544 raft_consensus.cc:359] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.872538 11546 tablet_bootstrap.cc:492] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:31.873466 11546 ts_tablet_manager.cc:1403] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.003s
I20260709 12:12:31.874650 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:31.877601 11500 raft_consensus.cc:2468] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:31.858029 11866 raft_consensus.cc:697] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:31.882396 11817 consensus_queue.cc:1048] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.883441 11866 consensus_queue.cc:237] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:31.884284 11544 raft_consensus.cc:385] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.884624 11544 raft_consensus.cc:740] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.885298 11544 consensus_queue.cc:260] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.886266 11242 leader_election.cc:304] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:31.887513 11777 raft_consensus.cc:2804] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:31.887866 11777 raft_consensus.cc:493] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.888196 11777 raft_consensus.cc:3060] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.876698 11605 raft_consensus.cc:515] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.876267 11546 raft_consensus.cc:359] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.891691 11546 raft_consensus.cc:385] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:31.891973 11546 raft_consensus.cc:740] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:31.892793 11546 consensus_queue.cc:260] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:31.893115 11846 raft_consensus.cc:493] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.895308 11546 ts_tablet_manager.cc:1434] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:12:31.893306 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:31.896231 11546 tablet_bootstrap.cc:492] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:31.896250 11427 raft_consensus.cc:2468] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:31.893651 11846 raft_consensus.cc:515] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.900750 11545 tablet_bootstrap.cc:654] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.907778 11501 raft_consensus.cc:2468] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:31.911221 11840 consensus_queue.cc:1048] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.911669 11351 raft_consensus.cc:3060] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.913395 11242 leader_election.cc:304] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:31.914494 11848 raft_consensus.cc:2804] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.915531 11848 raft_consensus.cc:697] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:31.916304 11848 consensus_queue.cc:237] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.916692 11685 raft_consensus.cc:2749] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:31.920022 11777 raft_consensus.cc:515] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:31.911638 11544 ts_tablet_manager.cc:1434] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:12:31.955590 11544 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:31.957194 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40b4b0fb044dd893a3a58ce7749e98" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:31.957767 11278 raft_consensus.cc:3060] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.958101 11175 catalog_manager.cc:5697] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:31.964324 11867 consensus_queue.cc:1048] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.968670 11866 consensus_queue.cc:1048] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:31.967981 11278 raft_consensus.cc:2468] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:31.973800 11318 leader_election.cc:304] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:31.979712 11849 raft_consensus.cc:493] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.980914 11849 raft_consensus.cc:515] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:31.982858 11849 leader_election.cc:290] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:31.983973 11777 leader_election.cc:290] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:31.978938 11840 raft_consensus.cc:2804] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:31.985252 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:31.985731 11840 raft_consensus.cc:697] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:31.985881 11500 raft_consensus.cc:3060] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.986029 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40b4b0fb044dd893a3a58ce7749e98" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:31.986403 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:31.986681 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:31.986974 11278 raft_consensus.cc:2468] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:31.987318 11352 raft_consensus.cc:2468] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:31.982877 11544 tablet_bootstrap.cc:654] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.990622 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:31.991427 11426 raft_consensus.cc:3060] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:31.974973 11605 leader_election.cc:290] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:32.000393 11390 leader_election.cc:304] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:32.000898 11846 leader_election.cc:290] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:31.999130 11638 consensus_queue.cc:1048] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:32.003189 11849 raft_consensus.cc:2804] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:32.003592 11849 raft_consensus.cc:493] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.003913 11849 raft_consensus.cc:3060] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.004370 11546 tablet_bootstrap.cc:654] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:31.979017 11866 consensus_queue.cc:1048] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:12:32.005961 11500 raft_consensus.cc:2468] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:32.008203 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:32.009107 11242 leader_election.cc:304] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:32.010460 11545 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:32.010959 11545 ts_tablet_manager.cc:1403] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.213s	user 0.011s	sys 0.000s
I20260709 12:12:32.013288 11819 raft_consensus.cc:493] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.013770 11819 raft_consensus.cc:515] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.014515 11545 raft_consensus.cc:359] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.014876 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:32.015650 11819 leader_election.cc:290] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
W20260709 12:12:32.016929 11319 leader_election.cc:343] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:31.988057 11840 consensus_queue.cc:237] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.020133 11849 raft_consensus.cc:515] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.006495 11318 leader_election.cc:304] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:32.022186 11426 raft_consensus.cc:2468] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:32.015452 11278 raft_consensus.cc:2468] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:32.023546 11638 raft_consensus.cc:2804] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:32.023944 11638 raft_consensus.cc:493] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.024253 11638 raft_consensus.cc:3060] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.027838 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:32.015218 11545 raft_consensus.cc:385] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.029538 11545 raft_consensus.cc:740] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.031097 11545 consensus_queue.cc:260] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.036006 11545 ts_tablet_manager.cc:1434] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:12:32.026412 11777 raft_consensus.cc:2804] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:32.037096 11545 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:32.045250 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
W20260709 12:12:32.035892 11464 leader_election.cc:343] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:32.054729 11467 leader_election.cc:343] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:32.055047 11467 leader_election.cc:304] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:32.064936 11777 raft_consensus.cc:697] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:32.084164 11545 tablet_bootstrap.cc:654] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.079036 11175 catalog_manager.cc:5697] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:32.082819 11424 raft_consensus.cc:2393] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 20c40041a85147a0bc5000c1aa44343e in this term.
I20260709 12:12:32.076596 11867 raft_consensus.cc:2749] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:32.116019 11542 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:32.116496 11542 ts_tablet_manager.cc:1403] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.315s	user 0.013s	sys 0.022s
I20260709 12:12:32.089507 11777 consensus_queue.cc:237] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.109210 11850 raft_consensus.cc:493] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.125785 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:32.128074 11275 raft_consensus.cc:3060] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.129487 11638 raft_consensus.cc:515] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.125083 11850 raft_consensus.cc:515] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.131567 11638 leader_election.cc:290] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:32.132288 11849 leader_election.cc:290] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:32.132541 11850 leader_election.cc:290] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:32.141098 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:32.147709 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:32.149675 11848 raft_consensus.cc:493] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.150164 11848 raft_consensus.cc:515] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.150357 11276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:32.151547 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c2239cec004da49f946e92b5d2ccf5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:32.152228 11352 raft_consensus.cc:2393] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in this term.
I20260709 12:12:32.152999 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:32.153802 11353 raft_consensus.cc:2393] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:32.154175 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ab1731cb8c4d9b91d8b33ada1a7e55" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:32.155189 11848 leader_election.cc:290] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:32.155002 11542 raft_consensus.cc:359] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.156183 11542 raft_consensus.cc:385] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.156502 11542 raft_consensus.cc:740] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.157264 11542 consensus_queue.cc:260] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
W20260709 12:12:32.158695 11904 log.cc:927] Time spent T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:12:32.158833 11542 ts_tablet_manager.cc:1434] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:12:32.159047 11546 tablet_bootstrap.cc:492] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:32.160065 11546 ts_tablet_manager.cc:1403] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.264s	user 0.020s	sys 0.011s
I20260709 12:12:32.160151 11542 tablet_bootstrap.cc:492] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
W20260709 12:12:32.161924 11241 leader_election.cc:343] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:32.162556 11546 raft_consensus.cc:359] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.163211 11546 raft_consensus.cc:385] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.163468 11546 raft_consensus.cc:740] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.164057 11546 consensus_queue.cc:260] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.164572 11390 leader_election.cc:304] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:32.165548 11714 raft_consensus.cc:3060] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.166018 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ab1731cb8c4d9b91d8b33ada1a7e55" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:32.166538 11546 ts_tablet_manager.cc:1434] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:32.167450 11546 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:32.174309 11546 tablet_bootstrap.cc:654] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:32.176697 11244 leader_election.cc:343] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:32.177175 11542 tablet_bootstrap.cc:654] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.177134 11244 leader_election.cc:304] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:32.177835 11848 raft_consensus.cc:2749] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:32.154261 11275 raft_consensus.cc:2468] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:32.183887 11318 leader_election.cc:304] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:32.190398 11173 catalog_manager.cc:5697] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:32.199344 11392 leader_election.cc:304] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:32.210248 11176 catalog_manager.cc:5697] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.191715 11605 raft_consensus.cc:2749] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:32.214396 11714 raft_consensus.cc:2749] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:32.223542 11850 raft_consensus.cc:2804] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:32.246420 11850 raft_consensus.cc:697] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:32.251595 11850 consensus_queue.cc:237] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.259881 11545 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:32.260370 11545 ts_tablet_manager.cc:1403] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.014s
I20260709 12:12:32.263008 11545 raft_consensus.cc:359] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.266938 11545 raft_consensus.cc:385] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.267213 11545 raft_consensus.cc:740] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.267866 11545 consensus_queue.cc:260] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.271821 11544 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:32.272287 11544 ts_tablet_manager.cc:1403] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.317s	user 0.020s	sys 0.009s
I20260709 12:12:32.281423 11544 raft_consensus.cc:359] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.282021 11544 raft_consensus.cc:385] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.282346 11544 raft_consensus.cc:740] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.283051 11544 consensus_queue.cc:260] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.289956 11817 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.297621 11546 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:32.298146 11546 ts_tablet_manager.cc:1403] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.131s	user 0.031s	sys 0.015s
I20260709 12:12:32.290429 11817 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.300992 11817 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:32.301908 11544 ts_tablet_manager.cc:1434] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.004s
I20260709 12:12:32.302819 11544 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:32.305981 11545 ts_tablet_manager.cc:1434] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.045s	user 0.001s	sys 0.005s
I20260709 12:12:32.306638 11545 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28: Bootstrap starting.
I20260709 12:12:32.318928 11840 raft_consensus.cc:493] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.320752 11840 raft_consensus.cc:515] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.322738 11840 leader_election.cc:290] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:32.324030 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969c64b986d444c19757cf5ce94bb8bc" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:32.324488 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:32.324761 11278 raft_consensus.cc:2393] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:32.325248 11542 tablet_bootstrap.cc:492] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:32.325774 11542 ts_tablet_manager.cc:1403] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.166s	user 0.016s	sys 0.007s
I20260709 12:12:32.326349 11176 catalog_manager.cc:5697] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.328622 11542 raft_consensus.cc:359] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.329303 11542 raft_consensus.cc:385] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.329543 11542 raft_consensus.cc:740] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.330152 11542 consensus_queue.cc:260] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.330458 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "969c64b986d444c19757cf5ce94bb8bc" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
W20260709 12:12:32.331095 11464 leader_election.cc:343] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:32.332155 11542 ts_tablet_manager.cc:1434] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:32.333068 11542 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:32.334235 11318 leader_election.cc:304] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:32.318758 11274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:32.336644 11846 raft_consensus.cc:3060] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.338408 11544 tablet_bootstrap.cc:654] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:32.336843 11466 leader_election.cc:343] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:32.346453 11466 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:32.347648 11866 raft_consensus.cc:2749] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:32.349155 11542 tablet_bootstrap.cc:654] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.364028 11545 tablet_bootstrap.cc:654] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.376260 11546 raft_consensus.cc:359] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.376260 11176 catalog_manager.cc:5697] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:32.377147 11546 raft_consensus.cc:385] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.381912 11546 raft_consensus.cc:740] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.382630 11546 consensus_queue.cc:260] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.373721 11817 consensus_queue.cc:1048] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:12:32.384624 11546 ts_tablet_manager.cc:1434] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.086s	user 0.002s	sys 0.003s
I20260709 12:12:32.374764 11866 consensus_queue.cc:1048] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:12:32.389396 11546 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:32.395457 11546 tablet_bootstrap.cc:654] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.411252 11542 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:32.411762 11542 ts_tablet_manager.cc:1403] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.002s
I20260709 12:12:32.415673 11866 consensus_queue.cc:1048] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:32.415674 11777 consensus_queue.cc:1048] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:32.418730 11846 raft_consensus.cc:2749] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:32.421844 11542 raft_consensus.cc:359] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.422518 11542 raft_consensus.cc:385] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.422776 11542 raft_consensus.cc:740] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.423482 11542 consensus_queue.cc:260] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.423902 11866 consensus_queue.cc:1048] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:32.433611 11542 ts_tablet_manager.cc:1434] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:12:32.442440 11542 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:32.453929 11546 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:32.454334 11544 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:32.454428 11546 ts_tablet_manager.cc:1403] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.006s
I20260709 12:12:32.454941 11544 ts_tablet_manager.cc:1403] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.152s	user 0.058s	sys 0.046s
I20260709 12:12:32.455860 11542 tablet_bootstrap.cc:654] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.457190 11544 raft_consensus.cc:359] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.460574 11544 raft_consensus.cc:385] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.460865 11544 raft_consensus.cc:740] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.461519 11544 consensus_queue.cc:260] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.457638 11546 raft_consensus.cc:359] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.463037 11546 raft_consensus.cc:385] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.463284 11546 raft_consensus.cc:740] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.466346 11545 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28: No bootstrap required, opened a new log
I20260709 12:12:32.466800 11545 ts_tablet_manager.cc:1403] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.005s
I20260709 12:12:32.467497 11546 consensus_queue.cc:260] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.470093 11546 ts_tablet_manager.cc:1434] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:12:32.471133 11546 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:32.472126 11545 raft_consensus.cc:359] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.472620 11545 raft_consensus.cc:385] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.556918 11544 ts_tablet_manager.cc:1434] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.102s	user 0.004s	sys 0.001s
I20260709 12:12:32.563406 11542 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:32.634076 11542 ts_tablet_manager.cc:1403] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.192s	user 0.018s	sys 0.003s
I20260709 12:12:32.472853 11545 raft_consensus.cc:740] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.590749 11844 raft_consensus.cc:493] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.637363 11844 raft_consensus.cc:515] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.637853 11545 consensus_queue.cc:260] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.639904 11545 ts_tablet_manager.cc:1434] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28: Time spent starting tablet: real 0.173s	user 0.006s	sys 0.002s
I20260709 12:12:32.655624 11426 raft_consensus.cc:3060] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.660904 11848 raft_consensus.cc:493] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.661590 11848 raft_consensus.cc:515] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.664253 11848 leader_election.cc:290] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:32.675347 11544 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:32.678318 11931 raft_consensus.cc:493] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.679057 11931 raft_consensus.cc:515] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.681855 11931 leader_election.cc:290] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:32.683501 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:32.652426 11846 raft_consensus.cc:493] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.686746 11544 tablet_bootstrap.cc:654] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.687228 11846 raft_consensus.cc:515] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.647061 11844 leader_election.cc:290] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:32.693281 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:32.694137 11500 raft_consensus.cc:2468] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:32.701076 11542 raft_consensus.cc:359] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:32.701737 11464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 93895.5us
I20260709 12:12:32.712419 11546 tablet_bootstrap.cc:654] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:32.700966 11846 leader_election.cc:290] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:32.713814 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:32.714515 11353 raft_consensus.cc:2468] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
W20260709 12:12:32.716173 11244 consensus_peers.cc:597] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.716881 11244 leader_election.cc:343] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:32.718716 11934 consensus_queue.cc:1048] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:32.724327 11390 leader_election.cc:304] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:32.725337 11850 consensus_queue.cc:1048] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:32.726333 11542 raft_consensus.cc:385] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.729035 11542 raft_consensus.cc:740] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
W20260709 12:12:32.746402 11467 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:35889, user_credentials={real_user=slave}} blocked reactor thread for 50925.1us
I20260709 12:12:32.749692 11542 consensus_queue.cc:260] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:32.750710 11714 raft_consensus.cc:2804] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:32.757402 11714 raft_consensus.cc:493] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.769397 11544 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:32.769913 11544 ts_tablet_manager.cc:1403] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.009s
I20260709 12:12:32.761199 11714 raft_consensus.cc:3060] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.774377 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:32.775228 11351 raft_consensus.cc:2468] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:32.769580 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:32.777473 11498 raft_consensus.cc:2468] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:32.783610 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:32.784298 11498 raft_consensus.cc:2468] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:32.785204 11817 raft_consensus.cc:493] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.785804 11817 raft_consensus.cc:515] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.787547 11242 leader_election.cc:304] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:32.789736 11846 consensus_queue.cc:1048] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:32.820564 11817 leader_election.cc:290] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:32.821575 11544 raft_consensus.cc:359] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.822113 11317 leader_election.cc:304] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:32.824296 11909 raft_consensus.cc:2804] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:32.824652 11909 raft_consensus.cc:493] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.825034 11909 raft_consensus.cc:3060] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.827324 11848 raft_consensus.cc:2804] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:32.831952 11544 raft_consensus.cc:385] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.832475 11544 raft_consensus.cc:740] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.833325 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf819e5fabb44ecb9cb0235c718d87d5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:32.827804 11848 raft_consensus.cc:493] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.838670 11848 raft_consensus.cc:3060] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.859329 11544 consensus_queue.cc:260] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.837201 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf819e5fabb44ecb9cb0235c718d87d5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:32.869618 11542 ts_tablet_manager.cc:1434] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.235s	user 0.005s	sys 0.005s
I20260709 12:12:32.871214 11546 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:32.872475 11546 ts_tablet_manager.cc:1403] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.402s	user 0.007s	sys 0.016s
I20260709 12:12:32.875677 11546 raft_consensus.cc:359] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.876498 11546 raft_consensus.cc:385] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:32.876772 11546 raft_consensus.cc:740] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:32.865468 11931 raft_consensus.cc:493] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.867980 11273 raft_consensus.cc:2468] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 0.
I20260709 12:12:32.882176 11931 raft_consensus.cc:515] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:32.886075 11467 leader_election.cc:343] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:32.891489 11542 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:32.895540 11931 leader_election.cc:290] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:32.869680 11241 leader_election.cc:304] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:32.899641 11933 raft_consensus.cc:2804] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:32.900004 11933 raft_consensus.cc:493] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.900322 11933 raft_consensus.cc:3060] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.901008 11714 raft_consensus.cc:515] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
W20260709 12:12:32.903630 11224 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:12:32.904372 11241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 76646.2us
I20260709 12:12:32.906294 11544 ts_tablet_manager.cc:1434] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.135s	user 0.006s	sys 0.000s
I20260709 12:12:32.907562 11544 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:32.908373 11496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:32.909161 11496 raft_consensus.cc:2468] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:32.882737 11546 consensus_queue.cc:260] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.914242 11714 leader_election.cc:290] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:32.904706 11848 raft_consensus.cc:515] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
W20260709 12:12:32.938866 11392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 119682us
I20260709 12:12:32.941643 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40b4b0fb044dd893a3a58ce7749e98" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:32.942113 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:32.943130 11427 raft_consensus.cc:2393] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 20c40041a85147a0bc5000c1aa44343e in this term.
I20260709 12:12:32.952334 11466 leader_election.cc:304] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:32.953137 11546 ts_tablet_manager.cc:1434] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 12:12:32.943789 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:32.959093 11636 raft_consensus.cc:2804] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:32.962692 11636 raft_consensus.cc:493] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.963080 11636 raft_consensus.cc:3060] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:32.971639 11636 raft_consensus.cc:515] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:32.972510 11542 tablet_bootstrap.cc:654] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:32.976974 11242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 139119us
I20260709 12:12:32.977780 11278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c40b4b0fb044dd893a3a58ce7749e98" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:32.981863 11917 consensus_queue.cc:1048] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:32.981997 11933 raft_consensus.cc:515] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:32.983897 11933 leader_election.cc:290] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:32.960458 11909 raft_consensus.cc:515] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:32.985116 11351 raft_consensus.cc:2393] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 1: Already voted for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in this term.
I20260709 12:12:33.031550 11544 tablet_bootstrap.cc:654] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.033517 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:33.034194 11497 raft_consensus.cc:3060] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.037031 11848 leader_election.cc:290] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
W20260709 12:12:33.037086 11242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 59422.5us
I20260709 12:12:33.039000 11426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:33.040561 11426 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.044611 11497 raft_consensus.cc:2468] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:33.033464 11714 raft_consensus.cc:493] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.050501 11714 raft_consensus.cc:515] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:33.053210 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:33.053715 11714 leader_election.cc:290] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:33.053815 11353 raft_consensus.cc:3060] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.054313 11909 leader_election.cc:290] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:33.050519 11546 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:33.057730 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ab1731cb8c4d9b91d8b33ada1a7e55" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:33.061022 11636 leader_election.cc:290] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:33.063210 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:33.063810 11497 raft_consensus.cc:3060] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.066561 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:33.067171 11501 raft_consensus.cc:3060] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:33.070416 11390 leader_election.cc:343] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.063975 11353 raft_consensus.cc:2468] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
W20260709 12:12:33.073359 11942 log.cc:927] Time spent T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e: Append to log took a long time: real 0.151s	user 0.003s	sys 0.008s
I20260709 12:12:33.080266 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:33.080382 11241 leader_election.cc:304] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:33.081027 11498 raft_consensus.cc:2393] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 20c40041a85147a0bc5000c1aa44343e in this term.
I20260709 12:12:33.081519 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf819e5fabb44ecb9cb0235c718d87d5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:33.081964 11848 raft_consensus.cc:2804] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:33.082093 11273 raft_consensus.cc:3060] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.082492 11848 raft_consensus.cc:697] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:33.085616 11848 consensus_queue.cc:237] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:33.089697 11501 raft_consensus.cc:2468] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:33.100490 11497 raft_consensus.cc:2468] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:33.101806 11542 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:33.102296 11542 ts_tablet_manager.cc:1403] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.211s	user 0.013s	sys 0.001s
I20260709 12:12:33.106362 11542 raft_consensus.cc:359] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:33.109503 11542 raft_consensus.cc:385] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.109774 11542 raft_consensus.cc:740] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.111660 11933 consensus_queue.cc:1048] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:33.113315 11242 leader_election.cc:304] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:33.119132 11542 consensus_queue.cc:260] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:33.119817 11244 leader_election.cc:343] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.125451 11392 leader_election.cc:304] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:33.137388 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ed543b345014451bd60ddfb0b548dd6" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:33.138259 11425 raft_consensus.cc:2393] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 20c40041a85147a0bc5000c1aa44343e in this term.
I20260709 12:12:33.138958 11936 raft_consensus.cc:2804] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:33.139526 11936 raft_consensus.cc:697] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:33.145206 11909 raft_consensus.cc:493] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.145711 11909 raft_consensus.cc:515] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:33.146185 11275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ab1731cb8c4d9b91d8b33ada1a7e55" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:33.146929 11275 raft_consensus.cc:2468] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 0.
I20260709 12:12:33.147825 11909 leader_election.cc:290] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:33.150445 11392 leader_election.cc:304] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:33.164358 11542 ts_tablet_manager.cc:1434] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.003s
I20260709 12:12:33.126066 11273 raft_consensus.cc:2468] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:33.140486 11936 consensus_queue.cc:237] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:33.159262 11714 consensus_queue.cc:1048] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:12:33.176965 11546 tablet_bootstrap.cc:654] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.169672 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7182aba132c4c0c8c8d9a45d8a2b978" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:33.178553 11542 tablet_bootstrap.cc:492] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:33.179641 11849 raft_consensus.cc:2804] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:33.189220 11466 leader_election.cc:304] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:33.194170 11819 raft_consensus.cc:2804] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:33.188964 11849 raft_consensus.cc:493] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.194782 11849 raft_consensus.cc:3060] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.201375 11819 raft_consensus.cc:697] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:33.202327 11819 consensus_queue.cc:237] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:33.205536 11319 leader_election.cc:304] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28
W20260709 12:12:33.206399 11319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:35889, user_credentials={real_user=slave}} blocked reactor thread for 52067.5us
W20260709 12:12:33.207434 11319 leader_election.cc:343] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.210067 11840 raft_consensus.cc:2749] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:12:33.212182 11391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 78174.6us
I20260709 12:12:33.213083 11391 leader_election.cc:304] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:33.225335 11274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7182aba132c4c0c8c8d9a45d8a2b978" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:33.226006 11274 raft_consensus.cc:2468] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:33.232378 11685 raft_consensus.cc:2804] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:33.259703 11544 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: No bootstrap required, opened a new log
I20260709 12:12:33.260241 11544 ts_tablet_manager.cc:1403] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.353s	user 0.010s	sys 0.017s
I20260709 12:12:33.232059 11849 raft_consensus.cc:515] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:33.254151 11945 raft_consensus.cc:2749] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:33.268121 11685 raft_consensus.cc:697] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:33.273985 11318 leader_election.cc:304] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
W20260709 12:12:33.275882 11318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 48349us
I20260709 12:12:33.280115 11917 raft_consensus.cc:2804] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:33.285778 11917 raft_consensus.cc:493] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.286108 11917 raft_consensus.cc:3060] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.285247 11935 raft_consensus.cc:493] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:33.382229 11959 log.cc:927] Time spent T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:12:33.386862 11542 tablet_bootstrap.cc:654] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.337265 11935 raft_consensus.cc:515] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:33.407706 11935 leader_election.cc:290] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:33.414669 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf819e5fabb44ecb9cb0235c718d87d5" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:33.415489 11940 raft_consensus.cc:493] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.416095 11940 raft_consensus.cc:515] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
W20260709 12:12:33.419301 11467 leader_election.cc:343] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.423398 11546 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:33.423935 11546 ts_tablet_manager.cc:1403] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.374s	user 0.014s	sys 0.010s
W20260709 12:12:33.442898 11318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 58476.1us
I20260709 12:12:33.453563 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ab1731cb8c4d9b91d8b33ada1a7e55" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:33.454372 11422 raft_consensus.cc:2393] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 20c40041a85147a0bc5000c1aa44343e in this term.
W20260709 12:12:33.454860 11916 log.cc:927] Time spent T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Append to log took a long time: real 0.278s	user 0.001s	sys 0.002s
I20260709 12:12:33.458421 11685 consensus_queue.cc:237] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:33.460222 11175 catalog_manager.cc:5697] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:33.464627 11544 raft_consensus.cc:359] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:33.465467 11544 raft_consensus.cc:385] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.465919 11544 raft_consensus.cc:740] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.444798 11274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ab1731cb8c4d9b91d8b33ada1a7e55" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:33.443656 11849 leader_election.cc:290] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
W20260709 12:12:33.486128 11467 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:35889, user_credentials={real_user=slave}} blocked reactor thread for 63805.8us
I20260709 12:12:33.492010 11274 raft_consensus.cc:3060] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:33.498456 11464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 211084us
I20260709 12:12:33.526010 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68a9fb3e63a45119c4c6ebf7623679d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:33.527262 11965 log.cc:927] Time spent T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:12:33.514971 11273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ab1731cb8c4d9b91d8b33ada1a7e55" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:33.538141 11423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68a9fb3e63a45119c4c6ebf7623679d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:33.540067 11917 raft_consensus.cc:515] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:33.550161 11467 leader_election.cc:343] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:33.561882 11960 log.cc:927] Time spent T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:12:33.563154 11546 raft_consensus.cc:359] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:33.563831 11546 raft_consensus.cc:385] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.564076 11546 raft_consensus.cc:740] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.565871 11546 consensus_queue.cc:260] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:33.566768 11318 leader_election.cc:304] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:33.569051 11840 raft_consensus.cc:3060] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.571539 11917 leader_election.cc:290] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:33.573480 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4ab1731cb8c4d9b91d8b33ada1a7e55" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:33.575981 11274 raft_consensus.cc:2468] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
W20260709 12:12:33.583436 11466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 181870us
I20260709 12:12:33.585321 11546 ts_tablet_manager.cc:1434] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.161s	user 0.005s	sys 0.002s
I20260709 12:12:33.587460 11542 tablet_bootstrap.cc:492] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:33.587929 11542 ts_tablet_manager.cc:1403] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.417s	user 0.013s	sys 0.018s
I20260709 12:12:33.589250 11272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7182aba132c4c0c8c8d9a45d8a2b978" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:33.589869 11272 raft_consensus.cc:3060] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.591403 11546 tablet_bootstrap.cc:492] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:33.595211 11840 raft_consensus.cc:2749] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:33.596897 11542 raft_consensus.cc:359] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:33.597560 11542 raft_consensus.cc:385] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.597831 11542 raft_consensus.cc:740] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.603729 11392 leader_election.cc:304] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:33.605106 11542 consensus_queue.cc:260] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:33.606298 11424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7182aba132c4c0c8c8d9a45d8a2b978" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:33.606493 11934 consensus_queue.cc:1048] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:33.606907 11424 raft_consensus.cc:3060] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.608940 11931 raft_consensus.cc:2804] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:33.615727 11351 raft_consensus.cc:2468] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:33.615572 11931 raft_consensus.cc:697] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:33.619594 11931 consensus_queue.cc:237] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:33.622812 11544 consensus_queue.cc:260] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:33.624166 11173 catalog_manager.cc:5697] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 1 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:33.626407 11544 ts_tablet_manager.cc:1434] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.366s	user 0.021s	sys 0.004s
I20260709 12:12:33.631450 11940 leader_election.cc:290] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:33.646040 11424 raft_consensus.cc:2468] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:33.664059 11936 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.664541 11936 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:33.666543 11936 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:33.672451 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:33.673194 11498 raft_consensus.cc:2468] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 0.
I20260709 12:12:33.676193 11319 leader_election.cc:304] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:33.686144 11542 ts_tablet_manager.cc:1434] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.098s	user 0.005s	sys 0.002s
I20260709 12:12:33.698603 11546 tablet_bootstrap.cc:654] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.691582 11969 raft_consensus.cc:2804] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:33.702613 11969 raft_consensus.cc:697] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:33.707882 11242 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:33.709388 11934 raft_consensus.cc:2804] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:33.709765 11934 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.710098 11934 raft_consensus.cc:3060] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.714443 11969 consensus_queue.cc:237] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
W20260709 12:12:33.721994 11464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 104381us
I20260709 12:12:33.721830 11938 consensus_queue.cc:1048] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:33.722784 11542 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081: Bootstrap starting.
I20260709 12:12:33.686651 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
W20260709 12:12:33.724905 11241 leader_election.cc:343] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.697710 11272 raft_consensus.cc:2468] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:33.741983 11866 consensus_queue.cc:1048] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:12:33.753104 11934 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:33.755643 11934 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:33.755757 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:33.756345 11497 raft_consensus.cc:3060] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.756629 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
W20260709 12:12:33.760272 11464 leader_election.cc:343] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.760763 11464 leader_election.cc:304] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:33.767012 11973 raft_consensus.cc:2749] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:33.767765 11241 leader_election.cc:343] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:33.772902 11497 raft_consensus.cc:2468] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 1.
I20260709 12:12:33.774245 11242 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:33.776487 11938 raft_consensus.cc:2804] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:33.780196 11938 raft_consensus.cc:697] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:33.781054 11938 consensus_queue.cc:237] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:33.782182 11542 tablet_bootstrap.cc:654] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.786618 11546 tablet_bootstrap.cc:492] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:33.787621 11546 ts_tablet_manager.cc:1403] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.007s
W20260709 12:12:33.788074 11467 consensus_peers.cc:597] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.789429 11244 consensus_peers.cc:597] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.840194 11840 raft_consensus.cc:493] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.840708 11840 raft_consensus.cc:515] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:33.840596 11546 raft_consensus.cc:359] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:33.842315 11546 raft_consensus.cc:385] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.842567 11546 raft_consensus.cc:740] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.842796 11840 leader_election.cc:290] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:33.843199 11546 consensus_queue.cc:260] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:33.844965 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68a9fb3e63a45119c4c6ebf7623679d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:33.845690 11498 raft_consensus.cc:2468] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:33.846127 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68a9fb3e63a45119c4c6ebf7623679d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:33.846474 11546 ts_tablet_manager.cc:1434] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.001s
I20260709 12:12:33.846748 11422 raft_consensus.cc:2468] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 0.
I20260709 12:12:33.847501 11546 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:33.848146 11317 leader_election.cc:304] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:33.849545 11969 raft_consensus.cc:2804] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:33.849918 11969 raft_consensus.cc:493] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.850261 11969 raft_consensus.cc:3060] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.859349 11542 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081: No bootstrap required, opened a new log
I20260709 12:12:33.860689 11542 ts_tablet_manager.cc:1403] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent bootstrapping tablet: real 0.138s	user 0.027s	sys 0.017s
I20260709 12:12:33.859309 11936 consensus_queue.cc:1048] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:33.863219 11542 raft_consensus.cc:359] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:33.864642 11542 raft_consensus.cc:385] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.864957 11542 raft_consensus.cc:740] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.869087 11542 consensus_queue.cc:260] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:33.871261 11542 ts_tablet_manager.cc:1434] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:33.877012 11714 consensus_queue.cc:1048] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:33.879431 11546 tablet_bootstrap.cc:654] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.885522 11969 raft_consensus.cc:515] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:33.896718 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68a9fb3e63a45119c4c6ebf7623679d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:33.897308 11425 raft_consensus.cc:3060] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.902992 11849 consensus_queue.cc:1048] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:33.904318 11425 raft_consensus.cc:2468] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:33.905422 11319 leader_election.cc:304] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:33.906345 11935 raft_consensus.cc:2804] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:33.906797 11935 raft_consensus.cc:697] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:33.910130 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c68a9fb3e63a45119c4c6ebf7623679d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:33.914619 11498 raft_consensus.cc:3060] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:33.907559 11935 consensus_queue.cc:237] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:33.916899 11969 leader_election.cc:290] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:33.918570 11546 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:33.919067 11546 ts_tablet_manager.cc:1403] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.002s
I20260709 12:12:33.921897 11546 raft_consensus.cc:359] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:33.926110 11546 raft_consensus.cc:385] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.926504 11546 raft_consensus.cc:740] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.927179 11546 consensus_queue.cc:260] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:33.922159 11172 catalog_manager.cc:5697] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:33.929378 11546 ts_tablet_manager.cc:1434] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:33.938581 11546 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e: Bootstrap starting.
I20260709 12:12:33.945916 11498 raft_consensus.cc:2468] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:33.951130 11546 tablet_bootstrap.cc:654] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:33.954668 11176 catalog_manager.cc:5697] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } }
I20260709 12:12:33.970270 11173 catalog_manager.cc:5697] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:33.972270 11546 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e: No bootstrap required, opened a new log
I20260709 12:12:33.972746 11546 ts_tablet_manager.cc:1403] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 12:12:33.972456 11173 catalog_manager.cc:5697] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:33.975440 11546 raft_consensus.cc:359] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:33.976053 11546 raft_consensus.cc:385] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:33.976316 11546 raft_consensus.cc:740] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Initialized, Role: FOLLOWER
I20260709 12:12:33.982002 11546 consensus_queue.cc:260] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:33.984790 11546 ts_tablet_manager.cc:1434] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
W20260709 12:12:33.986577 11224 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:33.986224 11175 catalog_manager.cc:5697] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:33.998520 11955 raft_consensus.cc:493] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.998953 11955 raft_consensus.cc:515] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:34.000946 11955 leader_election.cc:290] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:34.003072 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf819e5fabb44ecb9cb0235c718d87d5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:34.005924 11274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf819e5fabb44ecb9cb0235c718d87d5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:34.009949 11392 leader_election.cc:304] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:34.011904 11174 catalog_manager.cc:5697] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 1 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:34.016784 11955 raft_consensus.cc:2749] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:34.023669 11955 consensus_queue.cc:1048] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:34.046499 11685 consensus_queue.cc:1048] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:34.060935 11935 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.061314 11935 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:34.066179 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:34.066910 11498 raft_consensus.cc:2393] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 1: Already voted for candidate 8cd91ce67df74245a4fcfd0c7c799002 in this term.
I20260709 12:12:34.067399 11274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:34.068291 11935 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:34.068660 11318 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:34.069751 11935 raft_consensus.cc:3060] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:34.078939 11935 raft_consensus.cc:2749] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:34.134620 11935 consensus_queue.cc:1048] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:34.145630 11957 consensus_queue.cc:1048] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:34.176407 11946 consensus_queue.cc:1048] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:34.178297 11425 raft_consensus.cc:3060] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:34.180128 11424 raft_consensus.cc:3060] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:34.188877 11936 consensus_queue.cc:1048] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:34.406592 11957 consensus_queue.cc:1048] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:34.416978 11957 consensus_queue.cc:1048] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:35.845405  3725 tablet_server.cc:179] TabletServer@127.3.163.65:0 shutting down...
W20260709 12:12:35.855736 11466 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:35.869154 11466 consensus_peers.cc:597] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:35.882898 11392 consensus_peers.cc:597] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:35.883514 11392 consensus_peers.cc:597] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.892274  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:35.893530  3725 tablet_replica.cc:333] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.894202  3725 raft_consensus.cc:2243] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.894665  3725 raft_consensus.cc:2272] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.896648  3725 tablet_replica.cc:333] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.897498  3725 raft_consensus.cc:2243] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.898238  3725 raft_consensus.cc:2272] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:35.900014 11466 consensus_peers.cc:597] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.900563  3725 tablet_replica.cc:333] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.901327  3725 raft_consensus.cc:2243] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.901844  3725 raft_consensus.cc:2272] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.904078  3725 tablet_replica.cc:333] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.904650  3725 raft_consensus.cc:2243] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.905046  3725 raft_consensus.cc:2272] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.907752  3725 tablet_replica.cc:333] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.908591  3725 raft_consensus.cc:2243] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.909412  3725 raft_consensus.cc:2272] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:35.909956 11318 consensus_peers.cc:597] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.911449  3725 tablet_replica.cc:333] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.912019  3725 raft_consensus.cc:2243] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.912384  3725 raft_consensus.cc:2272] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.914336  3725 tablet_replica.cc:333] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.915030  3725 raft_consensus.cc:2243] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.915844  3725 raft_consensus.cc:2272] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.918174  3725 tablet_replica.cc:333] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.919028  3725 raft_consensus.cc:2243] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.919569  3725 raft_consensus.cc:2272] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:35.920768 11318 consensus_peers.cc:597] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.921725  3725 tablet_replica.cc:333] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.922529  3725 raft_consensus.cc:2243] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.923022  3725 raft_consensus.cc:2272] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.925096  3725 tablet_replica.cc:333] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.925654  3725 raft_consensus.cc:2243] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.926010  3725 raft_consensus.cc:2272] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.928102  3725 tablet_replica.cc:333] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.928664  3725 raft_consensus.cc:2243] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.929203  3725 raft_consensus.cc:2272] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.931298  3725 tablet_replica.cc:333] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.931948  3725 raft_consensus.cc:2243] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.932344  3725 raft_consensus.cc:2272] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.934160  3725 tablet_replica.cc:333] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.934719  3725 raft_consensus.cc:2243] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.935067  3725 raft_consensus.cc:2272] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.936761  3725 tablet_replica.cc:333] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.937322  3725 raft_consensus.cc:2243] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.938243  3725 raft_consensus.cc:2272] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.940765  3725 tablet_replica.cc:333] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.941530  3725 raft_consensus.cc:2243] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.942302  3725 raft_consensus.cc:2272] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.944370  3725 tablet_replica.cc:333] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
W20260709 12:12:35.945065 11318 consensus_peers.cc:597] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.945125  3725 raft_consensus.cc:2243] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.945936  3725 raft_consensus.cc:2272] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.948616  3725 tablet_replica.cc:333] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.949371  3725 raft_consensus.cc:2243] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.949887  3725 raft_consensus.cc:2272] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.951866  3725 tablet_replica.cc:333] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.952432  3725 raft_consensus.cc:2243] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.952893  3725 raft_consensus.cc:2272] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.954798  3725 tablet_replica.cc:333] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.955292  3725 raft_consensus.cc:2243] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.955603  3725 raft_consensus.cc:2272] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.957336  3725 tablet_replica.cc:333] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.957792  3725 raft_consensus.cc:2243] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.958465  3725 raft_consensus.cc:2272] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.960186  3725 tablet_replica.cc:333] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.960660  3725 raft_consensus.cc:2243] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.961350  3725 raft_consensus.cc:2272] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.962992  3725 tablet_replica.cc:333] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.963449  3725 raft_consensus.cc:2243] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.963788  3725 raft_consensus.cc:2272] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.965729  3725 tablet_replica.cc:333] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.966323  3725 raft_consensus.cc:2243] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.966977  3725 raft_consensus.cc:2272] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.968542  3725 tablet_replica.cc:333] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.969041  3725 raft_consensus.cc:2243] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.969724  3725 raft_consensus.cc:2272] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.971560  3725 tablet_replica.cc:333] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.972095  3725 raft_consensus.cc:2243] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.972496  3725 raft_consensus.cc:2272] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.974874  3725 tablet_replica.cc:333] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.975581  3725 raft_consensus.cc:2243] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:35.975840 11392 consensus_peers.cc:597] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.976086  3725 raft_consensus.cc:2272] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:35.976119 11318 consensus_peers.cc:597] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:35.977362 11466 consensus_peers.cc:597] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.978976  3725 tablet_replica.cc:333] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.979712  3725 raft_consensus.cc:2243] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.980233  3725 raft_consensus.cc:2272] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:35.981150 11466 consensus_peers.cc:597] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.982414  3725 tablet_replica.cc:333] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.982990  3725 raft_consensus.cc:2243] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.983402  3725 raft_consensus.cc:2272] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.985303  3725 tablet_replica.cc:333] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.985890  3725 raft_consensus.cc:2243] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.986374  3725 raft_consensus.cc:2272] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.988272  3725 tablet_replica.cc:333] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.988711  3725 raft_consensus.cc:2243] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.989106  3725 raft_consensus.cc:2272] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.990926  3725 tablet_replica.cc:333] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.991379  3725 raft_consensus.cc:2243] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.991711  3725 raft_consensus.cc:2272] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.993621  3725 tablet_replica.cc:333] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.994091  3725 raft_consensus.cc:2243] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.994454  3725 raft_consensus.cc:2272] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.996762  3725 tablet_replica.cc:333] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:35.997496  3725 raft_consensus.cc:2243] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.998009  3725 raft_consensus.cc:2272] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:35.998154 11466 consensus_peers.cc:597] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.000634  3725 tablet_replica.cc:333] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.001375  3725 raft_consensus.cc:2243] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.001885  3725 raft_consensus.cc:2272] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.003934  3725 tablet_replica.cc:333] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.004364  3725 raft_consensus.cc:2243] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.004712  3725 raft_consensus.cc:2272] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.006558  3725 tablet_replica.cc:333] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.007050  3725 raft_consensus.cc:2243] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.007427  3725 raft_consensus.cc:2272] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.009173  3725 tablet_replica.cc:333] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.009711  3725 raft_consensus.cc:2243] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.010175  3725 raft_consensus.cc:2272] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.012694  3725 tablet_replica.cc:333] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.013474  3725 raft_consensus.cc:2243] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:36.013798 11392 consensus_peers.cc:597] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.013955 11318 consensus_peers.cc:597] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.013994  3725 raft_consensus.cc:2272] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:36.014452 11392 consensus_peers.cc:597] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.016141  3725 tablet_replica.cc:333] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.016661  3725 raft_consensus.cc:2243] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.017079  3725 raft_consensus.cc:2272] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.018805  3725 tablet_replica.cc:333] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.019444  3725 raft_consensus.cc:2243] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.019948  3725 raft_consensus.cc:2272] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.022104  3725 tablet_replica.cc:333] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.022570  3725 raft_consensus.cc:2243] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:36.023303  3725 raft_consensus.cc:2272] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.025712  3725 tablet_replica.cc:333] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
W20260709 12:12:36.025933 11466 consensus_peers.cc:597] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.026355  3725 raft_consensus.cc:2243] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:36.027369  3725 raft_consensus.cc:2272] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.030140  3725 tablet_replica.cc:333] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.030745  3725 raft_consensus.cc:2243] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.031265  3725 raft_consensus.cc:2272] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.033782  3725 tablet_replica.cc:333] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.034394  3725 raft_consensus.cc:2243] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:36.035209  3725 raft_consensus.cc:2272] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:36.035879 11392 consensus_peers.cc:597] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.037513  3725 tablet_replica.cc:333] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: stopping tablet replica
I20260709 12:12:36.038007  3725 raft_consensus.cc:2243] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.038327  3725 raft_consensus.cc:2272] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:36.041853 11466 consensus_peers.cc:597] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.054957 11466 consensus_peers.cc:597] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.065218 11318 consensus_peers.cc:597] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.112722  3725 tablet_server.cc:196] TabletServer@127.3.163.65:0 shutdown complete.
W20260709 12:12:36.127236 11466 consensus_peers.cc:597] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.142282 11318 consensus_peers.cc:597] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.143901 11392 consensus_peers.cc:597] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.154750 11318 consensus_peers.cc:597] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.184836  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:36.192236 12023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:36.192272 12024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:36.196579 11318 consensus_peers.cc:597] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.196664 12026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:36.198537  3725 server_base.cc:1061] running on GCE node
I20260709 12:12:36.201650  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:36.201936  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:36.202150  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599156202134 us; error 0 us; skew 500 ppm
I20260709 12:12:36.202833  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:12:36.204552 11392 consensus_peers.cc:597] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.213864 11392 consensus_peers.cc:597] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.214848 11318 consensus_peers.cc:597] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.215246  3725 webserver.cc:533] Webserver started at http://127.3.163.65:34417/ using document root <none> and password file <none>
I20260709 12:12:36.215935  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:36.216159  3725 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:12:36.217634 11392 consensus_peers.cc:597] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.220677  3725 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:12:36.227807 12031 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:36.228542  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:36.228911  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "8cd91ce67df74245a4fcfd0c7c799002"
format_stamp: "Formatted at 2026-07-09 12:12:25 on dist-test-slave-s43n"
I20260709 12:12:36.229360  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:12:36.242718 11466 consensus_peers.cc:597] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.256132  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:36.257351  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:36.258656  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:36.262722 12038 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:12:36.329978 11318 consensus_peers.cc:597] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.332605 11318 consensus_peers.cc:597] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.438557 11318 consensus_peers.cc:597] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.487402  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:12:36.487723  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.226s	user 0.007s	sys 0.000s
I20260709 12:12:36.487989  3725 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:12:36.492898 12038 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.506487 12038 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.507347 12038 tablet_bootstrap.cc:492] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.507928 12038 ts_tablet_manager.cc:1403] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.015s	user 0.002s	sys 0.012s
I20260709 12:12:36.510334 12038 raft_consensus.cc:359] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.511014 12038 raft_consensus.cc:740] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.515039 12038 consensus_queue.cc:260] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.532096 12038 ts_tablet_manager.cc:1434] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.012s
I20260709 12:12:36.536633 12038 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.549880 12038 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.550520 12038 tablet_bootstrap.cc:492] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.551056 12038 ts_tablet_manager.cc:1403] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:12:36.552793 12038 raft_consensus.cc:359] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.553282 12038 raft_consensus.cc:740] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.553797 12038 consensus_queue.cc:260] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.555087 12038 ts_tablet_manager.cc:1434] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:36.555727 12038 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.568464 12038 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.569130 12038 tablet_bootstrap.cc:492] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.569588 12038 ts_tablet_manager.cc:1403] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 12:12:36.571297 12038 raft_consensus.cc:359] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.571760 12038 raft_consensus.cc:740] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.572260 12038 consensus_queue.cc:260] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.573516 12038 ts_tablet_manager.cc:1434] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:12:36.574054 12038 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.584172 12038 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.585001 12038 tablet_bootstrap.cc:492] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.585536 12038 ts_tablet_manager.cc:1403] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:12:36.587673 12038 raft_consensus.cc:359] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.588289 12038 raft_consensus.cc:740] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.588881 12038 consensus_queue.cc:260] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.590535 12038 ts_tablet_manager.cc:1434] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:36.591172 12038 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.616879 12038 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.617704 12038 tablet_bootstrap.cc:492] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.618266 12038 ts_tablet_manager.cc:1403] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.015s
I20260709 12:12:36.620503 12038 raft_consensus.cc:359] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.621155 12038 raft_consensus.cc:740] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.621763 12038 consensus_queue.cc:260] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.623548 12038 ts_tablet_manager.cc:1434] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:36.624292 12038 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.644940 12038 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.645804 12038 tablet_bootstrap.cc:492] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.646435 12038 ts_tablet_manager.cc:1403] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.003s
I20260709 12:12:36.648712 12038 raft_consensus.cc:359] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.649335 12038 raft_consensus.cc:740] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.649962 12038 consensus_queue.cc:260] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.651806 12038 ts_tablet_manager.cc:1434] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:12:36.652712 12038 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.670509 12038 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.671350 12038 tablet_bootstrap.cc:492] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.671964 12038 ts_tablet_manager.cc:1403] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:12:36.674198 12038 raft_consensus.cc:359] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.674822 12038 raft_consensus.cc:740] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.675434 12038 consensus_queue.cc:260] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.677271 12038 ts_tablet_manager.cc:1434] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:12:36.677949 12038 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.695787 12038 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.696614 12038 tablet_bootstrap.cc:492] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.697198 12038 ts_tablet_manager.cc:1403] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:12:36.699400 12038 raft_consensus.cc:359] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.700026 12038 raft_consensus.cc:740] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.700752 12038 consensus_queue.cc:260] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.702677 12038 ts_tablet_manager.cc:1434] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:36.704092 12038 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.717933  3725 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:12:36.718225  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.230s	user 0.203s	sys 0.004s
I20260709 12:12:36.718703 12038 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.719605 12038 tablet_bootstrap.cc:492] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.720213 12038 ts_tablet_manager.cc:1403] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:12:36.722687 12038 raft_consensus.cc:359] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.723384 12038 raft_consensus.cc:740] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.724141 12038 consensus_queue.cc:260] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.726105 12038 ts_tablet_manager.cc:1434] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:12:36.727775 12038 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.748435 12038 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.749336 12038 tablet_bootstrap.cc:492] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.749941 12038 ts_tablet_manager.cc:1403] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 12:12:36.752413 12038 raft_consensus.cc:359] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.753094 12038 raft_consensus.cc:740] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.753803 12038 consensus_queue.cc:260] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.755945 12038 ts_tablet_manager.cc:1434] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:36.756723 12038 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.775071 12038 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.775959 12038 tablet_bootstrap.cc:492] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.776576 12038 ts_tablet_manager.cc:1403] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 12:12:36.779002 12038 raft_consensus.cc:359] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.779650 12038 raft_consensus.cc:740] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.780335 12038 consensus_queue.cc:260] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.782353 12038 ts_tablet_manager.cc:1434] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:12:36.783120 12038 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.801529 12038 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.802368 12038 tablet_bootstrap.cc:492] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.802997 12038 ts_tablet_manager.cc:1403] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:12:36.805869 12038 raft_consensus.cc:359] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.806514 12038 raft_consensus.cc:740] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.807242 12038 consensus_queue.cc:260] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.809408 12038 ts_tablet_manager.cc:1434] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:36.810123 12038 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.827450 12038 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.828313 12038 tablet_bootstrap.cc:492] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.828935 12038 ts_tablet_manager.cc:1403] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:12:36.832638  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:32937
I20260709 12:12:36.832592 12038 raft_consensus.cc:359] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.833431 12038 raft_consensus.cc:740] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.834187 12038 consensus_queue.cc:260] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.835682 12114 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:32937 every 8 connection(s)
I20260709 12:12:36.836064 12038 ts_tablet_manager.cc:1434] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:12:36.836948 12038 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.884078 11982 raft_consensus.cc:493] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:36.884579 11982 raft_consensus.cc:515] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.885963 12115 heartbeater.cc:344] Connected to a master server at 127.3.163.126:38385
I20260709 12:12:36.886404 12115 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:36.886798 11982 leader_election.cc:290] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:36.887235 12115 heartbeater.cc:507] Master 127.3.163.126:38385 requested a full tablet report, sending...
I20260709 12:12:36.888083 12038 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.888185 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:36.889034 12038 tablet_bootstrap.cc:492] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.889665 12038 ts_tablet_manager.cc:1403] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.011s
I20260709 12:12:36.891428 12038 raft_consensus.cc:359] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.891932 12038 raft_consensus.cc:740] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.892482 12038 consensus_queue.cc:260] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.893275 12088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:36.893721 12038 ts_tablet_manager.cc:1434] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:12:36.893915 12088 raft_consensus.cc:2468] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:36.894538 12038 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.895123 11466 leader_election.cc:304] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:36.896153 11982 raft_consensus.cc:2804] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:36.896504 11982 raft_consensus.cc:493] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:36.896888 11982 raft_consensus.cc:3060] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:36.910189 12043 raft_consensus.cc:493] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:36.910691 12043 raft_consensus.cc:515] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.912427 11174 ts_manager.cc:194] Re-registered known tserver with Master: 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:36.912676 12038 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.913630 12038 tablet_bootstrap.cc:492] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.914459 12038 ts_tablet_manager.cc:1403] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:12:36.914762 11982 raft_consensus.cc:515] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.915887 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:36.916823 11982 leader_election.cc:290] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:36.917022 12038 raft_consensus.cc:359] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.917785 12038 raft_consensus.cc:740] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.918428 12038 consensus_queue.cc:260] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.920284 12038 ts_tablet_manager.cc:1434] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:12:36.921034 12038 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.922174 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:36.923537 12043 leader_election.cc:290] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:36.926964 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:36.927563 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:36.928175 12085 raft_consensus.cc:3060] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:36.928282 11466 leader_election.cc:343] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:36.928920 11466 leader_election.cc:304] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:36.930351 11973 raft_consensus.cc:2749] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:36.935858 12085 raft_consensus.cc:2468] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 2.
I20260709 12:12:36.936962 11466 leader_election.cc:304] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:36.937956 12043 raft_consensus.cc:2804] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:36.938431 12043 raft_consensus.cc:697] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:36.939750 12038 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.939282 12043 consensus_queue.cc:237] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:36.940507 12038 tablet_bootstrap.cc:492] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.941138 12038 ts_tablet_manager.cc:1403] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:12:36.943521 12038 raft_consensus.cc:359] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.944113 12038 raft_consensus.cc:740] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.944758 12038 consensus_queue.cc:260] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.946259 12038 ts_tablet_manager.cc:1434] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:36.946846 12038 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.960042 12038 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.960850 12038 tablet_bootstrap.cc:492] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.961400 12038 ts_tablet_manager.cc:1403] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:12:36.963416 12038 raft_consensus.cc:359] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.963848 12038 raft_consensus.cc:740] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.964342 12038 consensus_queue.cc:260] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:36.965953 12038 ts_tablet_manager.cc:1434] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:36.966532 12038 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:36.970279 11176 catalog_manager.cc:5697] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:36.985555 11174 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49618
I20260709 12:12:36.988145 12038 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:36.988794 12038 tablet_bootstrap.cc:492] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:36.989305 12038 ts_tablet_manager.cc:1403] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:12:36.990715 12115 heartbeater.cc:499] Master 127.3.163.126:38385 was elected leader, sending a full tablet report...
I20260709 12:12:36.991077 12038 raft_consensus.cc:359] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.993018 12038 raft_consensus.cc:740] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:36.993649 12038 consensus_queue.cc:260] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:36.995817 12038 ts_tablet_manager.cc:1434] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:36.996645 12038 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:37.007486 12041 raft_consensus.cc:493] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.007995 12041 raft_consensus.cc:515] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.010203 12041 leader_election.cc:290] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.013624 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.017565 12039 raft_consensus.cc:493] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.018059 12039 raft_consensus.cc:515] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.018682 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.019310 12087 raft_consensus.cc:2468] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:37.020073 12039 leader_election.cc:290] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.021122 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:37.021766 11318 leader_election.cc:304] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:37.022933 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.023911 12041 raft_consensus.cc:2804] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.024290 12041 raft_consensus.cc:493] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
W20260709 12:12:37.024186 11392 leader_election.cc:343] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.024796 12041 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.028280 12043 raft_consensus.cc:493] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.028762 12043 raft_consensus.cc:515] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.025084 11392 leader_election.cc:304] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.030979 12043 leader_election.cc:290] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.035017 12041 raft_consensus.cc:515] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.035430 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:37.036059 11425 raft_consensus.cc:2468] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:37.037051 12038 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:37.037309 11467 leader_election.cc:304] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:37.037708 12041 leader_election.cc:290] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.037911 12038 tablet_bootstrap.cc:492] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:37.038612 12038 ts_tablet_manager.cc:1403] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.004s
I20260709 12:12:37.038537 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:37.038795 11973 raft_consensus.cc:2804] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.039240 11973 raft_consensus.cc:493] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.039574 11973 raft_consensus.cc:3060] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.040912 12038 raft_consensus.cc:359] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.041501 12088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.041750 12038 raft_consensus.cc:740] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.042085 12088 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.042547 12038 consensus_queue.cc:260] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.044564 12038 ts_tablet_manager.cc:1434] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:37.045291 12038 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:37.045958 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.046967 12046 raft_consensus.cc:2749] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:37.047217 11466 leader_election.cc:343] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.048990 12039 raft_consensus.cc:493] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.049350 12088 raft_consensus.cc:2468] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:37.049823 12039 raft_consensus.cc:515] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.050431 11318 leader_election.cc:304] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:37.053853 11840 raft_consensus.cc:2804] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.054364 11840 raft_consensus.cc:697] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:37.056485 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
W20260709 12:12:37.057845 11392 leader_election.cc:343] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.058389 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.059258 11840 consensus_queue.cc:237] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.058408 12039 leader_election.cc:290] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.058342 11973 raft_consensus.cc:515] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.061349 11497 raft_consensus.cc:2393] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:37.062073 11973 leader_election.cc:290] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.063876 11391 leader_election.cc:304] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.064941 12039 raft_consensus.cc:3060] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.066228 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:37.070770 12088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "893e5c43cf564bd59d9f25fa8f9f0fbf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
W20260709 12:12:37.072031 11466 leader_election.cc:343] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.074872 11973 raft_consensus.cc:493] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.075331 11973 raft_consensus.cc:515] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.077919 11973 leader_election.cc:290] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.078095 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:37.080241 12038 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:37.081108 12038 tablet_bootstrap.cc:492] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:37.081161 12039 raft_consensus.cc:2749] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.081866 12088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
W20260709 12:12:37.083170 11466 leader_election.cc:343] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.083530 11466 leader_election.cc:304] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.085821 12038 ts_tablet_manager.cc:1403] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.006s
I20260709 12:12:37.087456 11425 raft_consensus.cc:2468] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 2.
I20260709 12:12:37.084862 11973 raft_consensus.cc:2749] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.087684 11174 catalog_manager.cc:5697] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:37.088234 12038 raft_consensus.cc:359] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.088944 12038 raft_consensus.cc:740] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.089178 11467 leader_election.cc:304] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.089732 12038 consensus_queue.cc:260] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.090157 11973 raft_consensus.cc:2804] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.091426 11973 raft_consensus.cc:697] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:37.091583 12038 ts_tablet_manager.cc:1434] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:12:37.092140 11973 consensus_queue.cc:237] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.093067 12038 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:37.110767 12038 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:37.111423 12038 tablet_bootstrap.cc:492] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:37.111955 12038 ts_tablet_manager.cc:1403] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:12:37.111637 11174 catalog_manager.cc:5697] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.113924 12038 raft_consensus.cc:359] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.114480 12038 raft_consensus.cc:740] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.115103 12038 consensus_queue.cc:260] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.117110 12038 ts_tablet_manager.cc:1434] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:12:37.118280 12038 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:37.138504 12038 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:37.139317 12038 tablet_bootstrap.cc:492] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:37.139896 12038 ts_tablet_manager.cc:1403] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:12:37.142140 12038 raft_consensus.cc:359] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.142783 12038 raft_consensus.cc:740] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.143389 12038 consensus_queue.cc:260] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.145355 12038 ts_tablet_manager.cc:1434] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:12:37.146253 12038 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:37.157231 11973 raft_consensus.cc:493] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.157699 11973 raft_consensus.cc:515] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.159493 11973 leader_election.cc:290] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.161837 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:37.164026 12088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.164620 12088 raft_consensus.cc:2468] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:37.165994 11466 leader_election.cc:304] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.169047 12043 raft_consensus.cc:2804] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.169420 12043 raft_consensus.cc:493] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.169775 12043 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.177333 11840 raft_consensus.cc:493] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.177800 11840 raft_consensus.cc:515] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.179522 11840 leader_election.cc:290] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.180912 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.181598 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.181598 11497 raft_consensus.cc:2468] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:37.183151 11317 leader_election.cc:304] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:37.184664 12016 raft_consensus.cc:2804] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.185065 12016 raft_consensus.cc:493] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.185431 12016 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:37.190342 11318 leader_election.cc:343] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.180222 12043 raft_consensus.cc:515] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.200402 12016 raft_consensus.cc:515] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.203444 12016 leader_election.cc:290] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.204454 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.205786 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:37.206349 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.206905 12087 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.208369 12038 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:37.209249 12038 tablet_bootstrap.cc:492] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:37.209836 12038 ts_tablet_manager.cc:1403] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.031s
W20260709 12:12:37.210305 11318 leader_election.cc:343] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.211539 12043 leader_election.cc:290] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.212333 12038 raft_consensus.cc:359] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.213013 12038 raft_consensus.cc:740] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.213119 12043 raft_consensus.cc:493] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.213289 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:37.213701 12038 consensus_queue.cc:260] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.214099 11497 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.215991 12087 raft_consensus.cc:2468] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 2.
I20260709 12:12:37.213840 12043 raft_consensus.cc:515] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.217227 11466 leader_election.cc:304] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:37.217898 12038 ts_tablet_manager.cc:1434] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:12:37.218648 12038 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:37.219825 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:37.218329 11973 raft_consensus.cc:2804] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.221161 11973 raft_consensus.cc:697] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:37.223503 12016 raft_consensus.cc:493] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.224006 12016 raft_consensus.cc:515] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.224555 12043 leader_election.cc:290] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.225898 12016 leader_election.cc:290] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.227773 12088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.228401 12088 raft_consensus.cc:2468] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:37.229632 11318 leader_election.cc:304] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.228889 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.230365 12016 raft_consensus.cc:2804] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.231355 12016 raft_consensus.cc:493] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.231779 12016 raft_consensus.cc:3060] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.232578 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.232862 12087 raft_consensus.cc:2468] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:37.233151 12041 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.233657 12041 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.228520 11973 consensus_queue.cc:237] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.236754 12041 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.238209 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.238852 11498 raft_consensus.cc:2468] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:37.238490 11466 leader_election.cc:304] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:37.240914 11982 raft_consensus.cc:2804] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.241268 11982 raft_consensus.cc:493] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.241616 11982 raft_consensus.cc:3060] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.243892 12086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.244563 12086 raft_consensus.cc:2468] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:37.245944 12042 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.246449 12042 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.252044 12086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
W20260709 12:12:37.253541 11466 leader_election.cc:343] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.248595 12042 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.255167 11982 raft_consensus.cc:515] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.246434 11318 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:37.258450 12086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.259083 12086 raft_consensus.cc:3060] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.259943 11982 leader_election.cc:290] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.262702 12140 raft_consensus.cc:493] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.263216 12140 raft_consensus.cc:515] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.279021 12039 raft_consensus.cc:493] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.279577 12039 raft_consensus.cc:515] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.281687 12043 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.282186 11982 raft_consensus.cc:493] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.282720 11982 raft_consensus.cc:515] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.282212 12043 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.288884 12014 raft_consensus.cc:493] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.289387 12014 raft_consensus.cc:515] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.290664 12043 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.291450 12014 leader_election.cc:290] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.292585 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.293021 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.293686 11500 raft_consensus.cc:2468] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
W20260709 12:12:37.294135 11392 leader_election.cc:343] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.295549 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.296277 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.296244 12085 raft_consensus.cc:2468] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:37.295539 11391 leader_election.cc:304] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.297699 11466 leader_election.cc:304] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.298207 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.296526 11982 leader_election.cc:290] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.298940 11982 raft_consensus.cc:2804] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.299320 11982 raft_consensus.cc:493] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.299651 11982 raft_consensus.cc:3060] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.299808 12039 leader_election.cc:290] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.300422 12014 raft_consensus.cc:2804] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.298875 12087 raft_consensus.cc:2468] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:37.300902 12014 raft_consensus.cc:493] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.302038 12014 raft_consensus.cc:3060] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.302182 11466 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.300215 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.306166 12085 raft_consensus.cc:2393] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:37.307041 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.307404 11392 leader_election.cc:304] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.307875 12087 raft_consensus.cc:2393] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b6d95e83cd149f88775563c5514ba28 in current term 2: Already voted for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in this term.
I20260709 12:12:37.305660 12016 raft_consensus.cc:515] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.309274 12138 raft_consensus.cc:2804] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.309710 12138 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.307816 12140 leader_election.cc:290] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.310070 12138 raft_consensus.cc:3060] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.312683 12041 raft_consensus.cc:493] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.313264 12041 raft_consensus.cc:515] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.314988 12140 raft_consensus.cc:2804] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.315378 12140 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.315796 12140 raft_consensus.cc:3060] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.315207 12041 leader_election.cc:290] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.318861 11497 raft_consensus.cc:2468] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:37.320748 12046 raft_consensus.cc:3060] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.309906 12016 leader_election.cc:290] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.334722 12140 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
W20260709 12:12:37.327085 11467 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:35889, user_credentials={real_user=slave}} blocked reactor thread for 83250.1us
I20260709 12:12:37.326201 12143 raft_consensus.cc:493] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.337939 12143 raft_consensus.cc:515] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.339923 12143 leader_election.cc:290] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
W20260709 12:12:37.328358 11318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 82072.4us
I20260709 12:12:37.341625 11425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:37.342172 11425 raft_consensus.cc:2468] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
I20260709 12:12:37.343091 11319 leader_election.cc:304] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:37.344028 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:37.344195 12046 raft_consensus.cc:2749] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.344875 11498 raft_consensus.cc:2393] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:37.344148 11174 catalog_manager.cc:5697] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.345024 12146 raft_consensus.cc:2804] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.345502 12146 raft_consensus.cc:493] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.345868 12146 raft_consensus.cc:3060] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.348956 12043 raft_consensus.cc:493] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.350318 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.351140 12087 raft_consensus.cc:2393] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:37.346630 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.330192 12014 raft_consensus.cc:515] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.324373 11982 raft_consensus.cc:515] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.350880 12043 raft_consensus.cc:515] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.368264 11317 leader_election.cc:304] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.369403 11350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:37.374377 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.366822 12016 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.359386 12088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
W20260709 12:12:37.380990 11466 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 56706.1us
I20260709 12:12:37.381470 12140 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.383553 11347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805b5febce314019a60dc7fe2f77b2cf" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:37.378372 12016 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.409049 11352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:37.416692 11840 raft_consensus.cc:2804] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.417557 11840 raft_consensus.cc:697] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:37.416752 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:37.418349 11351 raft_consensus.cc:2468] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:37.419864 11425 raft_consensus.cc:1275] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.421078 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:37.424505 11350 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:37.422415 12088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.426818 11973 consensus_queue.cc:1048] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:37.428313 12016 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.422739 12146 raft_consensus.cc:515] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.431180 12014 leader_election.cc:290] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.442167 12088 raft_consensus.cc:3060] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.440408 11840 consensus_queue.cc:237] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.435264 12038 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:37.435988 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.436651 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:37.456061 12038 tablet_bootstrap.cc:492] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:37.432425 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.436044 11347 raft_consensus.cc:2393] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b6d95e83cd149f88775563c5514ba28 in current term 2: Already voted for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in this term.
I20260709 12:12:37.456770 12038 ts_tablet_manager.cc:1403] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.238s	user 0.058s	sys 0.070s
I20260709 12:12:37.437565 12086 raft_consensus.cc:2468] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 2.
I20260709 12:12:37.449311 12043 leader_election.cc:290] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.450443 12016 raft_consensus.cc:493] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.486330 12087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.482986 12016 raft_consensus.cc:515] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.486704 11982 leader_election.cc:290] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.468113 11498 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 1.
W20260709 12:12:37.487478 11392 leader_election.cc:343] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.488037 12146 leader_election.cc:290] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:37.488183 12087 raft_consensus.cc:2468] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 1.
I20260709 12:12:37.488996 12016 leader_election.cc:290] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.489351 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.489920 12085 raft_consensus.cc:3060] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.491075 11317 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:37.493750 11466 leader_election.cc:304] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.493109 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:37.506289 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:37.506910 11497 raft_consensus.cc:3060] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.507473 12087 raft_consensus.cc:1275] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.510651 12043 raft_consensus.cc:2804] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.511008 12043 raft_consensus.cc:493] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.511358 12043 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.512001 12142 consensus_queue.cc:1048] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:37.513880 11464 leader_election.cc:304] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.510528 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.516433 12145 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.516748 11498 raft_consensus.cc:2393] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:37.522912 12043 raft_consensus.cc:515] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.524191 12145 raft_consensus.cc:2749] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.492939 12016 raft_consensus.cc:2804] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.515717 11497 raft_consensus.cc:2468] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:37.515794 12038 raft_consensus.cc:359] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.526275 12038 raft_consensus.cc:740] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.528406 12038 consensus_queue.cc:260] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.532737 12038 ts_tablet_manager.cc:1434] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.000s
I20260709 12:12:37.534135 11466 leader_election.cc:304] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.525094 12016 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.540783 12142 raft_consensus.cc:2804] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.548771 11318 leader_election.cc:304] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
W20260709 12:12:37.548247 11390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 68609.2us
I20260709 12:12:37.544150 12016 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.550125 11318 leader_election.cc:304] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.546811 12138 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.560366 12138 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.561265 12154 raft_consensus.cc:493] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.561758 12154 raft_consensus.cc:515] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.562985 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:37.563683 11500 raft_consensus.cc:2393] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:37.564706 12150 raft_consensus.cc:2749] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:12:37.565543 11318 leader_election.cc:343] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.569643 12086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.571334 12080 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.547554 12142 raft_consensus.cc:697] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:37.571930 12080 raft_consensus.cc:2468] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 1.
I20260709 12:12:37.572633 12142 consensus_queue.cc:237] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.572991 12081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:37.573417 11392 leader_election.cc:304] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.573781 12079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.578687 12079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.578953 11352 raft_consensus.cc:2393] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b6d95e83cd149f88775563c5514ba28 in current term 2: Already voted for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in this term.
I20260709 12:12:37.579206 12086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.556339 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e5700fed174a83ac83c3d104965013" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:37.581195 11422 raft_consensus.cc:3060] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.582543 12038 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:37.583747 12154 leader_election.cc:290] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.584486 12039 raft_consensus.cc:2804] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.584921 12039 raft_consensus.cc:493] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.585270 12039 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.554011 12144 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.589360 12043 leader_election.cc:290] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.589915 11464 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.591141 11982 raft_consensus.cc:2804] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:37.591503 11982 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:37.591835 11982 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.594799 12088 raft_consensus.cc:2468] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 2.
I20260709 12:12:37.551151 12085 raft_consensus.cc:2468] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 2.
I20260709 12:12:37.602665 11982 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.605047 11982 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Requested vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:37.628582 11466 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:37.633430 11466 leader_election.cc:304] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.622124 12079 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.637393 11351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:37.638273 12039 raft_consensus.cc:515] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.641927 12086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.642182 12144 raft_consensus.cc:2749] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.643769 11347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6536bd733514fbb927281bf18c6fa23" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:37.644716 11422 raft_consensus.cc:2468] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:37.645748 11176 catalog_manager.cc:5697] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:37.648114 11497 raft_consensus.cc:1275] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.652070 12142 raft_consensus.cc:2804] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:12:37.649964 11318 leader_election.cc:343] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.635819 12043 raft_consensus.cc:2804] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.682164 11391 leader_election.cc:304] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28; no voters: 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.686117 12155 raft_consensus.cc:2804] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.686586 12155 raft_consensus.cc:697] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:37.687391 12155 consensus_queue.cc:237] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.690924 11318 leader_election.cc:304] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.702512 12152 consensus_queue.cc:1048] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:37.704361 11423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:37.704682 11319 leader_election.cc:304] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:37.705281 11318 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.705292 11423 raft_consensus.cc:2393] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b6d95e83cd149f88775563c5514ba28 in current term 2: Already voted for candidate 20c40041a85147a0bc5000c1aa44343e in this term.
W20260709 12:12:37.706331 11318 leader_election.cc:343] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.707106 11422 raft_consensus.cc:1275] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.707391 12146 raft_consensus.cc:2804] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.709548 12043 raft_consensus.cc:697] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:37.711320 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:37.711493 12043 consensus_queue.cc:237] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.707549 12142 raft_consensus.cc:697] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:37.713002 12142 consensus_queue.cc:237] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.714921 12143 raft_consensus.cc:2749] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.715724 12146 raft_consensus.cc:697] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:37.716547 12146 consensus_queue.cc:237] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.712020 11500 raft_consensus.cc:2393] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c40041a85147a0bc5000c1aa44343e in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:37.661619 11347 raft_consensus.cc:3060] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.722234 12038 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:12:37.743458 11466 leader_election.cc:343] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:37.744079 11464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 89944.5us
I20260709 12:12:37.749488 12038 tablet_bootstrap.cc:492] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:37.750247 12038 ts_tablet_manager.cc:1403] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.168s	user 0.026s	sys 0.000s
I20260709 12:12:37.744491 11175 catalog_manager.cc:5697] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:37.772356 11318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 65203us
W20260709 12:12:37.788995 12157 log.cc:927] Time spent T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:12:37.792193 11466 consensus_peers.cc:597] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:37.794571 12038 raft_consensus.cc:359] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.799572 12038 raft_consensus.cc:740] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.800031 12038 consensus_queue.cc:260] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:37.804382 12038 ts_tablet_manager.cc:1434] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:12:37.801951 11348 raft_consensus.cc:1275] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:12:37.811018 11391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 69097.4us
I20260709 12:12:37.812223 12039 leader_election.cc:290] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.817273 12081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.821023 12016 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:37.822229 11351 raft_consensus.cc:2393] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b6d95e83cd149f88775563c5514ba28 in current term 2: Already voted for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in this term.
I20260709 12:12:37.823210 12016 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:37.825506 12079 raft_consensus.cc:2468] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 2.
I20260709 12:12:37.834286 11466 leader_election.cc:304] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:37.817360 12087 raft_consensus.cc:1275] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.861382 12165 raft_consensus.cc:2804] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.861932 12165 raft_consensus.cc:697] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Leader. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:37.862705 12165 consensus_queue.cc:237] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.861444 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
W20260709 12:12:37.868111 11467 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:35889, user_credentials={real_user=slave}} blocked reactor thread for 115341us
I20260709 12:12:37.868978 11347 raft_consensus.cc:2468] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b6d95e83cd149f88775563c5514ba28 in term 2.
I20260709 12:12:37.869798 12147 raft_consensus.cc:2749] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.871364 12172 consensus_queue.cc:1048] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:37.871634 12178 consensus_queue.cc:1048] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:37.880282 12038 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:37.885157 12085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:37.885425 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:37.886057 11497 raft_consensus.cc:2393] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:37.888509 12085 raft_consensus.cc:1275] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.888236 11175 catalog_manager.cc:5697] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.890198 12172 consensus_queue.cc:1048] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:37.897176 12152 consensus_queue.cc:1048] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:37.884112 11176 catalog_manager.cc:5697] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 2 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:37.910617 11318 leader_election.cc:343] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:37.911057 11318 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.915361 12147 raft_consensus.cc:2749] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.933130 11464 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.934127 12165 raft_consensus.cc:2749] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.946415 11175 catalog_manager.cc:5697] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.954430 11175 catalog_manager.cc:5697] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.967751 11175 catalog_manager.cc:5697] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 reported cstate change: term changed from 1 to 2, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68). New cstate: current_term: 2 leader_uuid: "8b6d95e83cd149f88775563c5514ba28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:37.971433 12038 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:37.973403 12038 tablet_bootstrap.cc:492] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:37.974078 12038 ts_tablet_manager.cc:1403] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.002s
I20260709 12:12:37.959740 11391 leader_election.cc:304] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e; no voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:37.989156 12182 raft_consensus.cc:2749] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.996273 12038 raft_consensus.cc:359] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:37.996971 12038 raft_consensus.cc:740] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:37.999588 11497 raft_consensus.cc:1275] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.998142 12038 consensus_queue.cc:260] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.002337 12038 ts_tablet_manager.cc:1434] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.001s
I20260709 12:12:38.003049 12038 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.005334 12016 consensus_queue.cc:1048] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:38.014878 11318 consensus_peers.cc:597] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:38.032604 12038 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.033460 12038 tablet_bootstrap.cc:492] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.033993 12038 ts_tablet_manager.cc:1403] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 12:12:38.035808 12038 raft_consensus.cc:359] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.036427 12038 raft_consensus.cc:740] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.037611 12038 consensus_queue.cc:260] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.039080 12038 ts_tablet_manager.cc:1434] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:38.039877 12038 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.045580 11351 raft_consensus.cc:1275] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.047101 11982 consensus_queue.cc:1048] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.060572 12087 raft_consensus.cc:1275] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.061663 12038 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.062134 12142 consensus_queue.cc:1048] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.062515 12038 tablet_bootstrap.cc:492] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.063191 12038 ts_tablet_manager.cc:1403] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 12:12:38.066002 12038 raft_consensus.cc:359] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.066618 12038 raft_consensus.cc:740] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.067207 12038 consensus_queue.cc:260] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.070286 12038 ts_tablet_manager.cc:1434] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:38.071038 12038 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.087252 12038 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.088325 12038 tablet_bootstrap.cc:492] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.088951 12038 ts_tablet_manager.cc:1403] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 12:12:38.091233 12038 raft_consensus.cc:359] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.091837 12038 raft_consensus.cc:740] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.092381 12038 consensus_queue.cc:260] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.094337 12038 ts_tablet_manager.cc:1434] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:38.095060 12038 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.109412 12038 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.110225 12038 tablet_bootstrap.cc:492] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.110816 12038 ts_tablet_manager.cc:1403] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 12:12:38.113006 12038 raft_consensus.cc:359] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.113605 12038 raft_consensus.cc:740] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.114225 12038 consensus_queue.cc:260] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.116107 12038 ts_tablet_manager.cc:1434] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:38.117959 12038 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.148101 12038 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.149015 12038 tablet_bootstrap.cc:492] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.149633 12038 ts_tablet_manager.cc:1403] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.019s
W20260709 12:12:38.150102 11392 consensus_peers.cc:597] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:38.152333 12038 raft_consensus.cc:359] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.153040 12038 raft_consensus.cc:740] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.153890 12038 consensus_queue.cc:260] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.155915 12038 ts_tablet_manager.cc:1434] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:38.156706 12038 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.169407 12038 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.170002 12038 tablet_bootstrap.cc:492] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.170519 12038 ts_tablet_manager.cc:1403] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 12:12:38.172148 12038 raft_consensus.cc:359] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.172582 12038 raft_consensus.cc:740] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.173084 12038 consensus_queue.cc:260] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.174796 12038 ts_tablet_manager.cc:1434] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:12:38.175923 12038 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.190510 12038 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.191344 12038 tablet_bootstrap.cc:492] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.191939 12038 ts_tablet_manager.cc:1403] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:12:38.195204 12038 raft_consensus.cc:359] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.195899 12038 raft_consensus.cc:740] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.195538 12085 raft_consensus.cc:1275] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.196592 12038 consensus_queue.cc:260] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.197880 12178 consensus_queue.cc:1048] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.199028 12038 ts_tablet_manager.cc:1434] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:38.200242 12038 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.204761 11500 raft_consensus.cc:1275] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.206815 12182 consensus_queue.cc:1048] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.209476 11348 raft_consensus.cc:1275] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.212754 12178 consensus_queue.cc:1048] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.223385 11424 raft_consensus.cc:1275] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.225383 12016 consensus_queue.cc:1048] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.243933 12087 raft_consensus.cc:1275] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.245232 12178 consensus_queue.cc:1048] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:38.257128 11318 consensus_peers.cc:597] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.260574 11392 consensus_peers.cc:597] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:38.271219 12038 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.272161 12038 tablet_bootstrap.cc:492] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.272754 12038 ts_tablet_manager.cc:1403] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.028s
I20260709 12:12:38.275290 12038 raft_consensus.cc:359] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.275918 12038 raft_consensus.cc:740] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.276643 12038 consensus_queue.cc:260] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.278694 12038 ts_tablet_manager.cc:1434] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:38.279431 12038 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
W20260709 12:12:38.284914 11392 consensus_peers.cc:597] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:38.298619 12085 raft_consensus.cc:1275] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.300148 12178 consensus_queue.cc:1048] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.311854 11422 raft_consensus.cc:1275] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.322400 12043 consensus_queue.cc:1048] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.332024 11351 raft_consensus.cc:1275] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8b6d95e83cd149f88775563c5514ba28: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:38.333451 12151 consensus_queue.cc:1048] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:38.336130 12038 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.337684 12038 tablet_bootstrap.cc:492] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.338321 12038 ts_tablet_manager.cc:1403] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.005s
I20260709 12:12:38.340596 12038 raft_consensus.cc:359] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.341229 12038 raft_consensus.cc:740] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.341889 12038 consensus_queue.cc:260] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.344170 12038 ts_tablet_manager.cc:1434] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:38.344954 12038 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.377839 12038 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.378701 12038 tablet_bootstrap.cc:492] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.380421 12038 ts_tablet_manager.cc:1403] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.007s
I20260709 12:12:38.382740 12038 raft_consensus.cc:359] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.383347 12038 raft_consensus.cc:740] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.383932 12038 consensus_queue.cc:260] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.389691 12038 ts_tablet_manager.cc:1434] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:12:38.390463 12038 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.411031 12038 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.411648 12038 tablet_bootstrap.cc:492] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.412123 12038 ts_tablet_manager.cc:1403] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 12:12:38.413800 12038 raft_consensus.cc:359] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.414250 12038 raft_consensus.cc:740] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.414788 12038 consensus_queue.cc:260] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.416420 12038 ts_tablet_manager.cc:1434] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:12:38.417426 12038 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.428879 12038 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.429469 12038 tablet_bootstrap.cc:492] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.429934 12038 ts_tablet_manager.cc:1403] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:12:38.431668 12038 raft_consensus.cc:359] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.432101 12038 raft_consensus.cc:740] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.432605 12038 consensus_queue.cc:260] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.433946 12038 ts_tablet_manager.cc:1434] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:38.434584 12038 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.445503 12038 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.446209 12038 tablet_bootstrap.cc:492] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.446700 12038 ts_tablet_manager.cc:1403] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:12:38.448273 12038 raft_consensus.cc:359] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.448693 12038 raft_consensus.cc:740] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.449280 12038 consensus_queue.cc:260] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.450707 12038 ts_tablet_manager.cc:1434] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:38.451602 12038 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.463410 12038 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.464071 12038 tablet_bootstrap.cc:492] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.464543 12038 ts_tablet_manager.cc:1403] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:12:38.466347 12038 raft_consensus.cc:359] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.466930 12038 raft_consensus.cc:740] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
W20260709 12:12:38.467161 11318 consensus_peers.cc:597] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:38.467633 12038 consensus_queue.cc:260] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.469640 12038 ts_tablet_manager.cc:1434] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:12:38.471019 12038 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.483217 12038 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.484004 12038 tablet_bootstrap.cc:492] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.485684 12038 ts_tablet_manager.cc:1403] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:12:38.488101 12038 raft_consensus.cc:359] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.488952 12038 raft_consensus.cc:740] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.489758 12038 consensus_queue.cc:260] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.491643 12038 ts_tablet_manager.cc:1434] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:38.492349 12038 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.503870 12038 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.504500 12038 tablet_bootstrap.cc:492] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.505040 12038 ts_tablet_manager.cc:1403] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:12:38.506635 12038 raft_consensus.cc:359] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.507095 12038 raft_consensus.cc:740] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.507555 12038 consensus_queue.cc:260] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.509399 12038 ts_tablet_manager.cc:1434] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:38.510383 12038 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.522233 12038 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.522984 12038 tablet_bootstrap.cc:492] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.523453 12038 ts_tablet_manager.cc:1403] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 12:12:38.525161 12038 raft_consensus.cc:359] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.525606 12038 raft_consensus.cc:740] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.526139 12038 consensus_queue.cc:260] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:38.527653 12038 ts_tablet_manager.cc:1434] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:38.528510 12038 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.548096 12038 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.548923 12038 tablet_bootstrap.cc:492] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.549470 12038 ts_tablet_manager.cc:1403] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:12:38.551667 12038 raft_consensus.cc:359] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.552101 12038 raft_consensus.cc:740] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.552613 12038 consensus_queue.cc:260] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:38.554136 12038 ts_tablet_manager.cc:1434] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:38.555104 12038 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap starting.
I20260709 12:12:38.566573 12038 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:38.567371 12038 tablet_bootstrap.cc:492] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Bootstrap complete.
I20260709 12:12:38.567911 12038 ts_tablet_manager.cc:1403] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:12:38.569468 12038 raft_consensus.cc:359] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.569924 12038 raft_consensus.cc:740] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Initialized, Role: FOLLOWER
I20260709 12:12:38.570487 12038 consensus_queue.cc:260] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:38.572268 12038 ts_tablet_manager.cc:1434] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:38.581393 12085 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.632638 12085 raft_consensus.cc:3060] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.642880 12085 raft_consensus.cc:3060] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.744184 12085 raft_consensus.cc:3060] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:39.633213 12237 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.638010 12237 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:39.644563 12237 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:39.810887 12245 raft_consensus.cc:493] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c40041a85147a0bc5000c1aa44343e)
I20260709 12:12:39.811427 12245 raft_consensus.cc:515] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:39.813553 12245 leader_election.cc:290] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:39.838943 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:39.839782 11498 raft_consensus.cc:2393] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8cd91ce67df74245a4fcfd0c7c799002 in current term 2: Already voted for candidate 8b6d95e83cd149f88775563c5514ba28 in this term.
I20260709 12:12:39.843694 11348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:39.844609 11348 raft_consensus.cc:2393] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8cd91ce67df74245a4fcfd0c7c799002 in current term 2: Already voted for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in this term.
I20260709 12:12:39.846065 12032 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:39.847365 12237 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:39.856539 12237 raft_consensus.cc:2749] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:39.857399 12237 raft_consensus.cc:493] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b6d95e83cd149f88775563c5514ba28)
I20260709 12:12:39.857903 12237 raft_consensus.cc:515] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:39.860708 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:39.861200 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:39.863315 12237 leader_election.cc:290] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:39.879359 12237 raft_consensus.cc:493] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8b6d95e83cd149f88775563c5514ba28)
I20260709 12:12:39.879856 12237 raft_consensus.cc:515] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:39.882417 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:39.885596 11348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca875d67c8364f99b00734f80028f1ff" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" is_pre_election: true
I20260709 12:12:39.887538 12032 leader_election.cc:304] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:39.890152 12256 raft_consensus.cc:2749] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:39.892062 11390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.66:46063, user_credentials={real_user=slave}} blocked reactor thread for 77837.1us
W20260709 12:12:39.900112 11392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 88946.9us
I20260709 12:12:39.908331 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a761f8e443864779b5216933f3dfe795" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "20c40041a85147a0bc5000c1aa44343e" is_pre_election: true
I20260709 12:12:39.912979 12237 leader_election.cc:290] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:39.914047 12035 leader_election.cc:304] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8cd91ce67df74245a4fcfd0c7c799002; no voters: 20c40041a85147a0bc5000c1aa44343e, 8b6d95e83cd149f88775563c5514ba28
I20260709 12:12:39.915118 12237 raft_consensus.cc:2749] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:39.917747 11319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:35889, user_credentials={real_user=slave}} blocked reactor thread for 165848us
I20260709 12:12:39.918582 12016 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.919037 12016 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:39.920943 12016 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:39.922669 12081 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:39.923190 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28" is_pre_election: true
I20260709 12:12:39.923355 12081 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:39.923758 11500 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:39.924870 11317 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:39.926302 12016 raft_consensus.cc:2804] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:39.926647 12016 raft_consensus.cc:493] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.926967 12016 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.936113 12082 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e442d52cd804d5fb247d09bf369c51d" candidate_uuid: "8b6d95e83cd149f88775563c5514ba28" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002" is_pre_election: true
I20260709 12:12:39.933629 12016 raft_consensus.cc:515] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:39.940538 11500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:39.940766 12084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad441508cb3d4912a21a23a55b982ae3" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
I20260709 12:12:39.941136 11500 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.941479 12084 raft_consensus.cc:3060] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:39.947990 11466 leader_election.cc:304] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:39.949129 11500 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 3.
I20260709 12:12:39.949631 12255 raft_consensus.cc:2749] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:39.951442 12016 leader_election.cc:290] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 3 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937)
I20260709 12:12:39.951933 11317 leader_election.cc:304] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
W20260709 12:12:39.950757 11392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.65:32937, user_credentials={real_user=slave}} blocked reactor thread for 45613.2us
I20260709 12:12:39.955003 12084 raft_consensus.cc:2468] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 3.
I20260709 12:12:39.955497 12251 raft_consensus.cc:2804] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:39.956785 12251 raft_consensus.cc:697] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:39.957626 12251 consensus_queue.cc:237] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:39.967527 11176 catalog_manager.cc:5697] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 1 to 3, leader changed from 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65) to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:40.346923 11501 raft_consensus.cc:1275] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:40.347844 12016 consensus_queue.cc:1048] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:40.357584 12081 raft_consensus.cc:1275] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:40.360244 12240 consensus_queue.cc:1048] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:40.738454 11522 debug-util.cc:398] Leaking SignalData structure 0x7b0800137c60 after lost signal to thread 3728
W20260709 12:12:40.739470 11522 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4740 after lost signal to thread 11210
W20260709 12:12:40.741921 11522 debug-util.cc:398] Leaking SignalData structure 0x7b080014e8c0 after lost signal to thread 11525
W20260709 12:12:40.742887 11522 debug-util.cc:398] Leaking SignalData structure 0x7b0800115b60 after lost signal to thread 12114
I20260709 12:12:47.679721  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:47.731768 11353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "320ba867e2f0452ea522852c10247484"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:48710
I20260709 12:12:47.732399 11353 raft_consensus.cc:606] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:47.734685 11353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
mode: GRACEFUL
new_leader_uuid: "20c40041a85147a0bc5000c1aa44343e"
 from {username='slave'} at 127.0.0.1:48710
I20260709 12:12:47.735095 11353 raft_consensus.cc:606] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Received request to transfer leadership to TS 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:47.737102 11353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dc72ff56ccb4ae79079d36d4b125e0b"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:48710
I20260709 12:12:47.737452 11353 raft_consensus.cc:606] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:47.739462 11353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b0efa61df04448da748e040931fad71"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:48710
I20260709 12:12:47.739970 11353 raft_consensus.cc:606] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:47.752621 11501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "20c40041a85147a0bc5000c1aa44343e"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:47.753098 11501 raft_consensus.cc:606] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Received request to transfer leadership to TS 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:47.755456 11348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:48710
I20260709 12:12:47.755864 11348 raft_consensus.cc:606] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:47.756740  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:47.757849  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:47.758548  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:47.855626 12290 raft_consensus.cc:993] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081: : Instructing follower 20c40041a85147a0bc5000c1aa44343e to start an election
I20260709 12:12:47.856149 12294 raft_consensus.cc:1081] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Signalling peer 20c40041a85147a0bc5000c1aa44343e to start an election
I20260709 12:12:47.857415 11422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8"
dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
 from {username='slave'} at 127.0.0.1:54344
I20260709 12:12:47.857800 11422 raft_consensus.cc:493] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:47.858052 11422 raft_consensus.cc:3060] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.863471 11422 raft_consensus.cc:515] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:47.866873 11348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:47.867584 11348 raft_consensus.cc:3055] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:47.867906 11348 raft_consensus.cc:740] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:47.869048 11422 leader_election.cc:290] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:47.869258 11348 consensus_queue.cc:260] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:47.870579 11348 raft_consensus.cc:3060] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.870723 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b54d6d44664c4a8f2fcc8d66288fe8" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:47.871320 11497 raft_consensus.cc:3060] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.876901 11348 raft_consensus.cc:2468] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:47.877103 11497 raft_consensus.cc:2468] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:47.878135 11390 leader_election.cc:304] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:47.878798 12293 raft_consensus.cc:2804] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:47.879192 12293 raft_consensus.cc:697] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:47.879959 12293 consensus_queue.cc:237] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:47.888931 11172 catalog_manager.cc:5697] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 1 to 2, leader changed from 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66) to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 2 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.977943 12294 raft_consensus.cc:993] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:47.978315 12290 raft_consensus.cc:1081] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:47.979627 12083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57678
I20260709 12:12:47.980121 12083 raft_consensus.cc:493] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:47.980449 12083 raft_consensus.cc:3060] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.985852 12083 raft_consensus.cc:515] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:47.987983 12083 leader_election.cc:290] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:47.988523 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:47.988615 11348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2512ccc1e8f45bab654f70492174d5e" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:47.989261 11422 raft_consensus.cc:3060] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.989383 11348 raft_consensus.cc:3055] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:47.989770 11348 raft_consensus.cc:740] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:47.990561 11348 consensus_queue.cc:260] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:47.991777 11348 raft_consensus.cc:3060] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:47.995472 11422 raft_consensus.cc:2468] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:47.996649 12035 leader_election.cc:304] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:47.998232 12304 raft_consensus.cc:2804] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:47.998363 11348 raft_consensus.cc:2468] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:47.999599 12304 raft_consensus.cc:697] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:48.000392 12304 consensus_queue.cc:237] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:48.002913 12294 raft_consensus.cc:993] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.003369 12290 raft_consensus.cc:1081] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.004669 12083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b0efa61df04448da748e040931fad71"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57678
I20260709 12:12:48.005203 12083 raft_consensus.cc:493] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.005465 12083 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:48.009372 12083 raft_consensus.cc:515] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:48.009682 11172 catalog_manager.cc:5697] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.010661 12083 leader_election.cc:290] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:48.011615 11348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:48.012184 11348 raft_consensus.cc:3055] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:48.012483 11348 raft_consensus.cc:740] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:48.013306 11348 consensus_queue.cc:260] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:48.014499 11348 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:48.021154 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b0efa61df04448da748e040931fad71" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:48.021332 11348 raft_consensus.cc:2468] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 3.
I20260709 12:12:48.021747 11497 raft_consensus.cc:3060] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:48.022382 12032 leader_election.cc:304] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:48.022972 12304 raft_consensus.cc:2804] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:48.023437 12304 raft_consensus.cc:697] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:48.024323 12304 consensus_queue.cc:237] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:48.032284 11497 raft_consensus.cc:2468] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 3.
I20260709 12:12:48.033067 12290 raft_consensus.cc:993] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.033567 12294 raft_consensus.cc:1081] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.034907 12083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dc72ff56ccb4ae79079d36d4b125e0b"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57678
I20260709 12:12:48.035380 12083 raft_consensus.cc:493] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.035692 12083 raft_consensus.cc:3060] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.038080 11172 catalog_manager.cc:5697] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 2 to 3, leader changed from 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.043067 12083 raft_consensus.cc:515] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:48.047945 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc72ff56ccb4ae79079d36d4b125e0b" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:48.048434 11353 raft_consensus.cc:3055] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.048561 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc72ff56ccb4ae79079d36d4b125e0b" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:48.048784 11353 raft_consensus.cc:740] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:48.048933 12083 leader_election.cc:290] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:48.049149 11422 raft_consensus.cc:3060] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.049638 11353 consensus_queue.cc:260] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:48.050930 11353 raft_consensus.cc:3060] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.055121 11422 raft_consensus.cc:2468] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:48.055996 12035 leader_election.cc:304] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:48.056663 12304 raft_consensus.cc:2804] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:48.057057 12304 raft_consensus.cc:697] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:48.057482 11353 raft_consensus.cc:2468] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:48.057789 12304 consensus_queue.cc:237] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:48.065809 11172 catalog_manager.cc:5697] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.075282 12272 raft_consensus.cc:993] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 20c40041a85147a0bc5000c1aa44343e to start an election
I20260709 12:12:48.075700 12292 raft_consensus.cc:1081] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Signalling peer 20c40041a85147a0bc5000c1aa44343e to start an election
I20260709 12:12:48.076853 11422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5"
dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
 from {username='slave'} at 127.0.0.1:54356
I20260709 12:12:48.077239 11422 raft_consensus.cc:493] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.077476 11422 raft_consensus.cc:3060] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.081341 11422 raft_consensus.cc:515] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:48.083287 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:48.083398 11422 leader_election.cc:290] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:48.083452 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc00a1ea01644d14b64b6826164bf7e5" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:48.084442 11497 raft_consensus.cc:3055] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.084730 11497 raft_consensus.cc:740] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:48.085872 11353 raft_consensus.cc:3060] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.086416 11497 consensus_queue.cc:260] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:48.087663 11497 raft_consensus.cc:3060] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.090934 11353 raft_consensus.cc:2468] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:48.091962 11390 leader_election.cc:304] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:48.092324 11497 raft_consensus.cc:2468] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:48.092619 12293 raft_consensus.cc:2804] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:48.093111 12293 raft_consensus.cc:697] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:48.094002 12293 consensus_queue.cc:237] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:48.103821 11172 catalog_manager.cc:5697] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 1 to 2, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 2 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.129462 12290 raft_consensus.cc:993] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.129873 12294 raft_consensus.cc:1081] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.131376 12081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "320ba867e2f0452ea522852c10247484"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57678
I20260709 12:12:48.131865 12081 raft_consensus.cc:493] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.132211 12081 raft_consensus.cc:3060] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.136940 12081 raft_consensus.cc:515] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:48.138213 12081 leader_election.cc:290] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889)
I20260709 12:12:48.138808 11353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320ba867e2f0452ea522852c10247484" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:48.139088 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320ba867e2f0452ea522852c10247484" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:48.139379 11353 raft_consensus.cc:3055] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.139602 11427 raft_consensus.cc:3060] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.139732 11353 raft_consensus.cc:740] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:48.140537 11353 consensus_queue.cc:260] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:48.141700 11353 raft_consensus.cc:3060] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.146258 11427 raft_consensus.cc:2468] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:48.147171 12035 leader_election.cc:304] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:48.147639 11353 raft_consensus.cc:2468] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:48.147768 12304 raft_consensus.cc:2804] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:48.148291 12304 raft_consensus.cc:697] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:48.149108 12304 consensus_queue.cc:237] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } }
I20260709 12:12:48.157596 11172 catalog_manager.cc:5697] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.327772 11501 raft_consensus.cc:1275] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.328835 12280 consensus_queue.cc:1048] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.337167 11348 raft_consensus.cc:1275] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.338544 12280 consensus_queue.cc:1048] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.379674 11427 raft_consensus.cc:1275] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.380744 12304 consensus_queue.cc:1048] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.399825 11348 raft_consensus.cc:1275] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.401262 12305 consensus_queue.cc:1048] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.412904 11501 raft_consensus.cc:1275] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:48.414036 12305 consensus_queue.cc:1048] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:48.423796 11349 raft_consensus.cc:1275] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:48.426800 12304 consensus_queue.cc:1048] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:48.544297 11427 raft_consensus.cc:1275] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.545466 12319 consensus_queue.cc:1048] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.546855 11349 raft_consensus.cc:1275] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.548190 12280 consensus_queue.cc:1048] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.555250 11348 raft_consensus.cc:1275] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.556602 12305 consensus_queue.cc:1048] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.566272 11501 raft_consensus.cc:1275] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.567852 12293 consensus_queue.cc:1048] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.741541 11427 raft_consensus.cc:1275] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.742667 12305 consensus_queue.cc:1048] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.753100 11349 raft_consensus.cc:1275] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:48.754931 12304 consensus_queue.cc:1048] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:48.794499  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:48.834369 11501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "229f7766e18a403594735eac02aebb69"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:48.834941 11501 raft_consensus.cc:606] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:48.850522 11422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e"
dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
mode: GRACEFUL
new_leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
 from {username='slave'} at 127.0.0.1:59684
I20260709 12:12:48.850948 11422 raft_consensus.cc:606] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Received request to transfer leadership to TS 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:48.851665 12280 raft_consensus.cc:993] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e: : Instructing follower 0ddfa5fdeb884fe4bd42def0e21f1081 to start an election
I20260709 12:12:48.852192 12330 raft_consensus.cc:1081] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Signalling peer 0ddfa5fdeb884fe4bd42def0e21f1081 to start an election
I20260709 12:12:48.853395 11501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "20c40041a85147a0bc5000c1aa44343e"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:48.853631 11349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
 from {username='slave'} at 127.0.0.1:55822
I20260709 12:12:48.853968 11501 raft_consensus.cc:606] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Received request to transfer leadership to TS 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:48.854140 11349 raft_consensus.cc:493] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.854563 11349 raft_consensus.cc:3060] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.856122 11348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:48710
I20260709 12:12:48.856704 11348 raft_consensus.cc:606] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:48.858899 11501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:48.859275 11501 raft_consensus.cc:606] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:48.860203  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:48.860595 11349 raft_consensus.cc:515] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:48.861716  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:48.862473  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:48.862907 11349 leader_election.cc:290] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:48.863456 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:48.863988 11422 raft_consensus.cc:3055] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.864271 11422 raft_consensus.cc:740] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:48.864329 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b43b6a73ce34d7297843d8f7ebc611e" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:48.864887 11501 raft_consensus.cc:3060] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.865177 11422 consensus_queue.cc:260] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:48.866439 11422 raft_consensus.cc:3060] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.869454 11501 raft_consensus.cc:2468] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:48.870322 11317 leader_election.cc:304] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8b6d95e83cd149f88775563c5514ba28; no voters: 
I20260709 12:12:48.870955 12290 raft_consensus.cc:2804] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:48.875811 11422 raft_consensus.cc:2468] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:48.881242 12290 raft_consensus.cc:697] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:48.881956 12290 consensus_queue.cc:237] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:48.892763 11176 catalog_manager.cc:5697] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 1 to 2, leader changed from 20c40041a85147a0bc5000c1aa44343e (127.3.163.67) to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.897437 12292 raft_consensus.cc:993] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.897888 12292 raft_consensus.cc:1081] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.899504 12081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "229f7766e18a403594735eac02aebb69"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57672
I20260709 12:12:48.899978 12081 raft_consensus.cc:493] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.900279 12081 raft_consensus.cc:3060] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.907320 12081 raft_consensus.cc:515] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:48.909601 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229f7766e18a403594735eac02aebb69" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:48.910141 11422 raft_consensus.cc:3060] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.915184 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "229f7766e18a403594735eac02aebb69" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:48.915712 11501 raft_consensus.cc:3055] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.915992 11501 raft_consensus.cc:740] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:48.916179 11422 raft_consensus.cc:2468] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:48.914355 12081 leader_election.cc:290] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:48.916800 11501 consensus_queue.cc:260] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:48.917881 11501 raft_consensus.cc:3060] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.917968 12035 leader_election.cc:304] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:48.920336 12304 raft_consensus.cc:2804] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:48.920794 12304 raft_consensus.cc:697] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:48.921609 12304 consensus_queue.cc:237] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:48.925241 11501 raft_consensus.cc:2468] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:48.931994 11176 catalog_manager.cc:5697] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.980930 12292 raft_consensus.cc:993] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 20c40041a85147a0bc5000c1aa44343e to start an election
I20260709 12:12:48.981269 12272 raft_consensus.cc:1081] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Signalling peer 20c40041a85147a0bc5000c1aa44343e to start an election
I20260709 12:12:48.982381 11422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd"
dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
 from {username='slave'} at 127.0.0.1:54356
I20260709 12:12:48.982755 11422 raft_consensus.cc:493] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.982968 11422 raft_consensus.cc:3060] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.987244 11422 raft_consensus.cc:515] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:48.988438 11422 leader_election.cc:290] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:48.989085 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:48.989253 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f12446f58fb4e5a867bb73ea759e3cd" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:48.989665 11349 raft_consensus.cc:3060] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.989741 11501 raft_consensus.cc:3055] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.990113 11501 raft_consensus.cc:740] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:48.990845 11501 consensus_queue.cc:260] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:48.992007 11501 raft_consensus.cc:3060] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.994186 12311 raft_consensus.cc:993] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.994666 12272 raft_consensus.cc:1081] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:48.996338 12081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57672
I20260709 12:12:48.996798 12081 raft_consensus.cc:493] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.997325 12081 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:48.997764 11349 raft_consensus.cc:2468] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:48.998010 11501 raft_consensus.cc:2468] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:48.998765 11390 leader_election.cc:304] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:48.999598 12330 raft_consensus.cc:2804] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:49.000039 12330 raft_consensus.cc:697] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:49.000840 12330 consensus_queue.cc:237] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:49.002676 12081 raft_consensus.cc:515] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:49.004823 12081 leader_election.cc:290] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:49.005095 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:49.005657 11422 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.011477 11422 raft_consensus.cc:2468] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 3.
I20260709 12:12:49.012419 12035 leader_election.cc:304] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:49.013142 12304 raft_consensus.cc:2804] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:49.013715 12304 raft_consensus.cc:697] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:49.013167 11176 catalog_manager.cc:5697] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 1 to 2, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 2 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.014532 12304 consensus_queue.cc:237] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:49.018224 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e04d1e1c941c46aa8589a0821e76d830" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:49.018823 11501 raft_consensus.cc:3055] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:49.019136 11501 raft_consensus.cc:740] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:49.020042 11501 consensus_queue.cc:260] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:49.021170 11501 raft_consensus.cc:3060] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.025116 12333 raft_consensus.cc:993] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:49.025606 12333 raft_consensus.cc:1081] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:49.027798 12081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57678
I20260709 12:12:49.028250 12081 raft_consensus.cc:493] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:49.028600 12081 raft_consensus.cc:3060] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:49.028637 11176 catalog_manager.cc:5697] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 2 to 3, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.029515 11501 raft_consensus.cc:2468] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 3.
I20260709 12:12:49.035552 12081 raft_consensus.cc:515] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:49.037294 12081 leader_election.cc:290] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:49.037959 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:49.038450 11501 raft_consensus.cc:3060] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:49.038937 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aab0de38956343e09d4f85cdd0797ead" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:49.039461 11349 raft_consensus.cc:3055] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:49.039742 11349 raft_consensus.cc:740] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:49.040442 11349 consensus_queue.cc:260] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:49.041409 11349 raft_consensus.cc:3060] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:49.043990 11501 raft_consensus.cc:2468] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:49.045020 12033 leader_election.cc:304] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:49.045648 12305 raft_consensus.cc:2804] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:49.046008 12305 raft_consensus.cc:697] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:49.046839 12305 consensus_queue.cc:237] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:49.047674 11349 raft_consensus.cc:2468] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:49.054419 11176 catalog_manager.cc:5697] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.291617 11501 raft_consensus.cc:1275] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.292608 12333 consensus_queue.cc:1048] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.300534 11427 raft_consensus.cc:1275] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.301839 12290 consensus_queue.cc:1048] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.355703 11501 raft_consensus.cc:1275] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.356793 12305 consensus_queue.cc:1048] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.365881 11427 raft_consensus.cc:1275] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.367002 12304 consensus_queue.cc:1048] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.508549 11501 raft_consensus.cc:1275] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.509559 12304 consensus_queue.cc:1048] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.517196 11348 raft_consensus.cc:1275] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.518626 12304 consensus_queue.cc:1048] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:12:49.533847 11501 raft_consensus.cc:1275] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.534828 12330 consensus_queue.cc:1048] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.544973 11349 raft_consensus.cc:1275] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.546573 12342 consensus_queue.cc:1048] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.549979 11427 raft_consensus.cc:1275] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 3 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:49.552337 12305 consensus_queue.cc:1048] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:49.575829 11501 raft_consensus.cc:1275] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:49.577374 12304 consensus_queue.cc:1048] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:49.914561  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:49.950281 11497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:49.950843 11497 raft_consensus.cc:606] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:49.953372 11349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:48710
I20260709 12:12:49.953876 11349 raft_consensus.cc:606] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:49.956432 11497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:49.958604 11497 raft_consensus.cc:606] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:49.962123 11427 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fff2a7419a4b29aa70e7b89e5d734f"
dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:59684
I20260709 12:12:49.962615 11427 raft_consensus.cc:606] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:49.965873 11497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3531bc235ff4e12b0d7be22a7b2d978"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:49.966224 11497 raft_consensus.cc:606] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:49.967077  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:49.968102  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:49.968606  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:50.035830 12272 raft_consensus.cc:993] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.036300 12311 raft_consensus.cc:1081] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.038089 12083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57672
I20260709 12:12:50.038468 12083 raft_consensus.cc:493] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.038688 12083 raft_consensus.cc:3060] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.044445 12083 raft_consensus.cc:515] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.045816 12083 leader_election.cc:290] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:50.046577 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:50.046627 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a75c00695f64bd1bf842779b19211c0" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:50.047071 11349 raft_consensus.cc:3060] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.047194 11497 raft_consensus.cc:3055] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:50.047587 11497 raft_consensus.cc:740] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:50.048280 11497 consensus_queue.cc:260] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.049326 11497 raft_consensus.cc:3060] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.052269 12293 raft_consensus.cc:993] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.052752 12342 raft_consensus.cc:1081] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.060627 12081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79fff2a7419a4b29aa70e7b89e5d734f"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57682
I20260709 12:12:50.061156 12081 raft_consensus.cc:493] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.061475 12081 raft_consensus.cc:3060] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.062067 11349 raft_consensus.cc:2468] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:50.062973 12032 leader_election.cc:304] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:50.063570 12305 raft_consensus.cc:2804] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:50.063941 12305 raft_consensus.cc:697] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:50.064730 12305 consensus_queue.cc:237] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.067829 12081 raft_consensus.cc:515] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:50.144364 11427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fff2a7419a4b29aa70e7b89e5d734f" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:50.144975 11427 raft_consensus.cc:3055] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:50.145263 11427 raft_consensus.cc:740] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:50.145970 11427 consensus_queue.cc:260] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:50.147032 11427 raft_consensus.cc:3060] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.148257 11497 raft_consensus.cc:2468] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:50.158669 11427 raft_consensus.cc:2468] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:50.165863 12081 leader_election.cc:290] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:50.166891 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fff2a7419a4b29aa70e7b89e5d734f" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:50.167469 11497 raft_consensus.cc:3060] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:50.160707 11317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 60852.8us
I20260709 12:12:50.169775 11173 catalog_manager.cc:5697] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.178783 12035 leader_election.cc:304] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c40041a85147a0bc5000c1aa44343e, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:50.181950 12361 raft_consensus.cc:2804] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:50.182561 12361 raft_consensus.cc:697] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:50.183380 12361 consensus_queue.cc:237] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:50.213580 11497 raft_consensus.cc:2468] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:50.216410 12364 raft_consensus.cc:993] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.216907 12364 raft_consensus.cc:1081] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.230316 12083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57678
I20260709 12:12:50.230816 12083 raft_consensus.cc:493] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.231175 12083 raft_consensus.cc:3060] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.231531 12311 raft_consensus.cc:993] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.231988 12311 raft_consensus.cc:1081] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.233620 12085 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57672
I20260709 12:12:50.234155 12085 raft_consensus.cc:493] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.234483 12085 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.238261 12083 raft_consensus.cc:515] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.240512 12083 leader_election.cc:290] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:50.240864 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:50.241420 11348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bbf184e378748efab2caeabdb1d91b2" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:50.243028 11348 raft_consensus.cc:3055] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:50.243294 11348 raft_consensus.cc:740] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:50.243887 11348 consensus_queue.cc:260] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.244663 11348 raft_consensus.cc:3060] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.244264 12085 raft_consensus.cc:515] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.248260 12311 raft_consensus.cc:993] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.249190 11501 raft_consensus.cc:3060] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.249907 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:50.250103 12272 raft_consensus.cc:1081] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:50.250438 11497 raft_consensus.cc:3055] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:50.250768 11497 raft_consensus.cc:740] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:50.251628 12081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3531bc235ff4e12b0d7be22a7b2d978"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57672
I20260709 12:12:50.251458 11497 consensus_queue.cc:260] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.252135 12081 raft_consensus.cc:493] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:50.252288 11497 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.252511 12081 raft_consensus.cc:3060] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.254079 12085 leader_election.cc:290] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:50.255012 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb7dfa5c3a47e4a1d57acd13660e0d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:50.255528 11349 raft_consensus.cc:3060] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:50.261495 11497 raft_consensus.cc:2468] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 3.
I20260709 12:12:50.262508 12033 leader_election.cc:304] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:50.263334 12305 raft_consensus.cc:2804] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:50.263775 12305 raft_consensus.cc:697] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:50.264909 12305 consensus_queue.cc:237] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.265991 11348 raft_consensus.cc:2468] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:50.271163 11349 raft_consensus.cc:2468] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 3.
I20260709 12:12:50.272046 12032 leader_election.cc:304] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:50.279292 12305 raft_consensus.cc:2804] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:50.279800 12305 raft_consensus.cc:697] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:50.280625 12305 consensus_queue.cc:237] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.281374 11173 catalog_manager.cc:5697] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 20c40041a85147a0bc5000c1aa44343e (127.3.163.67) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.269507 11501 raft_consensus.cc:2468] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:50.283147 11173 catalog_manager.cc:5697] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 2 to 3, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.294557 12081 raft_consensus.cc:515] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.296846 11497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3531bc235ff4e12b0d7be22a7b2d978" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:50.297358 11497 raft_consensus.cc:3055] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:50.297626 11497 raft_consensus.cc:740] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:50.298305 11497 consensus_queue.cc:260] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.299273 11497 raft_consensus.cc:3060] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.302587 12081 leader_election.cc:290] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:50.303488 11348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3531bc235ff4e12b0d7be22a7b2d978" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:50.304077 11348 raft_consensus.cc:3060] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.305341 11497 raft_consensus.cc:2468] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:50.307063 12033 leader_election.cc:304] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:50.307828 12305 raft_consensus.cc:2804] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:50.308262 12305 raft_consensus.cc:697] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:50.309123 12305 consensus_queue.cc:237] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:50.309870 11348 raft_consensus.cc:2468] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:50.311146 11173 catalog_manager.cc:5697] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.323232 11173 catalog_manager.cc:5697] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.451956 11497 raft_consensus.cc:1275] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.453146 12305 consensus_queue.cc:1048] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.463191 11348 raft_consensus.cc:1275] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.464485 12304 consensus_queue.cc:1048] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.697022 11497 raft_consensus.cc:1275] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.698011 12328 consensus_queue.cc:1048] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.708920 11348 raft_consensus.cc:1275] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.711344 12304 consensus_queue.cc:1048] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:50.737268 11348 raft_consensus.cc:1275] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:50.737960 11497 raft_consensus.cc:1275] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.738404 12328 consensus_queue.cc:1048] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:50.739319 12304 consensus_queue.cc:1048] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.762892 11501 raft_consensus.cc:1275] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.764670 12361 consensus_queue.cc:1048] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.765944 11497 raft_consensus.cc:1275] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:50.770411 12361 consensus_queue.cc:1048] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:50.795118 11349 raft_consensus.cc:1275] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.797102 12328 consensus_queue.cc:1048] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:50.798537 11391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.68:34547, user_credentials={real_user=slave}} blocked reactor thread for 46985.8us
I20260709 12:12:50.799872 11427 raft_consensus.cc:1275] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:50.805400 12305 consensus_queue.cc:1048] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:50.999260  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:51.031806 11501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e399427af66e44d79c315f13efd5c353"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:51.032260 11501 raft_consensus.cc:606] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Received request to transfer leadership to TS 0ddfa5fdeb884fe4bd42def0e21f1081
I20260709 12:12:51.034523 11501 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384"
dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
mode: GRACEFUL
new_leader_uuid: "20c40041a85147a0bc5000c1aa44343e"
 from {username='slave'} at 127.0.0.1:34560
I20260709 12:12:51.035004 11501 raft_consensus.cc:606] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Received request to transfer leadership to TS 20c40041a85147a0bc5000c1aa44343e
I20260709 12:12:51.036128  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:51.037612  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:51.038280  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:51.074747 12370 raft_consensus.cc:993] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 0ddfa5fdeb884fe4bd42def0e21f1081 to start an election
I20260709 12:12:51.075255 12272 raft_consensus.cc:1081] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Signalling peer 0ddfa5fdeb884fe4bd42def0e21f1081 to start an election
I20260709 12:12:51.076500 11348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e399427af66e44d79c315f13efd5c353"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
 from {username='slave'} at 127.0.0.1:55820
I20260709 12:12:51.076907 11348 raft_consensus.cc:493] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.077172 11348 raft_consensus.cc:3060] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.082804 11348 raft_consensus.cc:515] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:51.085074 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e399427af66e44d79c315f13efd5c353" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:51.085096 11348 leader_election.cc:290] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:51.085654 11422 raft_consensus.cc:3060] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.085649 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e399427af66e44d79c315f13efd5c353" candidate_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:51.089370 11501 raft_consensus.cc:3055] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:51.089665 11501 raft_consensus.cc:740] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:51.090296 11422 raft_consensus.cc:2468] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:51.090319 11501 consensus_queue.cc:260] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:51.091287 11319 leader_election.cc:304] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:51.091737 11501 raft_consensus.cc:3060] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.092162 12294 raft_consensus.cc:2804] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:51.092933 12294 raft_consensus.cc:697] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Becoming Leader. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:51.093748 12294 consensus_queue.cc:237] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:51.098773 11501 raft_consensus.cc:2468] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ddfa5fdeb884fe4bd42def0e21f1081 in term 2.
I20260709 12:12:51.102800 11173 catalog_manager.cc:5697] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 reported cstate change: term changed from 1 to 2, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.336727 12370 raft_consensus.cc:993] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28: : Instructing follower 20c40041a85147a0bc5000c1aa44343e to start an election
I20260709 12:12:51.337167 12272 raft_consensus.cc:1081] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Signalling peer 20c40041a85147a0bc5000c1aa44343e to start an election
I20260709 12:12:51.338356 11422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384"
dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
 from {username='slave'} at 127.0.0.1:54356
I20260709 12:12:51.338771 11422 raft_consensus.cc:493] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.339082 11422 raft_consensus.cc:3060] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.343955 11422 raft_consensus.cc:515] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:51.345724 11422 leader_election.cc:290] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Requested vote from peers 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:51.347419 11501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:51.347970 11501 raft_consensus.cc:3055] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:51.347083 11348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2299ef9f6f241bbbb8cb5faf9e7c384" candidate_uuid: "20c40041a85147a0bc5000c1aa44343e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:51.348318 11501 raft_consensus.cc:740] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b6d95e83cd149f88775563c5514ba28, State: Running, Role: LEADER
I20260709 12:12:51.348579 11348 raft_consensus.cc:3060] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.349678 11501 consensus_queue.cc:260] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:51.350842 11501 raft_consensus.cc:3060] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.354708 11348 raft_consensus.cc:2468] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:51.355726 11390 leader_election.cc:304] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 20c40041a85147a0bc5000c1aa44343e; no voters: 
I20260709 12:12:51.356320 12342 raft_consensus.cc:2804] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:51.356774 12342 raft_consensus.cc:697] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Becoming Leader. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:51.357451 11501 raft_consensus.cc:2468] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c40041a85147a0bc5000c1aa44343e in term 2.
I20260709 12:12:51.357595 12342 consensus_queue.cc:237] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } }
I20260709 12:12:51.375357 11173 catalog_manager.cc:5697] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e reported cstate change: term changed from 1 to 2, leader changed from 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68) to 20c40041a85147a0bc5000c1aa44343e (127.3.163.67). New cstate: current_term: 2 leader_uuid: "20c40041a85147a0bc5000c1aa44343e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.532205 11422 raft_consensus.cc:1275] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:51.533224 12294 consensus_queue.cc:1048] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:51.546265 11501 raft_consensus.cc:1275] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 0ddfa5fdeb884fe4bd42def0e21f1081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:51.547407 12294 consensus_queue.cc:1048] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:51.859061 11349 raft_consensus.cc:1275] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:51.860170 12383 consensus_queue.cc:1048] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:51.870666 11501 raft_consensus.cc:1275] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 20c40041a85147a0bc5000c1aa44343e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:51.874121 12400 consensus_queue.cc:1048] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.077370  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:52.112936 11349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d"
dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:48710
I20260709 12:12:52.113384 11349 raft_consensus.cc:606] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:52.115584 11422 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58"
dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
mode: GRACEFUL
new_leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:59684
I20260709 12:12:52.116092 11422 raft_consensus.cc:606] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Received request to transfer leadership to TS 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:52.117064  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:52.118047  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:52.118554  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:52.215708 12403 raft_consensus.cc:993] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:52.216123 12364 raft_consensus.cc:1081] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:52.217334 12081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57678
I20260709 12:12:52.217717 12081 raft_consensus.cc:493] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:52.217985 12081 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:52.222720 12081 raft_consensus.cc:515] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:52.224819 12081 leader_election.cc:290] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 election: Requested vote from peers 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:52.225135 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:52.225334 11349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "079d6cbc93b340bfb2dd2022db8bc00d" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081"
I20260709 12:12:52.225716 11498 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:52.225904 11349 raft_consensus.cc:3055] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:52.226326 11349 raft_consensus.cc:740] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ddfa5fdeb884fe4bd42def0e21f1081, State: Running, Role: LEADER
I20260709 12:12:52.226886 11349 consensus_queue.cc:260] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:52.228011 11349 raft_consensus.cc:3060] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:52.232563 11498 raft_consensus.cc:2468] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 3.
I20260709 12:12:52.233688 12033 leader_election.cc:304] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:52.234405 12361 raft_consensus.cc:2804] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:52.234992 12361 raft_consensus.cc:697] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:52.235746 12361 consensus_queue.cc:237] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:52.243199 11349 raft_consensus.cc:2468] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 3.
I20260709 12:12:52.256604 11174 catalog_manager.cc:5697] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 2 to 3, leader changed from 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 3 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.432548 12400 raft_consensus.cc:993] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e: : Instructing follower 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:52.432999 12342 raft_consensus.cc:1081] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Signalling peer 8cd91ce67df74245a4fcfd0c7c799002 to start an election
I20260709 12:12:52.434172 12081 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58"
dest_uuid: "8cd91ce67df74245a4fcfd0c7c799002"
 from {username='slave'} at 127.0.0.1:57682
I20260709 12:12:52.434566 12081 raft_consensus.cc:493] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:52.434805 12081 raft_consensus.cc:3060] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.439168 12081 raft_consensus.cc:515] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:52.440490 12081 leader_election.cc:290] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Requested vote from peers 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889), 8b6d95e83cd149f88775563c5514ba28 (127.3.163.68:34547)
I20260709 12:12:52.441033 11422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c40041a85147a0bc5000c1aa44343e"
I20260709 12:12:52.441509 11498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fcf2221d70d421fa3aa00ebd33d3a58" candidate_uuid: "8cd91ce67df74245a4fcfd0c7c799002" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b6d95e83cd149f88775563c5514ba28"
I20260709 12:12:52.441612 11422 raft_consensus.cc:3055] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:52.442148 11422 raft_consensus.cc:740] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c40041a85147a0bc5000c1aa44343e, State: Running, Role: LEADER
I20260709 12:12:52.442154 11498 raft_consensus.cc:3060] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.443594 11422 consensus_queue.cc:260] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:52.444497 11422 raft_consensus.cc:3060] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.446760 11498 raft_consensus.cc:2468] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:52.447561 12033 leader_election.cc:304] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28, 8cd91ce67df74245a4fcfd0c7c799002; no voters: 
I20260709 12:12:52.448292 12361 raft_consensus.cc:2804] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:52.448652 12361 raft_consensus.cc:697] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Becoming Leader. State: Replica: 8cd91ce67df74245a4fcfd0c7c799002, State: Running, Role: LEADER
I20260709 12:12:52.449164 11422 raft_consensus.cc:2468] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cd91ce67df74245a4fcfd0c7c799002 in term 2.
I20260709 12:12:52.449316 12361 consensus_queue.cc:237] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } }
I20260709 12:12:52.465304 11174 catalog_manager.cc:5697] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 reported cstate change: term changed from 1 to 2, leader changed from 20c40041a85147a0bc5000c1aa44343e (127.3.163.67) to 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "8cd91ce67df74245a4fcfd0c7c799002" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.745780 11498 raft_consensus.cc:1275] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:52.748472 12384 consensus_queue.cc:1048] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:52.797751 11349 raft_consensus.cc:1275] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:52.804915 12361 consensus_queue.cc:1048] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:52.866904 11500 raft_consensus.cc:1275] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.868681 12414 consensus_queue.cc:1048] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:52.882133 11427 raft_consensus.cc:1275] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Refusing update from remote peer 8cd91ce67df74245a4fcfd0c7c799002: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.883400 12414 consensus_queue.cc:1048] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c40041a85147a0bc5000c1aa44343e" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 35889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:53.150099  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:53.192730  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:53.194146  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:53.195767  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:53.239144  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:53.270833  3725 tablet_server.cc:179] TabletServer@127.3.163.65:32937 shutting down...
I20260709 12:12:53.303753  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:53.304658  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.305851  3725 raft_consensus.cc:2243] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.306842  3725 raft_consensus.cc:2272] T 4bbf184e378748efab2caeabdb1d91b2 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.307482 11318 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 66 similar messages]
I20260709 12:12:53.310166  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.311307  3725 raft_consensus.cc:2243] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.311757  3725 raft_consensus.cc:2272] T 2e442d52cd804d5fb247d09bf369c51d P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.311846 11318 consensus_peers.cc:597] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.314159  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.314759  3725 raft_consensus.cc:2243] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.315162  3725 raft_consensus.cc:2272] T 01c2239cec004da49f946e92b5d2ccf5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.317763  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.318347  3725 raft_consensus.cc:2243] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.318714  3725 raft_consensus.cc:2272] T cf819e5fabb44ecb9cb0235c718d87d5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.320921  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.321660  3725 raft_consensus.cc:2243] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.322094  3725 raft_consensus.cc:2272] T 10568811bd7a4972a6452da865f47f6c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.325573  3725 tablet_replica.cc:333] stopping tablet replica
W20260709 12:12:53.326365 11466 consensus_peers.cc:597] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.326459  3725 raft_consensus.cc:2243] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:12:53.326812 11392 consensus_peers.cc:597] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.327589  3725 raft_consensus.cc:2272] T e2512ccc1e8f45bab654f70492174d5e P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.329632  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.330219  3725 raft_consensus.cc:2243] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.330610  3725 raft_consensus.cc:2272] T f5328e5b3864423ca644295147703ecb P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.333063  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.334123  3725 raft_consensus.cc:2243] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.334712  3725 raft_consensus.cc:2272] T ad441508cb3d4912a21a23a55b982ae3 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.337051 11318 consensus_peers.cc:597] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.337332  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.338037  3725 raft_consensus.cc:2243] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.338562  3725 raft_consensus.cc:2272] T d0d5bebe45ea4b57b7ace8bb13073461 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.341563  3725 tablet_replica.cc:333] stopping tablet replica
W20260709 12:12:53.342387 11392 consensus_peers.cc:597] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.342484  3725 raft_consensus.cc:2243] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.343298  3725 raft_consensus.cc:2272] T e0c6b4483ba043e6a4a5871e772e01ed P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.345623 11318 consensus_peers.cc:597] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.346290 11318 consensus_peers.cc:597] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.346521  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.347118  3725 raft_consensus.cc:2243] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.348284  3725 raft_consensus.cc:2272] T aab0de38956343e09d4f85cdd0797ead P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.351001  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.351724  3725 raft_consensus.cc:2243] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.352196  3725 raft_consensus.cc:2272] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.354669 11392 consensus_peers.cc:597] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.355244  3725 tablet_replica.cc:333] stopping tablet replica
W20260709 12:12:53.355749 11466 consensus_peers.cc:597] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.356287  3725 raft_consensus.cc:2243] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.356825  3725 raft_consensus.cc:2272] T 8b687d036fd54d868cb28b2308d0d689 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.357867 11466 consensus_peers.cc:597] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.359253  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.359866  3725 raft_consensus.cc:2243] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.360266  3725 raft_consensus.cc:2272] T 8d75399439f14d43b801446067d46c8a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.363091  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.363830  3725 raft_consensus.cc:2243] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.364310  3725 raft_consensus.cc:2272] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.367054  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.367767  3725 raft_consensus.cc:2243] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.368758  3725 raft_consensus.cc:2272] T 079d6cbc93b340bfb2dd2022db8bc00d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.371282 11466 consensus_peers.cc:597] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.378634  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.379294  3725 raft_consensus.cc:2243] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.380044  3725 raft_consensus.cc:2272] T f3531bc235ff4e12b0d7be22a7b2d978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.382156  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.382714  3725 raft_consensus.cc:2243] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.383503  3725 raft_consensus.cc:2272] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.385933  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.386399  3725 raft_consensus.cc:2243] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.387274  3725 raft_consensus.cc:2272] T 8dc72ff56ccb4ae79079d36d4b125e0b P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.389705  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.390300  3725 raft_consensus.cc:2243] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.390722  3725 raft_consensus.cc:2272] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.393286  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.393790  3725 raft_consensus.cc:2243] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.394162  3725 raft_consensus.cc:2272] T c6743232edbd4f6997be3eb0f234a8b5 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.396522  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.397231  3725 raft_consensus.cc:2243] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.397660  3725 raft_consensus.cc:2272] T efc1dc6f02704e20829bc173c24d3725 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.397732 11318 consensus_peers.cc:597] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.400650  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.401507  3725 raft_consensus.cc:2243] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.401952  3725 raft_consensus.cc:2272] T 91bec71eba2d41c6929bdff648f3d1a0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.404387  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.405179  3725 raft_consensus.cc:2243] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.405673  3725 raft_consensus.cc:2272] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.407904 11318 consensus_peers.cc:597] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.408664  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.409370  3725 raft_consensus.cc:2243] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:12:53.410178 11392 consensus_peers.cc:597] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.410331  3725 raft_consensus.cc:2272] T 9b0efa61df04448da748e040931fad71 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.412480  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.413062  3725 raft_consensus.cc:2243] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.413476  3725 raft_consensus.cc:2272] T f6536bd733514fbb927281bf18c6fa23 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.415427  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.415971  3725 raft_consensus.cc:2243] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.416842  3725 raft_consensus.cc:2272] T 320ba867e2f0452ea522852c10247484 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.419719  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.420315  3725 raft_consensus.cc:2243] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.421135  3725 raft_consensus.cc:2272] T 79fff2a7419a4b29aa70e7b89e5d734f P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.423137  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.423856  3725 raft_consensus.cc:2243] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.424317  3725 raft_consensus.cc:2272] T e41052c070b94d9eb8b24b2b57890c0a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.426738  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.427304  3725 raft_consensus.cc:2243] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.428324  3725 raft_consensus.cc:2272] T 229f7766e18a403594735eac02aebb69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.430359  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.430907  3725 raft_consensus.cc:2243] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.431265  3725 raft_consensus.cc:2272] T 92e0cc76fe3c414896806d01bdc14d60 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.433110  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.433593  3725 raft_consensus.cc:2243] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.433959  3725 raft_consensus.cc:2272] T 3ddbedffb2a547f09b0683e1b8e90e69 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.436338  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.436968  3725 raft_consensus.cc:2243] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.437323  3725 raft_consensus.cc:2272] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.439272  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.439736  3725 raft_consensus.cc:2243] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.440389  3725 raft_consensus.cc:2272] T 64e5700fed174a83ac83c3d104965013 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.443110  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.443779  3725 raft_consensus.cc:2243] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.444249  3725 raft_consensus.cc:2272] T a7182aba132c4c0c8c8d9a45d8a2b978 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.447057  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.447587  3725 raft_consensus.cc:2243] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.447935  3725 raft_consensus.cc:2272] T 6c40b4b0fb044dd893a3a58ce7749e98 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.449986  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.450637  3725 raft_consensus.cc:2243] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.451098  3725 raft_consensus.cc:2272] T 904deb919d4b42b290b40955d7eb0154 P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.453622  3725 tablet_replica.cc:333] stopping tablet replica
W20260709 12:12:53.454169 11466 consensus_peers.cc:597] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.454344  3725 raft_consensus.cc:2243] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.455423  3725 raft_consensus.cc:2272] T e04d1e1c941c46aa8589a0821e76d830 P 8cd91ce67df74245a4fcfd0c7c799002 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.458396  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.459049  3725 raft_consensus.cc:2243] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:12:53.459550 11392 consensus_peers.cc:597] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.459929  3725 raft_consensus.cc:2272] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.462790  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.463490  3725 raft_consensus.cc:2243] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.464015  3725 raft_consensus.cc:2272] T ca875d67c8364f99b00734f80028f1ff P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.466938  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.467537  3725 raft_consensus.cc:2243] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.468019  3725 raft_consensus.cc:2272] T c66055995f9841a4b9356659c6ff082c P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.470849  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.471498  3725 raft_consensus.cc:2243] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:53.471531 11392 consensus_peers.cc:597] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.472177  3725 raft_consensus.cc:2272] T a761f8e443864779b5216933f3dfe795 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.474619  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.475106  3725 raft_consensus.cc:2243] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.475800  3725 raft_consensus.cc:2272] T 0a75c00695f64bd1bf842779b19211c0 P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.477764  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.478210  3725 raft_consensus.cc:2243] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.478551  3725 raft_consensus.cc:2272] T 969c64b986d444c19757cf5ce94bb8bc P 8cd91ce67df74245a4fcfd0c7c799002 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.480455  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:53.480940  3725 raft_consensus.cc:2243] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.481325  3725 raft_consensus.cc:2272] T 805b5febce314019a60dc7fe2f77b2cf P 8cd91ce67df74245a4fcfd0c7c799002 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.503211 11466 consensus_peers.cc:597] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.552120  3725 tablet_server.cc:196] TabletServer@127.3.163.65:32937 shutdown complete.
W20260709 12:12:53.608402 11466 consensus_peers.cc:597] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.628854 11392 consensus_peers.cc:597] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.629858  3725 tablet_server.cc:179] TabletServer@127.3.163.66:0 shutting down...
W20260709 12:12:53.641422 11390 consensus_peers.cc:597] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.652756 11318 consensus_peers.cc:597] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.655901 11464 consensus_peers.cc:597] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.661033 11392 consensus_peers.cc:597] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.678972 11318 consensus_peers.cc:597] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.682611  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:53.683588  3725 tablet_replica.cc:333] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.684528  3725 raft_consensus.cc:2243] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.685171  3725 raft_consensus.cc:2272] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.688139  3725 tablet_replica.cc:333] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.689075  3725 raft_consensus.cc:2243] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.689615  3725 raft_consensus.cc:2272] T 3ed543b345014451bd60ddfb0b548dd6 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.692330  3725 tablet_replica.cc:333] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
W20260709 12:12:53.690127 11390 consensus_peers.cc:597] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.693224  3725 raft_consensus.cc:2243] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.693799  3725 raft_consensus.cc:2272] T 805b5febce314019a60dc7fe2f77b2cf P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.695384 11318 consensus_peers.cc:597] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.696326  3725 tablet_replica.cc:333] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.697255  3725 raft_consensus.cc:2243] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:53.697784 11318 consensus_peers.cc:597] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.697785  3725 raft_consensus.cc:2272] T 969c64b986d444c19757cf5ce94bb8bc P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.700651  3725 tablet_replica.cc:333] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.701635  3725 raft_consensus.cc:2243] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:12:53.702585 11466 consensus_peers.cc:597] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.702802  3725 raft_consensus.cc:2272] T 6c40b4b0fb044dd893a3a58ce7749e98 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.704229 11464 consensus_peers.cc:597] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.706022  3725 tablet_replica.cc:333] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.706874  3725 raft_consensus.cc:2243] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.707419  3725 raft_consensus.cc:2272] T 01c2239cec004da49f946e92b5d2ccf5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.710305  3725 tablet_replica.cc:333] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.710860  3725 raft_consensus.cc:2243] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.711330  3725 raft_consensus.cc:2272] T 320ba867e2f0452ea522852c10247484 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.713388  3725 tablet_replica.cc:333] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.713964  3725 raft_consensus.cc:2243] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.714709  3725 raft_consensus.cc:2272] T a7182aba132c4c0c8c8d9a45d8a2b978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.716830  3725 tablet_replica.cc:333] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.717391  3725 raft_consensus.cc:2243] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.718173  3725 raft_consensus.cc:2272] T 64e5700fed174a83ac83c3d104965013 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.721628  3725 tablet_replica.cc:333] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
W20260709 12:12:53.721757 11464 consensus_peers.cc:597] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.722333  3725 raft_consensus.cc:2243] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.722849  3725 raft_consensus.cc:2272] T aab0de38956343e09d4f85cdd0797ead P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.725378  3725 tablet_replica.cc:333] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.726146  3725 raft_consensus.cc:2243] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.726715  3725 raft_consensus.cc:2272] T 0a75c00695f64bd1bf842779b19211c0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.729977  3725 tablet_replica.cc:333] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.730751  3725 raft_consensus.cc:2243] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.731372  3725 raft_consensus.cc:2272] T ca875d67c8364f99b00734f80028f1ff P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.734125  3725 tablet_replica.cc:333] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.734877  3725 raft_consensus.cc:2243] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.735476  3725 raft_consensus.cc:2272] T dc00a1ea01644d14b64b6826164bf7e5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.738443  3725 tablet_replica.cc:333] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.738948  3725 raft_consensus.cc:2243] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.739671  3725 raft_consensus.cc:2272] T c66055995f9841a4b9356659c6ff082c P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.741642  3725 tablet_replica.cc:333] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.742304  3725 raft_consensus.cc:2243] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.742722  3725 raft_consensus.cc:2272] T f3531bc235ff4e12b0d7be22a7b2d978 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.744994  3725 tablet_replica.cc:333] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
W20260709 12:12:53.745308 11392 consensus_peers.cc:597] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.745483  3725 raft_consensus.cc:2243] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.746004  3725 raft_consensus.cc:2272] T 079d6cbc93b340bfb2dd2022db8bc00d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.748261  3725 tablet_replica.cc:333] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.748847  3725 raft_consensus.cc:2243] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.749238  3725 raft_consensus.cc:2272] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.751910  3725 tablet_replica.cc:333] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.752658  3725 raft_consensus.cc:2243] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.753225  3725 raft_consensus.cc:2272] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.754101 11390 consensus_peers.cc:597] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.755425  3725 tablet_replica.cc:333] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.755944  3725 raft_consensus.cc:2243] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.756927  3725 raft_consensus.cc:2272] T c68a9fb3e63a45119c4c6ebf7623679d P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.758862  3725 tablet_replica.cc:333] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.759428  3725 raft_consensus.cc:2243] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.760249  3725 raft_consensus.cc:2272] T 8b687d036fd54d868cb28b2308d0d689 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.762354  3725 tablet_replica.cc:333] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.762859  3725 raft_consensus.cc:2243] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.763244  3725 raft_consensus.cc:2272] T 8b90ac113f32492b8af9dee4c36614cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.765849  3725 tablet_replica.cc:333] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.766557  3725 raft_consensus.cc:2243] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.767066  3725 raft_consensus.cc:2272] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.769598  3725 tablet_replica.cc:333] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.770242  3725 raft_consensus.cc:2243] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.771045  3725 raft_consensus.cc:2272] T 6b43b6a73ce34d7297843d8f7ebc611e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.771284 11466 consensus_peers.cc:597] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.772955  3725 tablet_replica.cc:333] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.773520  3725 raft_consensus.cc:2243] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.773959  3725 raft_consensus.cc:2272] T e41052c070b94d9eb8b24b2b57890c0a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.775820  3725 tablet_replica.cc:333] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.776306  3725 raft_consensus.cc:2243] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.777176  3725 raft_consensus.cc:2272] T 92e0cc76fe3c414896806d01bdc14d60 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.780354  3725 tablet_replica.cc:333] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.781067  3725 raft_consensus.cc:2243] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:53.781495 11466 consensus_peers.cc:597] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.781548  3725 raft_consensus.cc:2272] T 5963410c1ae543ee83abf42430c2ac10 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.783497  3725 tablet_replica.cc:333] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.783999  3725 raft_consensus.cc:2243] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.784658  3725 raft_consensus.cc:2272] T 3ddbedffb2a547f09b0683e1b8e90e69 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.786448  3725 tablet_replica.cc:333] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.786929  3725 raft_consensus.cc:2243] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.787288  3725 raft_consensus.cc:2272] T f6536bd733514fbb927281bf18c6fa23 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.789105  3725 tablet_replica.cc:333] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.789583  3725 raft_consensus.cc:2243] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.789978  3725 raft_consensus.cc:2272] T 7f12446f58fb4e5a867bb73ea759e3cd P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.791683  3725 tablet_replica.cc:333] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.792166  3725 raft_consensus.cc:2243] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.792564  3725 raft_consensus.cc:2272] T 9b0efa61df04448da748e040931fad71 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.794565  3725 tablet_replica.cc:333] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.795042  3725 raft_consensus.cc:2243] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.795734  3725 raft_consensus.cc:2272] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.797525  3725 tablet_replica.cc:333] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.798020  3725 raft_consensus.cc:2243] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.798712  3725 raft_consensus.cc:2272] T efc1dc6f02704e20829bc173c24d3725 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.800580  3725 tablet_replica.cc:333] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.801085  3725 raft_consensus.cc:2243] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.801455  3725 raft_consensus.cc:2272] T 91bec71eba2d41c6929bdff648f3d1a0 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.803228  3725 tablet_replica.cc:333] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.803802  3725 raft_consensus.cc:2243] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.804785  3725 raft_consensus.cc:2272] T ad441508cb3d4912a21a23a55b982ae3 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.807451  3725 tablet_replica.cc:333] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.808197  3725 raft_consensus.cc:2243] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.808622  3725 raft_consensus.cc:2272] T 34c01bb891f44a2990eb8b9b41aa3e1a P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.811041 11466 consensus_peers.cc:597] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.811148  3725 tablet_replica.cc:333] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.811931  3725 raft_consensus.cc:2243] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.812470  3725 raft_consensus.cc:2272] T 4bbf184e378748efab2caeabdb1d91b2 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.814642  3725 tablet_replica.cc:333] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.815114  3725 raft_consensus.cc:2243] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.815448  3725 raft_consensus.cc:2272] T 7db72482cd1247f689e8f82c76c75e27 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.817451  3725 tablet_replica.cc:333] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.818137  3725 raft_consensus.cc:2243] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.819041  3725 raft_consensus.cc:2272] T e399427af66e44d79c315f13efd5c353 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.821729  3725 tablet_replica.cc:333] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.822469  3725 raft_consensus.cc:2243] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.823017  3725 raft_consensus.cc:2272] T 8dc72ff56ccb4ae79079d36d4b125e0b P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.823907 11466 consensus_peers.cc:597] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 -> Peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Couldn't send request to peer 8cd91ce67df74245a4fcfd0c7c799002. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.825748  3725 tablet_replica.cc:333] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.826459  3725 raft_consensus.cc:2243] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.827376  3725 raft_consensus.cc:2272] T 7a1d4b7cb4344bdc8344faf45dc2167f P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.829965  3725 tablet_replica.cc:333] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.830567  3725 raft_consensus.cc:2243] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:53.831369  3725 raft_consensus.cc:2272] T c614ce4bca814377bb079b966180edce P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.833235  3725 tablet_replica.cc:333] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.833650  3725 raft_consensus.cc:2243] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.833982  3725 raft_consensus.cc:2272] T e2512ccc1e8f45bab654f70492174d5e P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.835719  3725 tablet_replica.cc:333] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.836139  3725 raft_consensus.cc:2243] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.836498  3725 raft_consensus.cc:2272] T ac6ca7e153ce4227bb8917fb38574ec5 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:53.838403  3725 tablet_replica.cc:333] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081: stopping tablet replica
I20260709 12:12:53.838810  3725 raft_consensus.cc:2243] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:53.839131  3725 raft_consensus.cc:2272] T 904deb919d4b42b290b40955d7eb0154 P 0ddfa5fdeb884fe4bd42def0e21f1081 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:53.844379 11390 consensus_peers.cc:597] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.856099 11464 consensus_peers.cc:597] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.860240 11464 consensus_peers.cc:597] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.866858 11390 consensus_peers.cc:597] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.910434  3725 tablet_server.cc:196] TabletServer@127.3.163.66:0 shutdown complete.
W20260709 12:12:53.943759 11390 consensus_peers.cc:597] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.969388 11390 consensus_peers.cc:597] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.974094 11464 consensus_peers.cc:597] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.987496 11390 consensus_peers.cc:597] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:53.990104 11390 consensus_peers.cc:597] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:53.996726  3725 tablet_server.cc:179] TabletServer@127.3.163.67:0 shutting down...
W20260709 12:12:54.015197 11464 consensus_peers.cc:597] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:54.022768 11464 consensus_peers.cc:597] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.038697  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:54.039366  3725 tablet_replica.cc:333] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.040139  3725 raft_consensus.cc:2243] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.041106  3725 raft_consensus.cc:2272] T 2e442d52cd804d5fb247d09bf369c51d P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:54.043232 11467 consensus_peers.cc:597] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.043713  3725 tablet_replica.cc:333] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.044404  3725 raft_consensus.cc:2243] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.044838  3725 raft_consensus.cc:2272] T cf819e5fabb44ecb9cb0235c718d87d5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.046675  3725 tablet_replica.cc:333] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.047214  3725 raft_consensus.cc:2243] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.047905  3725 raft_consensus.cc:2272] T a4ab1731cb8c4d9b91d8b33ada1a7e55 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.049710  3725 tablet_replica.cc:333] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.050239  3725 raft_consensus.cc:2243] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.050621  3725 raft_consensus.cc:2272] T 6c40b4b0fb044dd893a3a58ce7749e98 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.052364  3725 tablet_replica.cc:333] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.052915  3725 raft_consensus.cc:2243] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.053313  3725 raft_consensus.cc:2272] T a761f8e443864779b5216933f3dfe795 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.055430  3725 tablet_replica.cc:333] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.056169  3725 raft_consensus.cc:2243] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.057226  3725 raft_consensus.cc:2272] T 01c2239cec004da49f946e92b5d2ccf5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.059640  3725 tablet_replica.cc:333] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.060449  3725 raft_consensus.cc:2243] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.060950  3725 raft_consensus.cc:2272] T e0c6b4483ba043e6a4a5871e772e01ed P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.063782  3725 tablet_replica.cc:333] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.064462  3725 raft_consensus.cc:2243] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.064939  3725 raft_consensus.cc:2272] T f5328e5b3864423ca644295147703ecb P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.067255  3725 tablet_replica.cc:333] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.067721  3725 raft_consensus.cc:2243] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.068409  3725 raft_consensus.cc:2272] T dc00a1ea01644d14b64b6826164bf7e5 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.070295  3725 tablet_replica.cc:333] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.070884  3725 raft_consensus.cc:2243] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.071378  3725 raft_consensus.cc:2272] T c66055995f9841a4b9356659c6ff082c P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:54.072888 11467 consensus_peers.cc:597] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.073698  3725 tablet_replica.cc:333] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.074226  3725 raft_consensus.cc:2243] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.074577  3725 raft_consensus.cc:2272] T a7182aba132c4c0c8c8d9a45d8a2b978 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.076508  3725 tablet_replica.cc:333] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.077077  3725 raft_consensus.cc:2243] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.077431  3725 raft_consensus.cc:2272] T 64e5700fed174a83ac83c3d104965013 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.079360  3725 tablet_replica.cc:333] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.079862  3725 raft_consensus.cc:2243] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.080551  3725 raft_consensus.cc:2272] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.082388  3725 tablet_replica.cc:333] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.082872  3725 raft_consensus.cc:2243] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.083199  3725 raft_consensus.cc:2272] T c68a9fb3e63a45119c4c6ebf7623679d P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.084896  3725 tablet_replica.cc:333] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.085348  3725 raft_consensus.cc:2243] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.086005  3725 raft_consensus.cc:2272] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.087724  3725 tablet_replica.cc:333] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.088186  3725 raft_consensus.cc:2243] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.088524  3725 raft_consensus.cc:2272] T 8b687d036fd54d868cb28b2308d0d689 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.090253  3725 tablet_replica.cc:333] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.090790  3725 raft_consensus.cc:2243] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.091594  3725 raft_consensus.cc:2272] T 7f12446f58fb4e5a867bb73ea759e3cd P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:54.093333 11467 consensus_peers.cc:597] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.093773  3725 tablet_replica.cc:333] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.094317  3725 raft_consensus.cc:2243] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.094704  3725 raft_consensus.cc:2272] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.096482  3725 tablet_replica.cc:333] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.097002  3725 raft_consensus.cc:2243] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.097365  3725 raft_consensus.cc:2272] T 8b90ac113f32492b8af9dee4c36614cd P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.099028  3725 tablet_replica.cc:333] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.099514  3725 raft_consensus.cc:2243] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.100211  3725 raft_consensus.cc:2272] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.102042  3725 tablet_replica.cc:333] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.102552  3725 raft_consensus.cc:2243] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.102937  3725 raft_consensus.cc:2272] T 3ddbedffb2a547f09b0683e1b8e90e69 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.104715  3725 tablet_replica.cc:333] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.105345  3725 raft_consensus.cc:2243] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.105717  3725 raft_consensus.cc:2272] T 6b43b6a73ce34d7297843d8f7ebc611e P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.107561  3725 tablet_replica.cc:333] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.108222  3725 raft_consensus.cc:2243] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.108614  3725 raft_consensus.cc:2272] T 92e0cc76fe3c414896806d01bdc14d60 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.110599  3725 tablet_replica.cc:333] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.111110  3725 raft_consensus.cc:2243] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.111474  3725 raft_consensus.cc:2272] T 229f7766e18a403594735eac02aebb69 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:54.111894 11464 consensus_peers.cc:597] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 -> Peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Couldn't send request to peer 0ddfa5fdeb884fe4bd42def0e21f1081. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.113265  3725 tablet_replica.cc:333] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.113842  3725 raft_consensus.cc:2243] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.114214  3725 raft_consensus.cc:2272] T 5963410c1ae543ee83abf42430c2ac10 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.116667  3725 tablet_replica.cc:333] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.117359  3725 raft_consensus.cc:2243] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.117755  3725 raft_consensus.cc:2272] T 8e3f0383cd364797b2fd1e3a1c3ce300 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.119722  3725 tablet_replica.cc:333] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.120393  3725 raft_consensus.cc:2243] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.120890  3725 raft_consensus.cc:2272] T c6743232edbd4f6997be3eb0f234a8b5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.123163  3725 tablet_replica.cc:333] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.123623  3725 raft_consensus.cc:2243] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.124234  3725 raft_consensus.cc:2272] T 91bec71eba2d41c6929bdff648f3d1a0 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.126143  3725 tablet_replica.cc:333] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.126578  3725 raft_consensus.cc:2243] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.127239  3725 raft_consensus.cc:2272] T 7db72482cd1247f689e8f82c76c75e27 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.128957  3725 tablet_replica.cc:333] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.129388  3725 raft_consensus.cc:2243] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.130048  3725 raft_consensus.cc:2272] T 3ed543b345014451bd60ddfb0b548dd6 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.131749  3725 tablet_replica.cc:333] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.132189  3725 raft_consensus.cc:2243] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.132568  3725 raft_consensus.cc:2272] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.134271  3725 tablet_replica.cc:333] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.134719  3725 raft_consensus.cc:2243] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.135076  3725 raft_consensus.cc:2272] T 320ba867e2f0452ea522852c10247484 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.136911  3725 tablet_replica.cc:333] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.137343  3725 raft_consensus.cc:2243] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.137694  3725 raft_consensus.cc:2272] T 79fff2a7419a4b29aa70e7b89e5d734f P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.139503  3725 tablet_replica.cc:333] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.140013  3725 raft_consensus.cc:2243] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.140368  3725 raft_consensus.cc:2272] T e2512ccc1e8f45bab654f70492174d5e P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.142187  3725 tablet_replica.cc:333] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.142624  3725 raft_consensus.cc:2243] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.142984  3725 raft_consensus.cc:2272] T c614ce4bca814377bb079b966180edce P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.144735  3725 tablet_replica.cc:333] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.145247  3725 raft_consensus.cc:2243] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.145594  3725 raft_consensus.cc:2272] T e04d1e1c941c46aa8589a0821e76d830 P 20c40041a85147a0bc5000c1aa44343e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.147575  3725 tablet_replica.cc:333] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.148248  3725 raft_consensus.cc:2243] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.148772  3725 raft_consensus.cc:2272] T ac6ca7e153ce4227bb8917fb38574ec5 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.151372  3725 tablet_replica.cc:333] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.152006  3725 raft_consensus.cc:2243] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.152872  3725 raft_consensus.cc:2272] T 904deb919d4b42b290b40955d7eb0154 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.154732  3725 tablet_replica.cc:333] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.155402  3725 raft_consensus.cc:2243] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.155946  3725 raft_consensus.cc:2272] T e399427af66e44d79c315f13efd5c353 P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.158478  3725 tablet_replica.cc:333] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.159097  3725 raft_consensus.cc:2243] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.159623  3725 raft_consensus.cc:2272] T 8dc72ff56ccb4ae79079d36d4b125e0b P 20c40041a85147a0bc5000c1aa44343e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.162001  3725 tablet_replica.cc:333] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.162647  3725 raft_consensus.cc:2243] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.163522  3725 raft_consensus.cc:2272] T 8d75399439f14d43b801446067d46c8a P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.165872  3725 tablet_replica.cc:333] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.166453  3725 raft_consensus.cc:2243] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.167376  3725 raft_consensus.cc:2272] T 10568811bd7a4972a6452da865f47f6c P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.169653  3725 tablet_replica.cc:333] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.170066  3725 raft_consensus.cc:2243] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.170694  3725 raft_consensus.cc:2272] T d0d5bebe45ea4b57b7ace8bb13073461 P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.172436  3725 tablet_replica.cc:333] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e: stopping tablet replica
I20260709 12:12:54.172900  3725 raft_consensus.cc:2243] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.173249  3725 raft_consensus.cc:2272] T 7a1d4b7cb4344bdc8344faf45dc2167f P 20c40041a85147a0bc5000c1aa44343e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:54.182252 11467 consensus_peers.cc:597] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.236461  3725 tablet_server.cc:196] TabletServer@127.3.163.67:0 shutdown complete.
W20260709 12:12:54.249743 11467 consensus_peers.cc:597] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.67:35889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:54.276253 11467 consensus_peers.cc:597] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.67:35889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:54.310745 11467 consensus_peers.cc:597] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.67:35889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.313778  3725 tablet_server.cc:179] TabletServer@127.3.163.68:0 shutting down...
I20260709 12:12:54.341696  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:54.342334  3725 tablet_replica.cc:333] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.343014  3725 raft_consensus.cc:2243] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.343969  3725 raft_consensus.cc:2272] T cf819e5fabb44ecb9cb0235c718d87d5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.346067  3725 tablet_replica.cc:333] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.346598  3725 raft_consensus.cc:2243] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.347023  3725 raft_consensus.cc:2272] T 2e442d52cd804d5fb247d09bf369c51d P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.349068  3725 tablet_replica.cc:333] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.349567  3725 raft_consensus.cc:2243] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.350273  3725 raft_consensus.cc:2272] T 805b5febce314019a60dc7fe2f77b2cf P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.352242  3725 tablet_replica.cc:333] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.352730  3725 raft_consensus.cc:2243] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.353479  3725 raft_consensus.cc:2272] T 969c64b986d444c19757cf5ce94bb8bc P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.355664  3725 tablet_replica.cc:333] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.356177  3725 raft_consensus.cc:2243] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.356894  3725 raft_consensus.cc:2272] T a761f8e443864779b5216933f3dfe795 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.358644  3725 tablet_replica.cc:333] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.359158  3725 raft_consensus.cc:2243] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.359822  3725 raft_consensus.cc:2272] T ca875d67c8364f99b00734f80028f1ff P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.361641  3725 tablet_replica.cc:333] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.362176  3725 raft_consensus.cc:2243] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.362576  3725 raft_consensus.cc:2272] T dc00a1ea01644d14b64b6826164bf7e5 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.364344  3725 tablet_replica.cc:333] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.364856  3725 raft_consensus.cc:2243] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.365237  3725 raft_consensus.cc:2272] T e04d1e1c941c46aa8589a0821e76d830 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.367014  3725 tablet_replica.cc:333] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.367511  3725 raft_consensus.cc:2243] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.368006 12432 raft_consensus.cc:493] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8cd91ce67df74245a4fcfd0c7c799002)
I20260709 12:12:54.368242  3725 raft_consensus.cc:2272] T ac6ca7e153ce4227bb8917fb38574ec5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.368489 12432 raft_consensus.cc:515] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b6d95e83cd149f88775563c5514ba28" member_type: VOTER last_known_addr { host: "127.3.163.68" port: 34547 } } peers { permanent_uuid: "8cd91ce67df74245a4fcfd0c7c799002" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 32937 } } peers { permanent_uuid: "0ddfa5fdeb884fe4bd42def0e21f1081" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 46063 } }
I20260709 12:12:54.370326 12432 leader_election.cc:290] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937), 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063)
I20260709 12:12:54.370443  3725 tablet_replica.cc:333] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.371320  3725 raft_consensus.cc:2243] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.372225  3725 raft_consensus.cc:2272] T f5328e5b3864423ca644295147703ecb P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:54.374359 11464 leader_election.cc:336] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ddfa5fdeb884fe4bd42def0e21f1081 (127.3.163.66:46063): Network error: Client connection negotiation failed: client connection to 127.3.163.66:46063: connect: Connection refused (error 111)
I20260709 12:12:54.374819  3725 tablet_replica.cc:333] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
W20260709 12:12:54.375151 11466 leader_election.cc:336] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8cd91ce67df74245a4fcfd0c7c799002 (127.3.163.65:32937): Network error: Client connection negotiation failed: client connection to 127.3.163.65:32937: connect: Connection refused (error 111)
I20260709 12:12:54.375481 11466 leader_election.cc:304] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b6d95e83cd149f88775563c5514ba28; no voters: 0ddfa5fdeb884fe4bd42def0e21f1081, 8cd91ce67df74245a4fcfd0c7c799002
I20260709 12:12:54.375500  3725 raft_consensus.cc:2243] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.376151 12404 raft_consensus.cc:2749] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:54.376544  3725 raft_consensus.cc:2272] T e0c6b4483ba043e6a4a5871e772e01ed P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.378422  3725 tablet_replica.cc:333] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.378887  3725 raft_consensus.cc:2243] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.379232  3725 raft_consensus.cc:2272] T aab0de38956343e09d4f85cdd0797ead P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.380906  3725 tablet_replica.cc:333] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.381363  3725 raft_consensus.cc:2243] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.381711  3725 raft_consensus.cc:2272] T 0a75c00695f64bd1bf842779b19211c0 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.383379  3725 tablet_replica.cc:333] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.383852  3725 raft_consensus.cc:2243] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.384188  3725 raft_consensus.cc:2272] T 7f12446f58fb4e5a867bb73ea759e3cd P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.385936  3725 tablet_replica.cc:333] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.386425  3725 raft_consensus.cc:2243] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.386788  3725 raft_consensus.cc:2272] T 9b0efa61df04448da748e040931fad71 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.388491  3725 tablet_replica.cc:333] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.389007  3725 raft_consensus.cc:2243] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.389667  3725 raft_consensus.cc:2272] T 893e5c43cf564bd59d9f25fa8f9f0fbf P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.391337  3725 tablet_replica.cc:333] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.391824  3725 raft_consensus.cc:2243] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.392243  3725 raft_consensus.cc:2272] T 6b43b6a73ce34d7297843d8f7ebc611e P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.394079  3725 tablet_replica.cc:333] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.394744  3725 raft_consensus.cc:2243] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.395234  3725 raft_consensus.cc:2272] T 229f7766e18a403594735eac02aebb69 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.397617  3725 tablet_replica.cc:333] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.398315  3725 raft_consensus.cc:2243] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.398981  3725 raft_consensus.cc:2272] T e41052c070b94d9eb8b24b2b57890c0a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.400604  3725 tablet_replica.cc:333] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.401113  3725 raft_consensus.cc:2243] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.401806  3725 raft_consensus.cc:2272] T 5963410c1ae543ee83abf42430c2ac10 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.403537  3725 tablet_replica.cc:333] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.403990  3725 raft_consensus.cc:2243] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.404323  3725 raft_consensus.cc:2272] T ad441508cb3d4912a21a23a55b982ae3 P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.406250  3725 tablet_replica.cc:333] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.406811  3725 raft_consensus.cc:2243] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.407685  3725 raft_consensus.cc:2272] T 34c01bb891f44a2990eb8b9b41aa3e1a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:54.409680 11467 consensus_peers.cc:597] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 -> Peer 20c40041a85147a0bc5000c1aa44343e (127.3.163.67:35889): Couldn't send request to peer 20c40041a85147a0bc5000c1aa44343e. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.67:35889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.409798  3725 tablet_replica.cc:333] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.410404  3725 raft_consensus.cc:2243] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.411094  3725 raft_consensus.cc:2272] T 8b90ac113f32492b8af9dee4c36614cd P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.412835  3725 tablet_replica.cc:333] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.413335  3725 raft_consensus.cc:2243] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.413703  3725 raft_consensus.cc:2272] T 64b54d6d44664c4a8f2fcc8d66288fe8 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.415407  3725 tablet_replica.cc:333] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.415900  3725 raft_consensus.cc:2243] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.416265  3725 raft_consensus.cc:2272] T 79fff2a7419a4b29aa70e7b89e5d734f P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.418044  3725 tablet_replica.cc:333] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.418524  3725 raft_consensus.cc:2243] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.419178  3725 raft_consensus.cc:2272] T f6536bd733514fbb927281bf18c6fa23 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.420873  3725 tablet_replica.cc:333] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.421365  3725 raft_consensus.cc:2243] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.421729  3725 raft_consensus.cc:2272] T f3531bc235ff4e12b0d7be22a7b2d978 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.423436  3725 tablet_replica.cc:333] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.423900  3725 raft_consensus.cc:2243] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.424299  3725 raft_consensus.cc:2272] T f2299ef9f6f241bbbb8cb5faf9e7c384 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.426093  3725 tablet_replica.cc:333] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.426594  3725 raft_consensus.cc:2243] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.426965  3725 raft_consensus.cc:2272] T 79fb7dfa5c3a47e4a1d57acd13660e0d P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.428658  3725 tablet_replica.cc:333] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.429132  3725 raft_consensus.cc:2243] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.429507  3725 raft_consensus.cc:2272] T 079d6cbc93b340bfb2dd2022db8bc00d P 8b6d95e83cd149f88775563c5514ba28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.431218  3725 tablet_replica.cc:333] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.431706  3725 raft_consensus.cc:2243] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.432370  3725 raft_consensus.cc:2272] T c6743232edbd4f6997be3eb0f234a8b5 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.434129  3725 tablet_replica.cc:333] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.434602  3725 raft_consensus.cc:2243] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.435000  3725 raft_consensus.cc:2272] T efc1dc6f02704e20829bc173c24d3725 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.436770  3725 tablet_replica.cc:333] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.437299  3725 raft_consensus.cc:2243] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.437659  3725 raft_consensus.cc:2272] T c614ce4bca814377bb079b966180edce P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.439395  3725 tablet_replica.cc:333] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.439863  3725 raft_consensus.cc:2243] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.440227  3725 raft_consensus.cc:2272] T e399427af66e44d79c315f13efd5c353 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.441989  3725 tablet_replica.cc:333] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.442487  3725 raft_consensus.cc:2243] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.442849  3725 raft_consensus.cc:2272] T 8d75399439f14d43b801446067d46c8a P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.444586  3725 tablet_replica.cc:333] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.445087  3725 raft_consensus.cc:2243] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.445441  3725 raft_consensus.cc:2272] T 10568811bd7a4972a6452da865f47f6c P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.447116  3725 tablet_replica.cc:333] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.447562  3725 raft_consensus.cc:2243] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.447924  3725 raft_consensus.cc:2272] T 4bbf184e378748efab2caeabdb1d91b2 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.449486  3725 tablet_replica.cc:333] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.449925  3725 raft_consensus.cc:2243] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.450273  3725 raft_consensus.cc:2272] T 7db72482cd1247f689e8f82c76c75e27 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.452088  3725 tablet_replica.cc:333] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.452577  3725 raft_consensus.cc:2243] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.452955  3725 raft_consensus.cc:2272] T 3ed543b345014451bd60ddfb0b548dd6 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.454650  3725 tablet_replica.cc:333] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.455102  3725 raft_consensus.cc:2243] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.455457  3725 raft_consensus.cc:2272] T 6fcf2221d70d421fa3aa00ebd33d3a58 P 8b6d95e83cd149f88775563c5514ba28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.457062  3725 tablet_replica.cc:333] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.457536  3725 raft_consensus.cc:2243] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.457913  3725 raft_consensus.cc:2272] T c68a9fb3e63a45119c4c6ebf7623679d P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.459585  3725 tablet_replica.cc:333] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.460005  3725 raft_consensus.cc:2243] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.460358  3725 raft_consensus.cc:2272] T 9e553b4d23b3451ea8801cd6f0e0ab7f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.462011  3725 tablet_replica.cc:333] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.462416  3725 raft_consensus.cc:2243] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.462755  3725 raft_consensus.cc:2272] T d0d5bebe45ea4b57b7ace8bb13073461 P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.464449  3725 tablet_replica.cc:333] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28: stopping tablet replica
I20260709 12:12:54.464895  3725 raft_consensus.cc:2243] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:54.465248  3725 raft_consensus.cc:2272] T 7a1d4b7cb4344bdc8344faf45dc2167f P 8b6d95e83cd149f88775563c5514ba28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.549944  3725 tablet_server.cc:196] TabletServer@127.3.163.68:0 shutdown complete.
I20260709 12:12:54.606912  3725 master.cc:562] Master@127.3.163.126:38385 shutting down...
I20260709 12:12:54.627755  3725 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:54.628263  3725 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:54.628536  3725 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1cb74fc28c97463e95847b18a6808a69: stopping tablet replica
I20260709 12:12:54.648737  3725 master.cc:584] Master@127.3.163.126:38385 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (29882 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:12:54.727001  3725 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.163.126:46491
I20260709 12:12:54.728046  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:54.733326 12436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.733407 12437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.734462 12439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:54.736796  3725 server_base.cc:1061] running on GCE node
I20260709 12:12:54.738252  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:54.738430  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:54.738560  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599174738544 us; error 0 us; skew 500 ppm
I20260709 12:12:54.739040  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:54.741154  3725 webserver.cc:533] Webserver started at http://127.3.163.126:41357/ using document root <none> and password file <none>
I20260709 12:12:54.741577  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:54.741739  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:54.741981  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:54.743003  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/master-0-root/instance:
uuid: "6d80c0ba3d6048e192353f8b6ebd0ded"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-s43n"
I20260709 12:12:54.747023  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:12:54.749971 12444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.750602  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:12:54.750864  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/master-0-root
uuid: "6d80c0ba3d6048e192353f8b6ebd0ded"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-s43n"
I20260709 12:12:54.751102  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:54.766182  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:54.767230  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:54.802109  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.126:46491
I20260709 12:12:54.802215 12495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.126:46491 every 8 connection(s)
I20260709 12:12:54.805742 12496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.817482 12496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded: Bootstrap starting.
I20260709 12:12:54.821868 12496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.825660 12496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded: No bootstrap required, opened a new log
I20260709 12:12:54.827601 12496 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d80c0ba3d6048e192353f8b6ebd0ded" member_type: VOTER }
I20260709 12:12:54.827953 12496 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.828132 12496 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d80c0ba3d6048e192353f8b6ebd0ded, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.828598 12496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d80c0ba3d6048e192353f8b6ebd0ded" member_type: VOTER }
I20260709 12:12:54.829001 12496 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:54.829185 12496 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:54.829387 12496 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.833779 12496 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d80c0ba3d6048e192353f8b6ebd0ded" member_type: VOTER }
I20260709 12:12:54.834201 12496 leader_election.cc:304] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d80c0ba3d6048e192353f8b6ebd0ded; no voters: 
I20260709 12:12:54.835170 12496 leader_election.cc:290] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:54.835510 12499 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.836699 12499 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 1 LEADER]: Becoming Leader. State: Replica: 6d80c0ba3d6048e192353f8b6ebd0ded, State: Running, Role: LEADER
I20260709 12:12:54.837380 12499 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d80c0ba3d6048e192353f8b6ebd0ded" member_type: VOTER }
I20260709 12:12:54.837826 12496 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:54.841686 12500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d80c0ba3d6048e192353f8b6ebd0ded" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d80c0ba3d6048e192353f8b6ebd0ded" member_type: VOTER } }
I20260709 12:12:54.842620 12501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d80c0ba3d6048e192353f8b6ebd0ded. Latest consensus state: current_term: 1 leader_uuid: "6d80c0ba3d6048e192353f8b6ebd0ded" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d80c0ba3d6048e192353f8b6ebd0ded" member_type: VOTER } }
I20260709 12:12:54.843755 12500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:54.843815 12501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:54.845495 12507 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:54.850131 12507 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:54.853250  3725 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:54.857998 12507 catalog_manager.cc:1383] Generated new cluster ID: 1f3bd0f6a036490bbde9cdbf860c66b8
I20260709 12:12:54.858251 12507 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:54.869823 12507 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:54.870885 12507 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:54.881405 12507 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded: Generated new TSK 0
I20260709 12:12:54.881879 12507 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:54.886951  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:54.892268 12517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.893357 12518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:54.896710  3725 server_base.cc:1061] running on GCE node
W20260709 12:12:54.897010 12520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:54.899948  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:54.900141  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:54.900290  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599174900273 us; error 0 us; skew 500 ppm
I20260709 12:12:54.900776  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:54.902885  3725 webserver.cc:533] Webserver started at http://127.3.163.65:44583/ using document root <none> and password file <none>
I20260709 12:12:54.903317  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:54.903492  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:54.903726  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:54.904747  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root/instance:
uuid: "0f432bb7cc334cab9e03fc2623e29f70"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-s43n"
I20260709 12:12:54.908735  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:54.911723 12525 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.912380  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:54.912632  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "0f432bb7cc334cab9e03fc2623e29f70"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-s43n"
I20260709 12:12:54.912919  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:54.925622  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:54.926671  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:54.927951  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:54.930034  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:54.930214  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.930416  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:54.930581  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:54.968577  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:46153
I20260709 12:12:54.968673 12587 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:46153 every 8 connection(s)
I20260709 12:12:54.973285  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:54.980494 12592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.981036 12593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:54.983925 12595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:54.986280  3725 server_base.cc:1061] running on GCE node
I20260709 12:12:54.987278  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:54.987459  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:54.987583  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599174987572 us; error 0 us; skew 500 ppm
I20260709 12:12:54.988014  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:54.990571  3725 webserver.cc:533] Webserver started at http://127.3.163.66:41331/ using document root <none> and password file <none>
I20260709 12:12:54.991096  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:54.991277  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:54.991524 12588 heartbeater.cc:344] Connected to a master server at 127.3.163.126:46491
I20260709 12:12:54.991569  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:54.991916 12588 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:54.992597 12588 heartbeater.cc:507] Master 127.3.163.126:46491 requested a full tablet report, sending...
I20260709 12:12:54.992839  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-1-root/instance:
uuid: "557fc8003f69439db9a4e155fe8344a8"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-s43n"
I20260709 12:12:54.994478 12461 ts_manager.cc:194] Registered new tserver with Master: 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153)
I20260709 12:12:54.996140 12461 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36058
I20260709 12:12:54.997496  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:12:55.000995 12600 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.001665  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:12:55.001895  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-1-root
uuid: "557fc8003f69439db9a4e155fe8344a8"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-s43n"
I20260709 12:12:55.002125  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.015863  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.016899  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.018148  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:55.020165  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:55.020394  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.020651  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:55.020864  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:12:55.056753  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.66:37709
I20260709 12:12:55.056883 12662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.66:37709 every 8 connection(s)
I20260709 12:12:55.061229  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:55.067668 12666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.068375 12667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.070876 12669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.071978  3725 server_base.cc:1061] running on GCE node
I20260709 12:12:55.072907  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:55.073128  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:55.073292  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599175073276 us; error 0 us; skew 500 ppm
I20260709 12:12:55.073529 12663 heartbeater.cc:344] Connected to a master server at 127.3.163.126:46491
I20260709 12:12:55.073849  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:55.073887 12663 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.074810 12663 heartbeater.cc:507] Master 127.3.163.126:46491 requested a full tablet report, sending...
I20260709 12:12:55.076254  3725 webserver.cc:533] Webserver started at http://127.3.163.67:39771/ using document root <none> and password file <none>
I20260709 12:12:55.076756  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:55.076757 12461 ts_manager.cc:194] Registered new tserver with Master: 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:55.077100  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:55.077428  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:55.078296 12461 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36074
I20260709 12:12:55.078498  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-2-root/instance:
uuid: "340a66ee22a04111811e74e948c8aefb"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-s43n"
I20260709 12:12:55.082751  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:55.085641 12674 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.086292  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:55.086549  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-2-root
uuid: "340a66ee22a04111811e74e948c8aefb"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-s43n"
I20260709 12:12:55.086802  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.100750  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.101794  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.103091  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:55.105192  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:55.105377  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.105580  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:55.105726  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.145751  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.67:41129
I20260709 12:12:55.145870 12736 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.67:41129 every 8 connection(s)
I20260709 12:12:55.158142 12737 heartbeater.cc:344] Connected to a master server at 127.3.163.126:46491
I20260709 12:12:55.158535 12737 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.159185 12737 heartbeater.cc:507] Master 127.3.163.126:46491 requested a full tablet report, sending...
I20260709 12:12:55.160981 12461 ts_manager.cc:194] Registered new tserver with Master: 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.161983  3725 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013175289s
I20260709 12:12:55.162165 12461 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36090
I20260709 12:12:55.184021 12461 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36104:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:55.186651 12461 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:55.250613 12553 tablet_service.cc:1511] Processing CreateTablet for tablet 445f42fe2f2b4b2b8b46901dbad66398 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:55.251410 12551 tablet_service.cc:1511] Processing CreateTablet for tablet 08beb96a432b4e7eb0cda33ba55b9187 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:55.252025 12553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f42fe2f2b4b2b8b46901dbad66398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.252755 12551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08beb96a432b4e7eb0cda33ba55b9187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.254132 12552 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa26dec8c8c47e696a9310faab15399 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:55.255462 12552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa26dec8c8c47e696a9310faab15399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.261893 12628 tablet_service.cc:1511] Processing CreateTablet for tablet 445f42fe2f2b4b2b8b46901dbad66398 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:55.263157 12628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f42fe2f2b4b2b8b46901dbad66398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.265926 12627 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa26dec8c8c47e696a9310faab15399 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:55.267184 12627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa26dec8c8c47e696a9310faab15399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.271646 12626 tablet_service.cc:1511] Processing CreateTablet for tablet 08beb96a432b4e7eb0cda33ba55b9187 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:55.272925 12626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08beb96a432b4e7eb0cda33ba55b9187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.279204 12550 tablet_service.cc:1511] Processing CreateTablet for tablet e220f895274648a9a863c02331183ab9 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:55.280509 12550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e220f895274648a9a863c02331183ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.281919 12549 tablet_service.cc:1511] Processing CreateTablet for tablet 376861a0cfb2413abb6c8e185ca752e6 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:55.283136 12549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376861a0cfb2413abb6c8e185ca752e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.284520 12548 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6049421c1148129926d6253446994e (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:55.285797 12548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6049421c1148129926d6253446994e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.287874 12625 tablet_service.cc:1511] Processing CreateTablet for tablet e220f895274648a9a863c02331183ab9 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:55.288398 12624 tablet_service.cc:1511] Processing CreateTablet for tablet 376861a0cfb2413abb6c8e185ca752e6 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:55.289620 12624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376861a0cfb2413abb6c8e185ca752e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.291190 12625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e220f895274648a9a863c02331183ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.293955 12623 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6049421c1148129926d6253446994e (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:55.295192 12623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6049421c1148129926d6253446994e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.298260 12547 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf9ca1b632140f1a865bfa33c31317d (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:55.299485 12547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf9ca1b632140f1a865bfa33c31317d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.302783 12622 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf9ca1b632140f1a865bfa33c31317d (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:55.304062 12622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf9ca1b632140f1a865bfa33c31317d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.306077 12621 tablet_service.cc:1511] Processing CreateTablet for tablet a6d257be2f944af3979cf750d87a119d (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:55.307277 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d257be2f944af3979cf750d87a119d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.310364 12620 tablet_service.cc:1511] Processing CreateTablet for tablet 21ed58de55d6431c8496d343e0c50b54 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:55.311597 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ed58de55d6431c8496d343e0c50b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.313920 12752 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.319851 12752 tablet_bootstrap.cc:654] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.322252 12619 tablet_service.cc:1511] Processing CreateTablet for tablet cc429033ac8244beb03fab61253d9bfb (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:55.323500 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc429033ac8244beb03fab61253d9bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.334843 12702 tablet_service.cc:1511] Processing CreateTablet for tablet 445f42fe2f2b4b2b8b46901dbad66398 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:55.336225 12702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 445f42fe2f2b4b2b8b46901dbad66398. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.338068 12553 tablet_service.cc:1511] Processing CreateTablet for tablet 21ed58de55d6431c8496d343e0c50b54 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:55.339957 12552 tablet_service.cc:1511] Processing CreateTablet for tablet cc429033ac8244beb03fab61253d9bfb (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:55.346274 12701 tablet_service.cc:1511] Processing CreateTablet for tablet 8aa26dec8c8c47e696a9310faab15399 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:55.347652 12701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aa26dec8c8c47e696a9310faab15399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.357829 12551 tablet_service.cc:1511] Processing CreateTablet for tablet a6d257be2f944af3979cf750d87a119d (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:55.358290 12700 tablet_service.cc:1511] Processing CreateTablet for tablet 08beb96a432b4e7eb0cda33ba55b9187 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:55.359705 12700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08beb96a432b4e7eb0cda33ba55b9187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.366187 12699 tablet_service.cc:1511] Processing CreateTablet for tablet e220f895274648a9a863c02331183ab9 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:55.367412 12699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e220f895274648a9a863c02331183ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.374225 12698 tablet_service.cc:1511] Processing CreateTablet for tablet 376861a0cfb2413abb6c8e185ca752e6 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:55.375499 12698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376861a0cfb2413abb6c8e185ca752e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.390157 12697 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6049421c1148129926d6253446994e (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:55.391417 12697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6049421c1148129926d6253446994e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.396137 12754 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.400652 12752 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.401115 12752 ts_tablet_manager.cc:1403] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.024s
I20260709 12:12:55.401185 12551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d257be2f944af3979cf750d87a119d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.403204 12754 tablet_bootstrap.cc:654] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.404270 12553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ed58de55d6431c8496d343e0c50b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.404031 12752 raft_consensus.cc:359] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.404788 12752 raft_consensus.cc:385] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.405105 12752 raft_consensus.cc:740] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.405995 12752 consensus_queue.cc:260] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.405107 12552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc429033ac8244beb03fab61253d9bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.440173 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf9ca1b632140f1a865bfa33c31317d (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:55.441440 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf9ca1b632140f1a865bfa33c31317d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.445356 12695 tablet_service.cc:1511] Processing CreateTablet for tablet a6d257be2f944af3979cf750d87a119d (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:55.446909 12695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d257be2f944af3979cf750d87a119d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.462460 12694 tablet_service.cc:1511] Processing CreateTablet for tablet 21ed58de55d6431c8496d343e0c50b54 (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:55.463892 12694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ed58de55d6431c8496d343e0c50b54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.478580 12693 tablet_service.cc:1511] Processing CreateTablet for tablet cc429033ac8244beb03fab61253d9bfb (DEFAULT_TABLE table=test-workload [id=0cf2a51bcd764fe99f06e7da4693e8a3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:55.480020 12693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc429033ac8244beb03fab61253d9bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:55.507311 12757 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:55.509065 12588 heartbeater.cc:499] Master 127.3.163.126:46491 was elected leader, sending a full tablet report...
I20260709 12:12:55.509210 12752 ts_tablet_manager.cc:1434] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.108s	user 0.030s	sys 0.074s
I20260709 12:12:55.511104 12752 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.512742 12757 tablet_bootstrap.cc:654] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.515443 12754 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.515936 12754 ts_tablet_manager.cc:1403] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.023s
I20260709 12:12:55.517447 12752 tablet_bootstrap.cc:654] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.518899 12754 raft_consensus.cc:359] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.519672 12754 raft_consensus.cc:385] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.519979 12754 raft_consensus.cc:740] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.520887 12754 consensus_queue.cc:260] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.530025 12754 ts_tablet_manager.cc:1434] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:12:55.530718 12663 heartbeater.cc:499] Master 127.3.163.126:46491 was elected leader, sending a full tablet report...
I20260709 12:12:55.537951 12757 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:55.538506 12757 ts_tablet_manager.cc:1403] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.010s
I20260709 12:12:55.541206 12752 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.541689 12752 ts_tablet_manager.cc:1403] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
I20260709 12:12:55.541628 12757 raft_consensus.cc:359] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.542382 12757 raft_consensus.cc:385] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.542634 12757 raft_consensus.cc:740] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.543239 12757 consensus_queue.cc:260] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.543880 12754 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.544653 12752 raft_consensus.cc:359] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.545374 12752 raft_consensus.cc:385] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.545648 12752 raft_consensus.cc:740] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.546386 12752 consensus_queue.cc:260] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.548426 12752 ts_tablet_manager.cc:1434] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:55.549360 12752 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.550395 12754 tablet_bootstrap.cc:654] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.555207 12752 tablet_bootstrap.cc:654] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.563179 12754 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.563637 12754 ts_tablet_manager.cc:1403] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:12:55.564497 12752 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.564999 12752 ts_tablet_manager.cc:1403] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:12:55.566337 12754 raft_consensus.cc:359] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.567019 12754 raft_consensus.cc:385] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.567281 12754 raft_consensus.cc:740] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.567696 12752 raft_consensus.cc:359] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.568399 12752 raft_consensus.cc:385] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.568004 12754 consensus_queue.cc:260] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.568702 12752 raft_consensus.cc:740] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.569468 12752 consensus_queue.cc:260] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.570483 12754 ts_tablet_manager.cc:1434] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:55.571386 12754 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.571489 12752 ts_tablet_manager.cc:1434] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:12:55.572458 12752 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.577804 12754 tablet_bootstrap.cc:654] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.578212 12752 tablet_bootstrap.cc:654] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.588896 12754 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.589156 12752 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.589367 12754 ts_tablet_manager.cc:1403] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:12:55.589607 12752 ts_tablet_manager.cc:1403] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 12:12:55.590013 12737 heartbeater.cc:499] Master 127.3.163.126:46491 was elected leader, sending a full tablet report...
I20260709 12:12:55.590359 12757 ts_tablet_manager.cc:1434] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.052s	user 0.020s	sys 0.029s
I20260709 12:12:55.591336 12757 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:55.592249 12754 raft_consensus.cc:359] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.592993 12754 raft_consensus.cc:385] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.592576 12752 raft_consensus.cc:359] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.593284 12754 raft_consensus.cc:740] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.593355 12752 raft_consensus.cc:385] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.593740 12752 raft_consensus.cc:740] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.594103 12754 consensus_queue.cc:260] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.594749 12752 consensus_queue.cc:260] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.596875 12752 ts_tablet_manager.cc:1434] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:12:55.597384 12757 tablet_bootstrap.cc:654] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.597704 12752 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.598376 12754 ts_tablet_manager.cc:1434] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:55.599321 12754 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.604220 12752 tablet_bootstrap.cc:654] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.605223 12754 tablet_bootstrap.cc:654] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.616510 12752 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.616536 12754 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.617100 12754 ts_tablet_manager.cc:1403] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:12:55.617100 12752 ts_tablet_manager.cc:1403] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:12:55.619944 12752 raft_consensus.cc:359] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.620193 12754 raft_consensus.cc:359] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.620611 12752 raft_consensus.cc:385] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.620910 12754 raft_consensus.cc:385] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.620970 12752 raft_consensus.cc:740] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.621274 12754 raft_consensus.cc:740] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.621867 12752 consensus_queue.cc:260] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.622118 12754 consensus_queue.cc:260] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.626151 12754 ts_tablet_manager.cc:1434] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:55.626194 12752 ts_tablet_manager.cc:1434] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:12:55.627157 12754 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.627202 12752 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.633759 12754 tablet_bootstrap.cc:654] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.633759 12752 tablet_bootstrap.cc:654] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.645761 12752 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.645905 12754 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.646217 12752 ts_tablet_manager.cc:1403] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.001s
I20260709 12:12:55.646380 12754 ts_tablet_manager.cc:1403] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:12:55.649170 12752 raft_consensus.cc:359] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.649843 12752 raft_consensus.cc:385] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.650123 12752 raft_consensus.cc:740] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.650100 12754 raft_consensus.cc:359] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.650959 12754 raft_consensus.cc:385] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.651278 12754 raft_consensus.cc:740] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.651136 12752 consensus_queue.cc:260] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.652169 12754 consensus_queue.cc:260] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.656144 12752 ts_tablet_manager.cc:1434] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:55.656754 12754 ts_tablet_manager.cc:1434] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:55.657172 12752 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.657810 12754 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.663635 12752 tablet_bootstrap.cc:654] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.664012 12754 tablet_bootstrap.cc:654] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.683111 12752 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.683552 12752 ts_tablet_manager.cc:1403] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 12:12:55.684063 12754 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.684298 12757 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:55.684530 12754 ts_tablet_manager.cc:1403] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.010s
I20260709 12:12:55.684859 12757 ts_tablet_manager.cc:1403] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.094s	user 0.035s	sys 0.050s
I20260709 12:12:55.686214 12752 raft_consensus.cc:359] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.686931 12752 raft_consensus.cc:385] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.687209 12752 raft_consensus.cc:740] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.687500 12754 raft_consensus.cc:359] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.688199 12754 raft_consensus.cc:385] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.687928 12752 consensus_queue.cc:260] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.687965 12757 raft_consensus.cc:359] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.688599 12754 raft_consensus.cc:740] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.688766 12757 raft_consensus.cc:385] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.689134 12757 raft_consensus.cc:740] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.689538 12754 consensus_queue.cc:260] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.690126 12752 ts_tablet_manager.cc:1434] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:12:55.689942 12757 consensus_queue.cc:260] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.691108 12752 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.693569 12754 ts_tablet_manager.cc:1434] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:55.694572 12754 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.697212 12757 ts_tablet_manager.cc:1434] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:12:55.697644 12752 tablet_bootstrap.cc:654] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.698293 12757 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:55.700448 12754 tablet_bootstrap.cc:654] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.703776 12760 raft_consensus.cc:493] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.704288 12760 raft_consensus.cc:515] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.705147 12757 tablet_bootstrap.cc:654] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.704314 12761 raft_consensus.cc:493] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.708287 12752 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.708838 12752 ts_tablet_manager.cc:1403] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:12:55.708679 12761 raft_consensus.cc:515] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.711200 12761 leader_election.cc:290] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:55.711608 12752 raft_consensus.cc:359] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.712267 12752 raft_consensus.cc:385] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.712621 12752 raft_consensus.cc:740] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.713356 12752 consensus_queue.cc:260] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.715510 12752 ts_tablet_manager.cc:1434] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:55.716382 12752 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:12:55.725029 12760 leader_election.cc:290] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.734648 12752 tablet_bootstrap.cc:654] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.746915 12761 raft_consensus.cc:493] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.747411 12761 raft_consensus.cc:515] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.749650 12761 leader_election.cc:290] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:55.752641 12756 raft_consensus.cc:493] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.753165 12756 raft_consensus.cc:515] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.755591 12756 leader_election.cc:290] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.764110 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
I20260709 12:12:55.766348 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e220f895274648a9a863c02331183ab9" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:55.767890 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:55.768476 12638 raft_consensus.cc:2468] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 0.
W20260709 12:12:55.769420 12602 leader_election.cc:343] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:55.770754 12678 leader_election.cc:343] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.771418 12678 leader_election.cc:304] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:55.772333 12761 raft_consensus.cc:2804] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.772682 12761 raft_consensus.cc:493] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.773002 12761 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.780100 12761 raft_consensus.cc:515] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.785421 12757 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:55.785617 12754 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.786134 12757 ts_tablet_manager.cc:1403] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.088s	user 0.036s	sys 0.046s
I20260709 12:12:55.786226 12754 ts_tablet_manager.cc:1403] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.003s
I20260709 12:12:55.788350 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e220f895274648a9a863c02331183ab9" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:55.789041 12563 raft_consensus.cc:2468] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 0.
I20260709 12:12:55.789731 12757 raft_consensus.cc:359] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.790575 12757 raft_consensus.cc:385] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.790405 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:55.791299 12563 raft_consensus.cc:2468] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 0.
I20260709 12:12:55.791760 12562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:12:55.792027 12757 raft_consensus.cc:740] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.792078 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:55.792850 12562 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.793128 12638 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.793495 12757 consensus_queue.cc:260] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.792515 12760 raft_consensus.cc:493] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.794724 12760 raft_consensus.cc:515] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.796691 12760 leader_election.cc:290] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.798373 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6049421c1148129926d6253446994e" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
W20260709 12:12:55.799785 12602 leader_election.cc:343] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.799906 12638 raft_consensus.cc:2468] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 1.
I20260709 12:12:55.800992 12678 leader_election.cc:304] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:55.790474 12754 raft_consensus.cc:359] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.803750 12754 raft_consensus.cc:385] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.804790 12754 raft_consensus.cc:740] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.805171 12761 leader_election.cc:290] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:55.806046 12562 raft_consensus.cc:2468] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 1.
I20260709 12:12:55.807236 12754 consensus_queue.cc:260] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.808216 12562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:55.808794 12562 raft_consensus.cc:2468] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 0.
I20260709 12:12:55.809710 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6049421c1148129926d6253446994e" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:55.810318 12563 raft_consensus.cc:2468] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 0.
I20260709 12:12:55.810812 12761 raft_consensus.cc:2804] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.811266 12761 raft_consensus.cc:697] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:12:55.811378 12604 leader_election.cc:304] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:55.812073 12761 consensus_queue.cc:237] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.812515 12756 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.813010 12756 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.814958 12756 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.816226 12604 leader_election.cc:304] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:55.817140 12760 raft_consensus.cc:2804] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.817477 12760 raft_consensus.cc:493] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.817791 12760 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.822184 12754 ts_tablet_manager.cc:1434] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 12:12:55.824164 12678 leader_election.cc:304] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 557fc8003f69439db9a4e155fe8344a8
I20260709 12:12:55.824576 12760 raft_consensus.cc:515] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.836593 12754 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.837057 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
W20260709 12:12:55.838382 12602 leader_election.cc:343] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.829501 12785 raft_consensus.cc:2804] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.839259 12785 raft_consensus.cc:493] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.839591 12785 raft_consensus.cc:3060] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.841549 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f42fe2f2b4b2b8b46901dbad66398" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
I20260709 12:12:55.843377 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
W20260709 12:12:55.844759 12527 leader_election.cc:343] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:55.845439 12527 leader_election.cc:343] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.846778 12786 raft_consensus.cc:2804] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.847223 12786 raft_consensus.cc:493] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.847543 12786 raft_consensus.cc:3060] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:55.848991 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:55.850189 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f42fe2f2b4b2b8b46901dbad66398" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:55.851675 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:55.851419 12459 catalog_manager.cc:5697] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 0 to 1, leader changed from <none> to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 1 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.852254 12638 raft_consensus.cc:2468] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 0.
W20260709 12:12:55.853289 12529 leader_election.cc:343] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.853705 12529 leader_election.cc:304] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70; no voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8
I20260709 12:12:55.854749 12756 raft_consensus.cc:2749] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.855901 12529 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:55.856921 12756 raft_consensus.cc:2804] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.857259 12756 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.857569 12756 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.857754 12754 tablet_bootstrap.cc:654] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.862845 12785 raft_consensus.cc:515] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.865660 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e220f895274648a9a863c02331183ab9" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:12:55.866334 12785 leader_election.cc:290] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:55.866250 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e220f895274648a9a863c02331183ab9" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
W20260709 12:12:55.867674 12678 leader_election.cc:343] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.866243 12563 raft_consensus.cc:3060] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.869151 12754 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.869618 12754 ts_tablet_manager.cc:1403] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:12:55.874894 12563 raft_consensus.cc:2468] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 1.
I20260709 12:12:55.876401 12678 leader_election.cc:304] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 557fc8003f69439db9a4e155fe8344a8
I20260709 12:12:55.877816 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:12:55.864243 12756 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.878479 12563 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.878895 12785 raft_consensus.cc:2804] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.879570 12785 raft_consensus.cc:697] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:12:55.880378 12785 consensus_queue.cc:237] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.879586 12791 raft_consensus.cc:493] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.881522 12791 raft_consensus.cc:515] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.878163 12754 raft_consensus.cc:359] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.884294 12754 raft_consensus.cc:385] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.884606 12754 raft_consensus.cc:740] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.884910 12760 leader_election.cc:290] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.885447 12754 consensus_queue.cc:260] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.887471 12562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
W20260709 12:12:55.888855 12604 leader_election.cc:343] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.889303 12752 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:55.889757 12752 ts_tablet_manager.cc:1403] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.174s	user 0.065s	sys 0.086s
I20260709 12:12:55.890647 12754 ts_tablet_manager.cc:1434] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:12:55.890753 12791 leader_election.cc:290] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.891640 12754 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.890959 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
W20260709 12:12:55.892946 12602 leader_election.cc:343] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.893350 12602 leader_election.cc:304] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 557fc8003f69439db9a4e155fe8344a8; no voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:55.890360 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:55.894065 12791 raft_consensus.cc:2749] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.894455 12638 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.896097 12752 raft_consensus.cc:359] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.896793 12752 raft_consensus.cc:385] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.902822 12752 raft_consensus.cc:740] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.903502 12752 consensus_queue.cc:260] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.907212 12754 tablet_bootstrap.cc:654] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.907348 12461 catalog_manager.cc:5697] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 0 to 1, leader changed from <none> to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 1 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.913084 12638 raft_consensus.cc:2468] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 1.
I20260709 12:12:55.915283 12756 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Requested vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.915869 12756 raft_consensus.cc:493] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.916272 12756 raft_consensus.cc:515] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.916890 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:12:55.919071 12752 ts_tablet_manager.cc:1434] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.006s
I20260709 12:12:55.918099 12754 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
W20260709 12:12:55.919503 12527 leader_election.cc:343] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.919749 12754 ts_tablet_manager.cc:1403] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.003s
I20260709 12:12:55.919910 12756 leader_election.cc:290] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.921099 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
I20260709 12:12:55.921506 12529 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:55.921685 12712 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 0.
I20260709 12:12:55.922459 12754 raft_consensus.cc:359] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.923136 12754 raft_consensus.cc:385] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.922930 12527 leader_election.cc:304] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:12:55.923454 12754 raft_consensus.cc:740] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.923486 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:55.923944 12756 raft_consensus.cc:2804] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.924464 12756 raft_consensus.cc:493] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.924280 12754 consensus_queue.cc:260] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.884487 12563 raft_consensus.cc:2468] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 1.
W20260709 12:12:55.924998 12529 leader_election.cc:343] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.932372 12604 leader_election.cc:304] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:55.924938 12786 raft_consensus.cc:515] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.926700 12757 ts_tablet_manager.cc:1434] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.140s	user 0.033s	sys 0.049s
I20260709 12:12:55.933434 12760 raft_consensus.cc:2804] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.933935 12760 raft_consensus.cc:697] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:12:55.932999 12754 ts_tablet_manager.cc:1434] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:12:55.935120 12754 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8: Bootstrap starting.
I20260709 12:12:55.934772 12760 consensus_queue.cc:237] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.935449 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6049421c1148129926d6253446994e" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:12:55.936332 12752 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
W20260709 12:12:55.936704 12602 leader_election.cc:343] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.937089 12786 leader_election.cc:290] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.924896 12756 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.940781 12754 tablet_bootstrap.cc:654] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.943953 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6049421c1148129926d6253446994e" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:12:55.944507 12563 raft_consensus.cc:3060] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.944394 12786 raft_consensus.cc:493] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.946457 12786 raft_consensus.cc:515] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.948340 12786 leader_election.cc:290] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.934051 12757 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:55.949285 12562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f42fe2f2b4b2b8b46901dbad66398" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:55.950047 12562 raft_consensus.cc:2468] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 0.
I20260709 12:12:55.951555 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f42fe2f2b4b2b8b46901dbad66398" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
I20260709 12:12:55.951741 12604 leader_election.cc:304] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
W20260709 12:12:55.952943 12602 leader_election.cc:343] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.953430 12754 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8: No bootstrap required, opened a new log
I20260709 12:12:55.953899 12754 ts_tablet_manager.cc:1403] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:12:55.953826 12786 raft_consensus.cc:2804] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.954416 12786 raft_consensus.cc:493] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.954738 12786 raft_consensus.cc:3060] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.955343 12756 raft_consensus.cc:515] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.956413 12754 raft_consensus.cc:359] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.957096 12754 raft_consensus.cc:385] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.957357 12754 raft_consensus.cc:740] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.957324 12756 leader_election.cc:290] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Requested vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.953908 12752 tablet_bootstrap.cc:654] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.958426 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:12:55.958293 12754 consensus_queue.cc:260] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.957926 12461 catalog_manager.cc:5697] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.958974 12712 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.960246 12754 ts_tablet_manager.cc:1434] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:12:55.923051 12794 raft_consensus.cc:2804] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.961206 12794 raft_consensus.cc:697] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: Becoming Leader. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Running, Role: LEADER
I20260709 12:12:55.961987 12794 consensus_queue.cc:237] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.965672 12757 tablet_bootstrap.cc:654] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:55.968772 12529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:37709, user_credentials={real_user=slave}} blocked reactor thread for 43806.2us
I20260709 12:12:55.971450 12563 raft_consensus.cc:2468] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 1.
I20260709 12:12:55.974445 12757 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:55.974948 12757 ts_tablet_manager.cc:1403] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 12:12:55.978598 12757 raft_consensus.cc:359] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.979254 12757 raft_consensus.cc:385] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.979528 12757 raft_consensus.cc:740] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.980183 12757 consensus_queue.cc:260] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.983866 12712 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 1.
I20260709 12:12:55.986222 12757 ts_tablet_manager.cc:1434] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:55.986475 12786 raft_consensus.cc:515] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.987213 12757 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:55.987062 12461 catalog_manager.cc:5697] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "0f432bb7cc334cab9e03fc2623e29f70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.988032 12786 leader_election.cc:290] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:55.988977 12760 raft_consensus.cc:493] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.990108 12760 raft_consensus.cc:515] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:55.990296 12527 leader_election.cc:304] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:12:55.989516 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:55.991003 12638 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.992139 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f42fe2f2b4b2b8b46901dbad66398" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:12:55.992755 12563 raft_consensus.cc:3060] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.998536 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f42fe2f2b4b2b8b46901dbad66398" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:12:55.999807 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e220f895274648a9a863c02331183ab9" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
W20260709 12:12:56.000066 12602 leader_election.cc:343] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.000401 12757 tablet_bootstrap.cc:654] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.000615 12760 leader_election.cc:290] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:56.001930 12638 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 1.
I20260709 12:12:55.989432 12604 leader_election.cc:304] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:56.004667 12562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e220f895274648a9a863c02331183ab9" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:56.005437 12562 raft_consensus.cc:2393] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 557fc8003f69439db9a4e155fe8344a8 in current term 1: Already voted for candidate 340a66ee22a04111811e74e948c8aefb in this term.
I20260709 12:12:56.006527 12756 raft_consensus.cc:2804] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.006981 12756 raft_consensus.cc:697] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: Becoming Leader. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Running, Role: LEADER
I20260709 12:12:56.007176 12795 raft_consensus.cc:493] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.007655 12795 raft_consensus.cc:515] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.007896 12756 consensus_queue.cc:237] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.008991 12760 raft_consensus.cc:2804] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.009654 12760 raft_consensus.cc:697] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:12:56.009686 12795 leader_election.cc:290] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:56.010564 12760 consensus_queue.cc:237] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.012787 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
W20260709 12:12:56.014258 12527 leader_election.cc:343] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.016242 12563 raft_consensus.cc:2468] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 1.
I20260709 12:12:56.019141 12604 leader_election.cc:304] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 557fc8003f69439db9a4e155fe8344a8; no voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:56.019855 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:56.021205 12638 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 0.
I20260709 12:12:56.021754 12752 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: No bootstrap required, opened a new log
I20260709 12:12:56.022217 12786 raft_consensus.cc:3060] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.024351 12757 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:56.023613 12461 catalog_manager.cc:5697] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "0f432bb7cc334cab9e03fc2623e29f70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.024863 12757 ts_tablet_manager.cc:1403] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.006s
I20260709 12:12:56.022234 12752 ts_tablet_manager.cc:1403] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.014s
I20260709 12:12:56.027700 12757 raft_consensus.cc:359] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.028409 12757 raft_consensus.cc:385] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.028667 12757 raft_consensus.cc:740] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.029189 12752 raft_consensus.cc:359] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.030668 12752 raft_consensus.cc:385] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.030993 12752 raft_consensus.cc:740] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.031674 12752 consensus_queue.cc:260] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.032418 12786 raft_consensus.cc:2749] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.029407 12757 consensus_queue.cc:260] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.034083 12752 ts_tablet_manager.cc:1434] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:56.035351 12604 leader_election.cc:304] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:56.035655 12757 ts_tablet_manager.cc:1434] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:12:56.036209 12786 raft_consensus.cc:2804] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.035843 12459 catalog_manager.cc:5697] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.036970 12757 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:56.036743 12529 leader_election.cc:304] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:56.036918 12786 raft_consensus.cc:697] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:12:56.038115 12756 raft_consensus.cc:2804] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.038101 12786 consensus_queue.cc:237] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.038684 12756 raft_consensus.cc:493] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.039155 12756 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.042922 12757 tablet_bootstrap.cc:654] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.046181 12756 raft_consensus.cc:515] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.048353 12756 leader_election.cc:290] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Requested vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:56.049886 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:12:56.048964 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:56.055028 12638 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.055287 12527 leader_election.cc:343] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.059327 12760 raft_consensus.cc:493] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.059814 12760 raft_consensus.cc:515] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.061836 12760 leader_election.cc:290] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:56.062136 12638 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 1.
I20260709 12:12:56.061896 12459 catalog_manager.cc:5697] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.064041 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ed58de55d6431c8496d343e0c50b54" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:56.064101 12529 leader_election.cc:304] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:56.064719 12563 raft_consensus.cc:2468] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 0.
I20260709 12:12:56.064935 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ed58de55d6431c8496d343e0c50b54" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
I20260709 12:12:56.065275 12756 raft_consensus.cc:2804] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.066553 12756 raft_consensus.cc:697] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: Becoming Leader. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Running, Role: LEADER
W20260709 12:12:56.066329 12602 leader_election.cc:343] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.067469 12756 consensus_queue.cc:237] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.068059 12604 leader_election.cc:304] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:56.070489 12757 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:56.071455 12757 ts_tablet_manager.cc:1403] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.010s
I20260709 12:12:56.070866 12786 raft_consensus.cc:2804] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.073030 12786 raft_consensus.cc:493] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.073374 12786 raft_consensus.cc:3060] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.073971 12757 raft_consensus.cc:359] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.074671 12757 raft_consensus.cc:385] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.074949 12757 raft_consensus.cc:740] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.075299 12459 catalog_manager.cc:5697] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "0f432bb7cc334cab9e03fc2623e29f70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.075654 12757 consensus_queue.cc:260] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.077831 12757 ts_tablet_manager.cc:1434] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:56.078714 12757 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:56.082648 12786 raft_consensus.cc:515] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.084573 12757 tablet_bootstrap.cc:654] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.085474 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ed58de55d6431c8496d343e0c50b54" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:12:56.086038 12563 raft_consensus.cc:3060] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.087901 12786 leader_election.cc:290] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:56.088958 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ed58de55d6431c8496d343e0c50b54" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:12:56.089530 12757 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:56.089955 12757 ts_tablet_manager.cc:1403] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
W20260709 12:12:56.090099 12602 leader_election.cc:343] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:56.092074 12563 raft_consensus.cc:2468] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 1.
I20260709 12:12:56.091930 12757 raft_consensus.cc:359] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.092507 12757 raft_consensus.cc:385] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.092782 12757 raft_consensus.cc:740] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.092962 12604 leader_election.cc:304] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:56.093452 12757 consensus_queue.cc:260] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.093612 12786 raft_consensus.cc:2804] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.094161 12786 raft_consensus.cc:697] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:12:56.095685 12757 ts_tablet_manager.cc:1434] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:12:56.095958 12786 consensus_queue.cc:237] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.096589 12757 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:56.101490 12757 tablet_bootstrap.cc:654] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.105804 12757 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:56.106173 12757 ts_tablet_manager.cc:1403] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:12:56.105679 12459 catalog_manager.cc:5697] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.108002 12757 raft_consensus.cc:359] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.108629 12757 raft_consensus.cc:385] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.108908 12757 raft_consensus.cc:740] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.109546 12757 consensus_queue.cc:260] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.111106 12757 ts_tablet_manager.cc:1434] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:12:56.111724 12757 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:56.114785 12784 raft_consensus.cc:493] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.115641 12757 tablet_bootstrap.cc:654] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.115268 12784 raft_consensus.cc:515] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.117429 12784 leader_election.cc:290] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:56.119011 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6049421c1148129926d6253446994e" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:56.119032 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6049421c1148129926d6253446994e" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:56.120242 12757 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:56.120321 12563 raft_consensus.cc:2393] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 340a66ee22a04111811e74e948c8aefb in current term 1: Already voted for candidate 557fc8003f69439db9a4e155fe8344a8 in this term.
I20260709 12:12:56.120718 12757 ts_tablet_manager.cc:1403] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:12:56.121500 12678 leader_election.cc:304] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb; no voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8
I20260709 12:12:56.122171 12784 raft_consensus.cc:3060] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.122920 12757 raft_consensus.cc:359] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.123572 12757 raft_consensus.cc:385] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.123821 12757 raft_consensus.cc:740] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.124450 12757 consensus_queue.cc:260] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.126370 12757 ts_tablet_manager.cc:1434] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:56.127220 12757 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb: Bootstrap starting.
I20260709 12:12:56.129109 12784 raft_consensus.cc:2749] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.131706 12757 tablet_bootstrap.cc:654] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:56.135804 12757 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb: No bootstrap required, opened a new log
I20260709 12:12:56.136121 12757 ts_tablet_manager.cc:1403] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:56.137790 12757 raft_consensus.cc:359] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.138202 12757 raft_consensus.cc:385] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:56.138391 12757 raft_consensus.cc:740] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Initialized, Role: FOLLOWER
I20260709 12:12:56.138887 12757 consensus_queue.cc:260] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.140237 12757 ts_tablet_manager.cc:1434] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
W20260709 12:12:56.151467 12738 tablet.cc:2406] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:56.164608 12756 raft_consensus.cc:493] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.165091 12756 raft_consensus.cc:515] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.166616 12756 leader_election.cc:290] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:56.167366 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:56.167661 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
I20260709 12:12:56.167901 12638 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 0.
I20260709 12:12:56.168251 12712 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 0.
I20260709 12:12:56.168922 12529 leader_election.cc:304] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:56.169709 12756 raft_consensus.cc:2804] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:56.170045 12756 raft_consensus.cc:493] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.170327 12756 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.174926 12756 raft_consensus.cc:515] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.176407 12756 leader_election.cc:290] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Requested vote from peers 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:56.177068 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:56.177335 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "0f432bb7cc334cab9e03fc2623e29f70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:12:56.177644 12638 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.177903 12712 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.184453 12712 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 1.
I20260709 12:12:56.184453 12638 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f432bb7cc334cab9e03fc2623e29f70 in term 1.
I20260709 12:12:56.185606 12527 leader_election.cc:304] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:12:56.186184 12756 raft_consensus.cc:2804] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:56.186542 12756 raft_consensus.cc:697] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: Becoming Leader. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Running, Role: LEADER
I20260709 12:12:56.187203 12756 consensus_queue.cc:237] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.193567 12458 catalog_manager.cc:5697] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65). New cstate: current_term: 1 leader_uuid: "0f432bb7cc334cab9e03fc2623e29f70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.218236 12784 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.218659 12784 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.220129 12784 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:56.220877 12563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70" is_pre_election: true
I20260709 12:12:56.221096 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:56.221813 12638 raft_consensus.cc:2393] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 340a66ee22a04111811e74e948c8aefb in current term 1: Already voted for candidate 0f432bb7cc334cab9e03fc2623e29f70 in this term.
I20260709 12:12:56.222599 12678 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb; no voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8
I20260709 12:12:56.223188 12784 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.227772 12784 raft_consensus.cc:2749] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.268213 12784 consensus_queue.cc:1048] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.278885 12761 consensus_queue.cc:1048] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.326313 12761 consensus_queue.cc:1048] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.336264 12784 consensus_queue.cc:1048] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.350713 12756 consensus_queue.cc:1048] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.356644 12794 consensus_queue.cc:1048] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.389328  3725 ts_manager.cc:295] Set tserver state for 0f432bb7cc334cab9e03fc2623e29f70 to MAINTENANCE_MODE
I20260709 12:12:56.389974  3725 tablet_server.cc:179] TabletServer@127.3.163.65:0 shutting down...
I20260709 12:12:56.409744  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:56.410444  3725 tablet_replica.cc:333] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.410998  3725 raft_consensus.cc:2243] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:56.411556  3725 pending_rounds.cc:70] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Trying to abort 1 pending ops.
I20260709 12:12:56.411741  3725 pending_rounds.cc:77] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622225669070848 op_type: NO_OP noop_request { }
I20260709 12:12:56.412007  3725 raft_consensus.cc:2889] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:56.412253  3725 raft_consensus.cc:2272] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.414515  3725 tablet_replica.cc:333] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.415177  3725 raft_consensus.cc:2243] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:56.415527  3725 raft_consensus.cc:2272] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.417145  3725 tablet_replica.cc:333] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.417645  3725 raft_consensus.cc:2243] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:56.418001  3725 raft_consensus.cc:2272] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.420050  3725 tablet_replica.cc:333] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.420536  3725 raft_consensus.cc:2243] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:56.420887  3725 raft_consensus.cc:2272] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.422411  3725 tablet_replica.cc:333] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.422871  3725 raft_consensus.cc:2243] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:56.423400  3725 pending_rounds.cc:70] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Trying to abort 1 pending ops.
I20260709 12:12:56.423552  3725 pending_rounds.cc:77] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622225181974528 op_type: NO_OP noop_request { }
I20260709 12:12:56.423753  3725 raft_consensus.cc:2889] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:56.423960  3725 raft_consensus.cc:2272] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.425837  3725 tablet_replica.cc:333] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.426290  3725 raft_consensus.cc:2243] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:56.426978  3725 raft_consensus.cc:2272] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.428786  3725 tablet_replica.cc:333] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.429278  3725 raft_consensus.cc:2243] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:56.429602  3725 raft_consensus.cc:2272] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.431469  3725 tablet_replica.cc:333] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.431983  3725 raft_consensus.cc:2243] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:56.432286  3725 raft_consensus.cc:2272] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.433985  3725 tablet_replica.cc:333] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.434403  3725 raft_consensus.cc:2243] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:56.434890  3725 pending_rounds.cc:70] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Trying to abort 1 pending ops.
I20260709 12:12:56.435056  3725 pending_rounds.cc:77] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622224938131456 op_type: NO_OP noop_request { }
I20260709 12:12:56.435256  3725 raft_consensus.cc:2889] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:56.435462  3725 raft_consensus.cc:2272] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:56.437253  3725 tablet_replica.cc:333] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: stopping tablet replica
I20260709 12:12:56.437654  3725 raft_consensus.cc:2243] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:56.437952  3725 raft_consensus.cc:2272] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:56.457527 12604 consensus_peers.cc:597] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.460006 12712 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.464250  3725 tablet_server.cc:196] TabletServer@127.3.163.65:0 shutdown complete.
W20260709 12:12:56.465798 12604 consensus_peers.cc:597] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.467535 12786 consensus_queue.cc:1048] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.528116 12712 raft_consensus.cc:3060] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.531039 12604 consensus_peers.cc:597] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.534538 12791 consensus_queue.cc:1048] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:56.545181 12604 consensus_peers.cc:597] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.583019 12784 raft_consensus.cc:493] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.583184 12761 raft_consensus.cc:493] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.583669 12784 raft_consensus.cc:515] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.583711 12761 raft_consensus.cc:515] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:56.585839 12761 leader_election.cc:290] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:56.585855 12784 leader_election.cc:290] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:56.587960 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "445f42fe2f2b4b2b8b46901dbad66398" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:56.588382 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:56.589301 12637 raft_consensus.cc:2393] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 340a66ee22a04111811e74e948c8aefb in current term 1: Already voted for candidate 0f432bb7cc334cab9e03fc2623e29f70 in this term.
W20260709 12:12:56.591234 12678 leader_election.cc:336] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:56.591568 12678 leader_election.cc:304] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb; no voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8
I20260709 12:12:56.592099 12784 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:56.592206 12678 leader_election.cc:336] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:56.592614 12678 leader_election.cc:304] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb; no voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8
I20260709 12:12:56.593178 12761 raft_consensus.cc:2749] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.596974 12784 raft_consensus.cc:2749] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:56.635845 12786 consensus_queue.cc:1048] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.681743 12712 raft_consensus.cc:3060] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:56.687362 12786 consensus_queue.cc:1048] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:56.801728 12678 consensus_peers.cc:597] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:56.849857 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:12:56.925598 12678 consensus_peers.cc:597] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:57.563977 12784 raft_consensus.cc:493] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.564388 12784 raft_consensus.cc:515] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:57.566031 12784 leader_election.cc:290] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:57.567188 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:57.567759 12637 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 1.
I20260709 12:12:57.568759 12678 leader_election.cc:304] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:57.569345 12784 raft_consensus.cc:2804] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:57.569386 12678 leader_election.cc:336] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:57.569656 12784 raft_consensus.cc:493] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.569964 12784 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.574658 12784 raft_consensus.cc:515] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:57.576004 12784 leader_election.cc:290] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:57.577210 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:57.577651 12637 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:57.579066 12678 leader_election.cc:336] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:57.582350 12637 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:12:57.583151 12678 leader_election.cc:304] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 0f432bb7cc334cab9e03fc2623e29f70
I20260709 12:12:57.583724 12784 raft_consensus.cc:2804] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:57.584168 12784 raft_consensus.cc:697] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:12:57.584961 12784 consensus_queue.cc:237] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:57.591799 12458 catalog_manager.cc:5697] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 1 to 2, leader changed from 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 2 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:57.850756 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:12:57.859648 12760 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f432bb7cc334cab9e03fc2623e29f70)
I20260709 12:12:57.860105 12760 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:57.860509 12784 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f432bb7cc334cab9e03fc2623e29f70)
I20260709 12:12:57.861022 12784 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:57.861943 12760 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:57.862730 12784 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:57.863116 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb" is_pre_election: true
I20260709 12:12:57.864303 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:57.864955 12637 raft_consensus.cc:2468] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 1.
I20260709 12:12:57.863726 12712 raft_consensus.cc:2468] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 1.
I20260709 12:12:57.866216 12678 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:57.866788 12602 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:57.866964 12784 raft_consensus.cc:2804] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:57.867023 12678 leader_election.cc:336] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
W20260709 12:12:57.867583 12604 leader_election.cc:336] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:57.867624 12760 raft_consensus.cc:2804] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:57.867600 12784 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f432bb7cc334cab9e03fc2623e29f70)
I20260709 12:12:57.868360 12760 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f432bb7cc334cab9e03fc2623e29f70)
I20260709 12:12:57.868428 12784 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.868703 12760 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:57.874421 12784 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:57.875013 12760 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:57.875993 12784 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:57.877110 12760 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:12:57.877250 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:57.878039 12637 raft_consensus.cc:2393] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 340a66ee22a04111811e74e948c8aefb in current term 2: Already voted for candidate 557fc8003f69439db9a4e155fe8344a8 in this term.
I20260709 12:12:57.878031 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:12:57.878906 12712 raft_consensus.cc:2393] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 557fc8003f69439db9a4e155fe8344a8 in current term 2: Already voted for candidate 340a66ee22a04111811e74e948c8aefb in this term.
W20260709 12:12:57.880314 12678 leader_election.cc:336] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:57.880764 12678 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb; no voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8
W20260709 12:12:57.881176 12604 leader_election.cc:336] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:57.881433 12784 raft_consensus.cc:2749] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:57.881551 12604 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 557fc8003f69439db9a4e155fe8344a8; no voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb
I20260709 12:12:57.882206 12760 raft_consensus.cc:2749] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:58.058696 12637 raft_consensus.cc:1275] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:58.059719 12784 consensus_queue.cc:1048] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:58.070920 12678 consensus_peers.cc:597] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:58.118712 12784 raft_consensus.cc:493] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.119071 12784 raft_consensus.cc:515] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:58.120630 12784 leader_election.cc:290] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:58.121829 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:58.122496 12637 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 1.
I20260709 12:12:58.123332 12678 leader_election.cc:304] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:58.123920 12784 raft_consensus.cc:2804] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:58.123977 12678 leader_election.cc:336] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:58.124349 12784 raft_consensus.cc:493] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.124693 12784 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:58.129385 12784 raft_consensus.cc:515] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:58.130852 12784 leader_election.cc:290] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:58.132050 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:58.132620 12637 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:58.133874 12678 leader_election.cc:336] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:58.137193 12637 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:12:58.138036 12678 leader_election.cc:304] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 0f432bb7cc334cab9e03fc2623e29f70
I20260709 12:12:58.138613 12784 raft_consensus.cc:2804] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:58.139019 12784 raft_consensus.cc:697] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:12:58.139671 12784 consensus_queue.cc:237] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:58.146059 12459 catalog_manager.cc:5697] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 1 to 2, leader changed from 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 2 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.237066 12784 raft_consensus.cc:493] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.237704 12784 raft_consensus.cc:515] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:58.239991 12784 leader_election.cc:290] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:58.241035 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:58.241658 12637 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 1.
I20260709 12:12:58.243172 12678 leader_election.cc:304] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:58.243928 12784 raft_consensus.cc:2804] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:58.243988 12678 leader_election.cc:336] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:58.244324 12784 raft_consensus.cc:493] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.244704 12784 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:58.250150 12784 raft_consensus.cc:515] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:58.251555 12784 leader_election.cc:290] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:58.252749 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:58.253340 12637 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:58.254554 12678 leader_election.cc:336] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:58.258180 12637 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:12:58.259023 12678 leader_election.cc:304] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 0f432bb7cc334cab9e03fc2623e29f70
I20260709 12:12:58.259544 12784 raft_consensus.cc:2804] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:58.259907 12784 raft_consensus.cc:697] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:12:58.260602 12784 consensus_queue.cc:237] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:58.266912 12459 catalog_manager.cc:5697] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 1 to 2, leader changed from 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 2 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:58.390763 12678 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111) [suppressed 123 similar messages]
I20260709 12:12:58.565018 12637 raft_consensus.cc:1275] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:58.566107 12784 consensus_queue.cc:1048] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:58.578939 12678 consensus_peers.cc:597] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:58.640637 12678 consensus_peers.cc:597] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:58.779404 12637 raft_consensus.cc:1275] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:58.781457 12847 consensus_queue.cc:1048] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:58.785058 12604 consensus_peers.cc:597] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:58.851552 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:12:58.858171 12604 consensus_peers.cc:597] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:59.005652 12604 consensus_peers.cc:597] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:59.143519 12604 consensus_peers.cc:597] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:59.227519 12678 consensus_peers.cc:597] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:59.384584 12678 consensus_peers.cc:597] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:59.770351 12847 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.770730 12847 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:59.772403 12847 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:59.773705 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8" is_pre_election: true
I20260709 12:12:59.774601 12637 raft_consensus.cc:2468] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:12:59.775914 12678 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:12:59.776448 12847 raft_consensus.cc:2804] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:59.776712 12847 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.777047 12847 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:59.777813 12678 leader_election.cc:336] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:59.781893 12847 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:59.783346 12847 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 3 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:12:59.784528 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:12:59.785008 12637 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:59.786384 12678 leader_election.cc:336] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111)
I20260709 12:12:59.790037 12637 raft_consensus.cc:2468] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 3.
I20260709 12:12:59.790880 12678 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 340a66ee22a04111811e74e948c8aefb, 557fc8003f69439db9a4e155fe8344a8; no voters: 0f432bb7cc334cab9e03fc2623e29f70
I20260709 12:12:59.791633 12847 raft_consensus.cc:2804] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:59.792374 12847 raft_consensus.cc:697] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 3 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:12:59.793104 12847 consensus_queue.cc:237] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:12:59.799898 12458 catalog_manager.cc:5697] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 1 to 3, leader changed from 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 3 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:59.852416 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:00.260434 12637 raft_consensus.cc:1275] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:00.261551 12847 consensus_queue.cc:1048] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:00.273077 12678 consensus_peers.cc:597] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:00.459098 12678 consensus_peers.cc:597] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:00.853235 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:13:00.900372 12678 consensus_peers.cc:597] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:01.215873 12678 consensus_peers.cc:597] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:01.304726 12604 consensus_peers.cc:597] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:01.409003 12604 consensus_peers.cc:597] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:01.485869  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:01.491688 12860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:01.491910 12861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.494861  3725 server_base.cc:1061] running on GCE node
W20260709 12:13:01.494946 12863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:01.496060  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:01.496244  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:01.496377  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599181496366 us; error 0 us; skew 500 ppm
I20260709 12:13:01.496891  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:01.498878  3725 webserver.cc:533] Webserver started at http://127.3.163.65:44583/ using document root <none> and password file <none>
I20260709 12:13:01.499287  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:01.499429  3725 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:13:01.502573  3725 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:01.505764 12868 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:01.506430  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:01.506690  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "0f432bb7cc334cab9e03fc2623e29f70"
format_stamp: "Formatted at 2026-07-09 12:12:54 on dist-test-slave-s43n"
I20260709 12:13:01.506953  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:01.523183  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:01.524151  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:01.525496  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:01.528494 12875 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:13:01.572458  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:13:01.572697  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.045s	user 0.002s	sys 0.000s
I20260709 12:13:01.572950  3725 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:13:01.576908 12875 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
W20260709 12:13:01.582710 12604 consensus_peers.cc:597] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:01.588474 12875 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:01.589244 12875 tablet_bootstrap.cc:492] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.589735 12875 ts_tablet_manager.cc:1403] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.006s
I20260709 12:13:01.591565 12875 raft_consensus.cc:359] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.592162 12875 raft_consensus.cc:740] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.592700 12875 consensus_queue.cc:260] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.594830 12875 ts_tablet_manager.cc:1434] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:01.595505 12875 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.606269 12875 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:01.606933 12875 tablet_bootstrap.cc:492] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.607380 12875 ts_tablet_manager.cc:1403] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:13:01.609040  3725 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:13:01.609282  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.036s	user 0.029s	sys 0.007s
I20260709 12:13:01.609230 12875 raft_consensus.cc:359] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.610002 12875 raft_consensus.cc:740] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.610625 12875 consensus_queue.cc:260] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.612031 12875 ts_tablet_manager.cc:1434] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:13:01.612627 12875 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.624323 12875 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.625046 12875 tablet_bootstrap.cc:492] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.625612 12875 ts_tablet_manager.cc:1403] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:13:01.627718 12875 raft_consensus.cc:359] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.628445 12875 raft_consensus.cc:740] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.629326 12875 consensus_queue.cc:260] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.631325 12875 ts_tablet_manager.cc:1434] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:01.631886 12875 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.641335 12875 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:13:01.642145 12875 tablet_bootstrap.cc:492] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.642714 12875 ts_tablet_manager.cc:1403] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:13:01.644685 12875 raft_consensus.cc:359] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.645368 12875 raft_consensus.cc:740] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.646113 12875 consensus_queue.cc:260] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
W20260709 12:13:01.646499 12604 consensus_peers.cc:597] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:01.647620 12875 ts_tablet_manager.cc:1434] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:01.648216 12875 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.657915 12875 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.658529 12875 tablet_bootstrap.cc:492] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.659021 12875 ts_tablet_manager.cc:1403] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:13:01.660585 12875 raft_consensus.cc:359] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.661060 12875 raft_consensus.cc:740] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.661563 12875 consensus_queue.cc:260] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.662871 12875 ts_tablet_manager.cc:1434] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:01.663446 12875 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.670100  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:46153
I20260709 12:13:01.670323 12937 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:46153 every 8 connection(s)
I20260709 12:13:01.672917 12875 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.673764 12875 tablet_bootstrap.cc:492] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.674345  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:01.674417 12875 ts_tablet_manager.cc:1403] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:13:01.679498 12875 raft_consensus.cc:359] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.680137 12875 raft_consensus.cc:740] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.680883 12875 consensus_queue.cc:260] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.682374 12875 ts_tablet_manager.cc:1434] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:01.683140 12875 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.696799 12875 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.697388 12875 tablet_bootstrap.cc:492] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.697846 12875 ts_tablet_manager.cc:1403] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:13:01.699924 12875 raft_consensus.cc:359] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.700579 12875 raft_consensus.cc:740] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.701320 12875 consensus_queue.cc:260] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.702049 12939 heartbeater.cc:344] Connected to a master server at 127.3.163.126:46491
I20260709 12:13:01.702489 12939 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:01.703333 12939 heartbeater.cc:507] Master 127.3.163.126:46491 requested a full tablet report, sending...
I20260709 12:13:01.703629 12875 ts_tablet_manager.cc:1434] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:01.704355 12875 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.706677 12911 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.707237 12712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
mode: GRACEFUL
new_leader_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:54104
I20260709 12:13:01.707927 12712 raft_consensus.cc:606] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Received request to transfer leadership to TS 557fc8003f69439db9a4e155fe8344a8
I20260709 12:13:01.711298 12458 ts_manager.cc:194] Re-registered known tserver with Master: 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153)
I20260709 12:13:01.711997 12712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
mode: GRACEFUL
new_leader_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:54104
I20260709 12:13:01.712553 12712 raft_consensus.cc:606] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Received request to transfer leadership to TS 557fc8003f69439db9a4e155fe8344a8
I20260709 12:13:01.713759 12911 pending_rounds.cc:85] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Aborting all ops after (but not including) 0
I20260709 12:13:01.714107 12911 pending_rounds.cc:107] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:13:01.714393 12911 raft_consensus.cc:2889] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:01.718072 12875 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.718974 12875 tablet_bootstrap.cc:492] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.719640 12875 ts_tablet_manager.cc:1403] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 12:13:01.722179 12875 raft_consensus.cc:359] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.722864 12875 raft_consensus.cc:740] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.723713 12875 consensus_queue.cc:260] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.725781 12875 ts_tablet_manager.cc:1434] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:13:01.726591 12875 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.726979 12458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44962
I20260709 12:13:01.730443 12939 heartbeater.cc:499] Master 127.3.163.126:46491 was elected leader, sending a full tablet report...
I20260709 12:13:01.730974 12637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
mode: GRACEFUL
new_leader_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:35610
I20260709 12:13:01.731562 12637 raft_consensus.cc:606] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Received request to transfer leadership to TS 340a66ee22a04111811e74e948c8aefb
I20260709 12:13:01.733865  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:01.734436  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:01.735054  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:01.740574 12875 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.741420 12875 tablet_bootstrap.cc:492] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.742050 12875 ts_tablet_manager.cc:1403] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:13:01.744325 12875 raft_consensus.cc:359] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.745021 12875 raft_consensus.cc:740] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.745723 12875 consensus_queue.cc:260] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.747587 12875 ts_tablet_manager.cc:1434] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:13:01.748353 12875 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap starting.
I20260709 12:13:01.759490 12875 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:01.760058 12875 tablet_bootstrap.cc:492] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Bootstrap complete.
I20260709 12:13:01.760505 12875 ts_tablet_manager.cc:1403] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:13:01.762209 12875 raft_consensus.cc:359] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.762679 12875 raft_consensus.cc:740] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f432bb7cc334cab9e03fc2623e29f70, State: Initialized, Role: FOLLOWER
I20260709 12:13:01.763201 12875 consensus_queue.cc:260] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.764551 12875 ts_tablet_manager.cc:1434] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:13:01.772799 12954 raft_consensus.cc:993] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8: : Instructing follower 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:01.773218 12760 raft_consensus.cc:1081] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Signalling peer 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:01.774420 12712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:48278
I20260709 12:13:01.774818 12712 raft_consensus.cc:493] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:01.775063 12712 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.779955 12712 raft_consensus.cc:515] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.781361 12712 leader_election.cc:290] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:13:01.782038 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:01.782173 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:13:01.782528 12911 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.782721 12637 raft_consensus.cc:3055] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:01.783082 12637 raft_consensus.cc:740] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:01.783705 12637 consensus_queue.cc:260] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.784598 12637 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.787074 12911 raft_consensus.cc:2468] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:13:01.787966 12678 leader_election.cc:304] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:13:01.788542 12847 raft_consensus.cc:2804] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:01.788928 12847 raft_consensus.cc:697] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:01.789974 12637 raft_consensus.cc:2468] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:13:01.789716 12847 consensus_queue.cc:237] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.795960 12458 catalog_manager.cc:5697] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 1 to 2, leader changed from 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 2 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:01.854070 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:01.876454 12911 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:01.909373 12911 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.913602 12911 pending_rounds.cc:85] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Aborting all ops after (but not including) 0
I20260709 12:13:01.913803 12911 pending_rounds.cc:107] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:13:01.913995 12911 raft_consensus.cc:2889] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:01.974931 12859 raft_consensus.cc:993] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb: : Instructing follower 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:01.975355 12847 raft_consensus.cc:1081] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Signalling peer 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:01.976717 12637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:53178
I20260709 12:13:01.977218 12637 raft_consensus.cc:493] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:01.977640 12637 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.984328 12637 raft_consensus.cc:515] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.986495 12637 leader_election.cc:290] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:13:01.986619 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:01.987030 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:13:01.987342 12911 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.987654 12712 raft_consensus.cc:3055] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:01.988004 12712 raft_consensus.cc:740] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:01.988878 12712 consensus_queue.cc:260] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:01.990100 12712 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:01.993980 12911 raft_consensus.cc:2468] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 2.
I20260709 12:13:01.995010 12604 leader_election.cc:304] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:13:01.995703 12760 raft_consensus.cc:2804] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:01.996063 12760 raft_consensus.cc:697] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 2 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:01.996541 12712 raft_consensus.cc:2468] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 2.
I20260709 12:13:01.996752 12760 consensus_queue.cc:237] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:02.003974 12458 catalog_manager.cc:5697] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 1 to 2, leader changed from 340a66ee22a04111811e74e948c8aefb (127.3.163.67) to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.139936 12911 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:02.144521 12911 pending_rounds.cc:85] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Aborting all ops after (but not including) 0
I20260709 12:13:02.144732 12911 pending_rounds.cc:107] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:13:02.144953 12911 raft_consensus.cc:2889] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:02.161094 12859 raft_consensus.cc:993] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb: : Instructing follower 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:02.161490 12847 raft_consensus.cc:1081] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Signalling peer 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:02.162817 12637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:53178
I20260709 12:13:02.163269 12637 raft_consensus.cc:493] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:02.163546 12637 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:02.168344 12637 raft_consensus.cc:515] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:02.169819 12637 leader_election.cc:290] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 3 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:13:02.170434 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:02.170678 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:13:02.171031 12911 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:02.171346 12712 raft_consensus.cc:3055] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:02.171617 12712 raft_consensus.cc:740] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:02.172212 12712 consensus_queue.cc:260] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:02.173116 12712 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:02.175575 12911 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 3.
I20260709 12:13:02.176415 12604 leader_election.cc:304] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:13:02.176982 12760 raft_consensus.cc:2804] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:02.177326 12760 raft_consensus.cc:697] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:02.177322 12712 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 3.
I20260709 12:13:02.178097 12760 consensus_queue.cc:237] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:02.184113 12458 catalog_manager.cc:5697] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 2 to 3, leader changed from 340a66ee22a04111811e74e948c8aefb (127.3.163.67) to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:02.202947 12911 raft_consensus.cc:1275] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:02.204533 12847 consensus_queue.cc:1048] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:02.226632 12637 raft_consensus.cc:1275] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:02.227936 12971 consensus_queue.cc:1048] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.478775 12911 raft_consensus.cc:1275] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:02.480012 12967 consensus_queue.cc:1048] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.487285 12712 raft_consensus.cc:1275] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:02.488387 12760 consensus_queue.cc:1048] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.627272 12712 raft_consensus.cc:1275] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:02.628026 12911 raft_consensus.cc:1275] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:02.628412 12760 consensus_queue.cc:1048] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.629263 12967 consensus_queue.cc:1048] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.756547  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:02.771437 12637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
mode: GRACEFUL
new_leader_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:35610
I20260709 12:13:02.772189 12637 raft_consensus.cc:606] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Received request to transfer leadership to TS 340a66ee22a04111811e74e948c8aefb
I20260709 12:13:02.774950 12637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f6049421c1148129926d6253446994e"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
mode: GRACEFUL
new_leader_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:35610
I20260709 12:13:02.775480 12637 raft_consensus.cc:606] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Received request to transfer leadership to TS 340a66ee22a04111811e74e948c8aefb
I20260709 12:13:02.778829 12712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
mode: GRACEFUL
new_leader_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:54104
I20260709 12:13:02.779565 12712 raft_consensus.cc:606] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Received request to transfer leadership to TS 557fc8003f69439db9a4e155fe8344a8
I20260709 12:13:02.781482  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:02.781999  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:02.782860  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:02.854971 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:02.901427 12954 raft_consensus.cc:993] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8: : Instructing follower 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:02.902041 12760 raft_consensus.cc:1081] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Signalling peer 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:02.903414 12712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f6049421c1148129926d6253446994e"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:48278
I20260709 12:13:02.903927 12712 raft_consensus.cc:493] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:02.904330 12712 raft_consensus.cc:3060] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:02.911787 12712 raft_consensus.cc:515] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:02.913317 12712 leader_election.cc:290] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:13:02.914280 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6049421c1148129926d6253446994e" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:13:02.914250 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6049421c1148129926d6253446994e" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:02.914885 12637 raft_consensus.cc:3055] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:02.915148 12911 raft_consensus.cc:3060] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:02.915158 12637 raft_consensus.cc:740] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:02.916168 12637 consensus_queue.cc:260] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:02.917512 12637 raft_consensus.cc:3060] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:02.922173 12911 raft_consensus.cc:2468] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:13:02.923334 12678 leader_election.cc:304] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:13:02.923421 12637 raft_consensus.cc:2468] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:13:02.924217 12971 raft_consensus.cc:2804] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:02.924633 12971 raft_consensus.cc:697] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:02.925597 12971 consensus_queue.cc:237] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:02.932617 12459 catalog_manager.cc:5697] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 1 to 2, leader changed from 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 2 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.132120 12970 raft_consensus.cc:993] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb: : Instructing follower 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:03.132647 12971 raft_consensus.cc:1081] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Signalling peer 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:03.134488 12638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:53178
I20260709 12:13:03.135056 12638 raft_consensus.cc:493] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:03.135406 12638 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.143307 12638 raft_consensus.cc:515] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.145047 12638 leader_election.cc:290] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 3 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:13:03.145605 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:03.146106 12911 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.146486 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:13:03.146945 12712 raft_consensus.cc:3055] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:03.147158 12712 raft_consensus.cc:740] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:03.147944 12712 consensus_queue.cc:260] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.149029 12712 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:03.151083 12911 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 3.
I20260709 12:13:03.152096 12604 leader_election.cc:304] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:13:03.152876 12760 raft_consensus.cc:2804] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:03.153293 12760 raft_consensus.cc:697] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:03.154160 12712 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 3.
I20260709 12:13:03.154207 12760 consensus_queue.cc:237] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.161160 12459 catalog_manager.cc:5697] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 2 to 3, leader changed from 340a66ee22a04111811e74e948c8aefb (127.3.163.67) to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.226334 12967 raft_consensus.cc:993] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8: : Instructing follower 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:03.226733 12760 raft_consensus.cc:1081] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Signalling peer 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:03.228209 12712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:48278
I20260709 12:13:03.228698 12712 raft_consensus.cc:493] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:03.229007 12712 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:03.234061 12712 raft_consensus.cc:515] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.235347 12712 leader_election.cc:290] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 4 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:13:03.236037 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:03.236245 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aa26dec8c8c47e696a9310faab15399" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:13:03.236627 12911 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:03.236840 12638 raft_consensus.cc:3055] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:03.237174 12638 raft_consensus.cc:740] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:03.237969 12638 consensus_queue.cc:260] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.239213 12638 raft_consensus.cc:3060] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:03.242681 12911 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 4.
I20260709 12:13:03.243574 12678 leader_election.cc:304] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:13:03.244252 12971 raft_consensus.cc:2804] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:03.244607 12971 raft_consensus.cc:697] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:03.244794 12638 raft_consensus.cc:2468] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 4.
I20260709 12:13:03.245570 12971 consensus_queue.cc:237] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.251273 12459 catalog_manager.cc:5697] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 3 to 4, leader changed from 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 4 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:03.322655 12638 raft_consensus.cc:1275] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:03.323683 12971 consensus_queue.cc:1048] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.332382 12911 raft_consensus.cc:1275] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:03.333815 12859 consensus_queue.cc:1048] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.626145 12911 raft_consensus.cc:1275] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:03.627140 12859 consensus_queue.cc:1048] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.634235 12638 raft_consensus.cc:1275] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:03.636237 12859 consensus_queue.cc:1048] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:03.665408 12911 raft_consensus.cc:1275] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:03.666528 12967 consensus_queue.cc:1048] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.674489 12712 raft_consensus.cc:1275] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:03.676213 12991 consensus_queue.cc:1048] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.790004  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:03.797291 12712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
mode: GRACEFUL
new_leader_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:54104
I20260709 12:13:03.797739 12712 raft_consensus.cc:606] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Received request to transfer leadership to TS 557fc8003f69439db9a4e155fe8344a8
I20260709 12:13:03.799837 12638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
mode: GRACEFUL
new_leader_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:35610
I20260709 12:13:03.800266 12638 raft_consensus.cc:606] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Received request to transfer leadership to TS 340a66ee22a04111811e74e948c8aefb
I20260709 12:13:03.802321 12712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e220f895274648a9a863c02331183ab9"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
mode: GRACEFUL
new_leader_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:54104
I20260709 12:13:03.802701 12712 raft_consensus.cc:606] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Received request to transfer leadership to TS 557fc8003f69439db9a4e155fe8344a8
I20260709 12:13:03.803630  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:03.804036  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:03.804508  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:03.855751 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:03.906762 12971 raft_consensus.cc:993] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb: : Instructing follower 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:03.907214 12859 raft_consensus.cc:1081] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Signalling peer 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:03.908470 12638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e220f895274648a9a863c02331183ab9"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:53178
I20260709 12:13:03.908921 12638 raft_consensus.cc:493] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:03.909178 12638 raft_consensus.cc:3060] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.914106 12638 raft_consensus.cc:515] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.915604 12638 leader_election.cc:290] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:13:03.916167 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e220f895274648a9a863c02331183ab9" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:03.916498 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e220f895274648a9a863c02331183ab9" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:13:03.916785 12911 raft_consensus.cc:3060] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.917006 12712 raft_consensus.cc:3055] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:03.917346 12712 raft_consensus.cc:740] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:03.918076 12712 consensus_queue.cc:260] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.918988 12712 raft_consensus.cc:3060] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:03.921859 12911 raft_consensus.cc:2468] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 2.
I20260709 12:13:03.922816 12604 leader_election.cc:304] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:13:03.923406 12991 raft_consensus.cc:2804] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:03.923856 12991 raft_consensus.cc:697] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 2 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:03.924243 12712 raft_consensus.cc:2468] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 2.
I20260709 12:13:03.924787 12991 consensus_queue.cc:237] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:03.931223 12461 catalog_manager.cc:5697] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 1 to 2, leader changed from 340a66ee22a04111811e74e948c8aefb (127.3.163.67) to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.188014 12967 raft_consensus.cc:993] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8: : Instructing follower 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:04.188511 12997 raft_consensus.cc:1081] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Signalling peer 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:04.189905 12712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:48278
I20260709 12:13:04.190316 12712 raft_consensus.cc:493] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:04.190595 12712 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:04.195436 12712 raft_consensus.cc:515] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:04.196780 12712 leader_election.cc:290] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 4 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:13:04.197348 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:04.197675 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:13:04.197906 12911 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:04.198204 12638 raft_consensus.cc:3055] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:04.198474 12638 raft_consensus.cc:740] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:04.199079 12638 consensus_queue.cc:260] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:04.199952 12638 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:04.202051 12911 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 4.
I20260709 12:13:04.202935 12678 leader_election.cc:304] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:13:04.203507 12859 raft_consensus.cc:2804] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:04.203994 12859 raft_consensus.cc:697] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:04.204774 12859 consensus_queue.cc:237] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:04.205415 12638 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 4.
I20260709 12:13:04.211084 12461 catalog_manager.cc:5697] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 3 to 4, leader changed from 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 4 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:04.224709 12970 raft_consensus.cc:993] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb: : Instructing follower 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:04.225122 12859 raft_consensus.cc:1081] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Signalling peer 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:04.226310 12638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:53178
I20260709 12:13:04.226716 12638 raft_consensus.cc:493] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:04.226984 12638 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:04.231693 12638 raft_consensus.cc:515] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:04.233134 12638 leader_election.cc:290] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 3 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:13:04.233721 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:04.233920 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf9ca1b632140f1a865bfa33c31317d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:13:04.234314 12911 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:04.234409 12712 raft_consensus.cc:3055] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:04.234743 12712 raft_consensus.cc:740] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:04.235427 12712 consensus_queue.cc:260] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:04.236379 12712 raft_consensus.cc:3060] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:04.238425 12911 raft_consensus.cc:2468] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 3.
I20260709 12:13:04.239204 12604 leader_election.cc:304] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:13:04.239833 12997 raft_consensus.cc:2804] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:04.240206 12997 raft_consensus.cc:697] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:04.241159 12712 raft_consensus.cc:2468] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 3.
I20260709 12:13:04.241081 12997 consensus_queue.cc:237] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:04.247330 12461 catalog_manager.cc:5697] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 2 to 3, leader changed from 340a66ee22a04111811e74e948c8aefb (127.3.163.67) to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:04.362488 12911 raft_consensus.cc:1275] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:04.363577 12997 consensus_queue.cc:1048] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:04.373029 12712 raft_consensus.cc:1275] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:04.375545 12967 consensus_queue.cc:1048] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:04.751402 12638 raft_consensus.cc:1275] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:04.752756 12859 consensus_queue.cc:1048] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:04.762396 12912 raft_consensus.cc:1275] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:04.763614 13007 consensus_queue.cc:1048] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:04.781694 12912 raft_consensus.cc:1275] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:04.782711 12967 consensus_queue.cc:1048] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:04.791011 12712 raft_consensus.cc:1275] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:04.792531 12991 consensus_queue.cc:1048] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:04.810950  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:04.817721 12637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21ed58de55d6431c8496d343e0c50b54"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
mode: GRACEFUL
new_leader_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:35610
I20260709 12:13:04.818097 12637 raft_consensus.cc:606] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Received request to transfer leadership to TS 340a66ee22a04111811e74e948c8aefb
I20260709 12:13:04.820317 12637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
mode: GRACEFUL
new_leader_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:35610
I20260709 12:13:04.820660 12637 raft_consensus.cc:606] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 2 LEADER]: Received request to transfer leadership to TS 340a66ee22a04111811e74e948c8aefb
I20260709 12:13:04.822700 12711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
mode: GRACEFUL
new_leader_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:54104
I20260709 12:13:04.823102 12711 raft_consensus.cc:606] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Received request to transfer leadership to TS 557fc8003f69439db9a4e155fe8344a8
I20260709 12:13:04.824187  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:04.824586  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:04.825078  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:04.856465 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:05.042488 12967 raft_consensus.cc:993] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8: : Instructing follower 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:05.043031 12991 raft_consensus.cc:1081] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 2 LEADER]: Signalling peer 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:05.044317 12711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:48278
I20260709 12:13:05.044860 12711 raft_consensus.cc:493] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:05.045123 12711 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:05.050997 12711 raft_consensus.cc:515] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.052631 12711 leader_election.cc:290] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 3 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:13:05.053231 12912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:05.053498 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376861a0cfb2413abb6c8e185ca752e6" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:13:05.053879 12912 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:05.054021 12637 raft_consensus.cc:3055] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:05.054358 12637 raft_consensus.cc:740] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:05.054983 12637 consensus_queue.cc:260] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.055842 12637 raft_consensus.cc:3060] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:05.058967 12912 raft_consensus.cc:2468] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 3.
I20260709 12:13:05.059839 12678 leader_election.cc:304] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:13:05.060441 12637 raft_consensus.cc:2468] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 3.
I20260709 12:13:05.060612 13006 raft_consensus.cc:2804] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:05.061141 13006 raft_consensus.cc:697] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 3 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:05.061996 13006 consensus_queue.cc:237] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.068200 12461 catalog_manager.cc:5697] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 2 to 3, leader changed from 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 3 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.197259 12967 raft_consensus.cc:993] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8: : Instructing follower 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:05.197669 12991 raft_consensus.cc:1081] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Signalling peer 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:05.198890 12711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21ed58de55d6431c8496d343e0c50b54"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:48278
I20260709 12:13:05.199295 12711 raft_consensus.cc:493] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:05.199532 12711 raft_consensus.cc:3060] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.204459 12711 raft_consensus.cc:515] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.206002 12711 leader_election.cc:290] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:13:05.206482 12912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ed58de55d6431c8496d343e0c50b54" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:05.206753 12637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21ed58de55d6431c8496d343e0c50b54" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:13:05.207104 12912 raft_consensus.cc:3060] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.207260 12637 raft_consensus.cc:3055] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:05.207587 12637 raft_consensus.cc:740] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:05.208277 12637 consensus_queue.cc:260] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.209298 12637 raft_consensus.cc:3060] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:05.211864 12912 raft_consensus.cc:2468] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:13:05.212841 12678 leader_election.cc:304] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:13:05.213546 13006 raft_consensus.cc:2804] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:05.214004 13006 raft_consensus.cc:697] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:05.214890 13006 consensus_queue.cc:237] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.215323 12637 raft_consensus.cc:2468] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 2.
I20260709 12:13:05.221279 12461 catalog_manager.cc:5697] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 1 to 2, leader changed from 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 2 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.394946 12859 raft_consensus.cc:993] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb: : Instructing follower 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:05.395341 13006 raft_consensus.cc:1081] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Signalling peer 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:05.396538 12637 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:53178
I20260709 12:13:05.396948 12637 raft_consensus.cc:493] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:05.397281 12637 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:05.402068 12637 raft_consensus.cc:515] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.403318 12637 leader_election.cc:290] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 3 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:13:05.404033 12912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:05.404338 12711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:13:05.404656 12912 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:05.404983 12711 raft_consensus.cc:3055] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:05.405314 12711 raft_consensus.cc:740] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:05.406241 12711 consensus_queue.cc:260] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.407558 12711 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:05.411412 12912 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 3.
I20260709 12:13:05.412578 12604 leader_election.cc:304] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:13:05.413199 12967 raft_consensus.cc:2804] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:05.413657 12967 raft_consensus.cc:697] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:05.414160 12711 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 3.
I20260709 12:13:05.414577 12967 consensus_queue.cc:237] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.420665 12461 catalog_manager.cc:5697] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 2 to 3, leader changed from 340a66ee22a04111811e74e948c8aefb (127.3.163.67) to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.595116 12912 raft_consensus.cc:1275] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:05.596575 12912 raft_consensus.cc:1275] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:05.596491 13006 consensus_queue.cc:1048] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.597713 13006 consensus_queue.cc:1048] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.603044 12637 raft_consensus.cc:1275] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:05.605996 13006 consensus_queue.cc:1048] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.618187 12638 raft_consensus.cc:1275] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:05.619454 12859 consensus_queue.cc:1048] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.826217 12711 raft_consensus.cc:1275] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:05.827184 12967 consensus_queue.cc:1048] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.831053  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:05.835459 12911 raft_consensus.cc:1275] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:05.837935 13027 consensus_queue.cc:1048] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:05.846339 12712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
mode: GRACEFUL
new_leader_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:54104
I20260709 12:13:05.846815 12712 raft_consensus.cc:606] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 3 LEADER]: Received request to transfer leadership to TS 557fc8003f69439db9a4e155fe8344a8
I20260709 12:13:05.849045 12638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
mode: GRACEFUL
new_leader_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:35610
I20260709 12:13:05.849426 12638 raft_consensus.cc:606] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Received request to transfer leadership to TS 340a66ee22a04111811e74e948c8aefb
I20260709 12:13:05.851549 12712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
mode: GRACEFUL
new_leader_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:54104
I20260709 12:13:05.851922 12712 raft_consensus.cc:606] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Received request to transfer leadership to TS 557fc8003f69439db9a4e155fe8344a8
I20260709 12:13:05.852778  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:05.853266  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:05.853789  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:05.857192 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:05.907586 12859 raft_consensus.cc:993] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb: : Instructing follower 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:05.908030 13007 raft_consensus.cc:1081] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 3 LEADER]: Signalling peer 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:05.909204 12638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:53178
I20260709 12:13:05.909591 12638 raft_consensus.cc:493] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:05.909824 12638 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:05.914202 12638 raft_consensus.cc:515] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.915485 12638 leader_election.cc:290] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 4 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:13:05.916064 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:05.916282 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08beb96a432b4e7eb0cda33ba55b9187" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:13:05.916630 12911 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:05.916826 12712 raft_consensus.cc:3055] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:05.917135 12712 raft_consensus.cc:740] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:05.917778 12712 consensus_queue.cc:260] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.918599 12712 raft_consensus.cc:3060] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:05.920892 12911 raft_consensus.cc:2468] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 4.
I20260709 12:13:05.921728 12604 leader_election.cc:304] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:13:05.922297 13027 raft_consensus.cc:2804] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:05.922669 13027 raft_consensus.cc:697] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 4 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:05.922691 12712 raft_consensus.cc:2468] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 4.
I20260709 12:13:05.923664 13027 consensus_queue.cc:237] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:05.929752 12458 catalog_manager.cc:5697] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 3 to 4, leader changed from 340a66ee22a04111811e74e948c8aefb (127.3.163.67) to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 4 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.041114 12859 raft_consensus.cc:993] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb: : Instructing follower 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:06.041498 13007 raft_consensus.cc:1081] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Signalling peer 557fc8003f69439db9a4e155fe8344a8 to start an election
I20260709 12:13:06.042670 12638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb"
dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
 from {username='slave'} at 127.0.0.1:53178
I20260709 12:13:06.043066 12638 raft_consensus.cc:493] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:06.043306 12638 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:06.047667 12638 raft_consensus.cc:515] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:06.049216 12638 leader_election.cc:290] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 5 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 340a66ee22a04111811e74e948c8aefb (127.3.163.67:41129)
I20260709 12:13:06.049731 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:06.050311 12911 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:06.051535 12712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc429033ac8244beb03fab61253d9bfb" candidate_uuid: "557fc8003f69439db9a4e155fe8344a8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "340a66ee22a04111811e74e948c8aefb"
I20260709 12:13:06.052096 12712 raft_consensus.cc:3055] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:06.052362 12712 raft_consensus.cc:740] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:06.053020 12712 consensus_queue.cc:260] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:06.053810 12712 raft_consensus.cc:3060] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:06.054885 12911 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 5.
I20260709 12:13:06.055722 12604 leader_election.cc:304] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 557fc8003f69439db9a4e155fe8344a8; no voters: 
I20260709 12:13:06.056399 13027 raft_consensus.cc:2804] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:06.056763 13027 raft_consensus.cc:697] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 5 LEADER]: Becoming Leader. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:06.057463 13027 consensus_queue.cc:237] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:06.058285 12712 raft_consensus.cc:2468] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557fc8003f69439db9a4e155fe8344a8 in term 5.
I20260709 12:13:06.063725 12458 catalog_manager.cc:5697] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 reported cstate change: term changed from 4 to 5, leader changed from 340a66ee22a04111811e74e948c8aefb (127.3.163.67) to 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66). New cstate: current_term: 5 leader_uuid: "557fc8003f69439db9a4e155fe8344a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.309842 13016 raft_consensus.cc:993] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8: : Instructing follower 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:06.310268 13027 raft_consensus.cc:1081] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Signalling peer 340a66ee22a04111811e74e948c8aefb to start an election
I20260709 12:13:06.311450 12712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d"
dest_uuid: "340a66ee22a04111811e74e948c8aefb"
 from {username='slave'} at 127.0.0.1:48278
I20260709 12:13:06.311836 12712 raft_consensus.cc:493] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:06.312101 12712 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:06.316270 12712 raft_consensus.cc:515] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:06.317526 12712 leader_election.cc:290] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 4 election: Requested vote from peers 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153), 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709)
I20260709 12:13:06.318145 12911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0f432bb7cc334cab9e03fc2623e29f70"
I20260709 12:13:06.318388 12638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d257be2f944af3979cf750d87a119d" candidate_uuid: "340a66ee22a04111811e74e948c8aefb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "557fc8003f69439db9a4e155fe8344a8"
I20260709 12:13:06.318634 12911 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:06.318902 12638 raft_consensus.cc:3055] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:06.319136 12638 raft_consensus.cc:740] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 557fc8003f69439db9a4e155fe8344a8, State: Running, Role: LEADER
I20260709 12:13:06.319658 12638 consensus_queue.cc:260] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:06.320468 12638 raft_consensus.cc:3060] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:06.322809 12911 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 4.
I20260709 12:13:06.323722 12678 leader_election.cc:304] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f432bb7cc334cab9e03fc2623e29f70, 340a66ee22a04111811e74e948c8aefb; no voters: 
I20260709 12:13:06.324283 13034 raft_consensus.cc:2804] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:06.324640 13034 raft_consensus.cc:697] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Becoming Leader. State: Replica: 340a66ee22a04111811e74e948c8aefb, State: Running, Role: LEADER
I20260709 12:13:06.324739 12638 raft_consensus.cc:2468] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 340a66ee22a04111811e74e948c8aefb in term 4.
I20260709 12:13:06.325354 13034 consensus_queue.cc:237] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } }
I20260709 12:13:06.330570 12458 catalog_manager.cc:5697] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb reported cstate change: term changed from 3 to 4, leader changed from 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66) to 340a66ee22a04111811e74e948c8aefb (127.3.163.67). New cstate: current_term: 4 leader_uuid: "340a66ee22a04111811e74e948c8aefb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.491202 12712 raft_consensus.cc:1275] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:06.492161 13027 consensus_queue.cc:1048] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:06.500756 12911 raft_consensus.cc:1275] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:06.502285 13016 consensus_queue.cc:1048] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:06.562443 12911 raft_consensus.cc:1275] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 5 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:06.563436 13027 consensus_queue.cc:1048] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:06.565804 12712 raft_consensus.cc:1275] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 5 FOLLOWER]: Refusing update from remote peer 557fc8003f69439db9a4e155fe8344a8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:06.566993 13016 consensus_queue.cc:1048] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "340a66ee22a04111811e74e948c8aefb" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 41129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:06.706818 12638 raft_consensus.cc:1275] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:06.707840 13034 consensus_queue.cc:1048] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "557fc8003f69439db9a4e155fe8344a8" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 37709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:06.714006 12911 raft_consensus.cc:1275] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Refusing update from remote peer 340a66ee22a04111811e74e948c8aefb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:06.715956 13044 consensus_queue.cc:1048] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f432bb7cc334cab9e03fc2623e29f70" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 46153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:06.857996 12509 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:13:06.859841  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:06.891274  3725 tablet_server.cc:179] TabletServer@127.3.163.65:46153 shutting down...
I20260709 12:13:06.909169  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:06.909847  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.910475  3725 raft_consensus.cc:2243] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.910925  3725 raft_consensus.cc:2272] T 9cf9ca1b632140f1a865bfa33c31317d P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.913311  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.914078  3725 raft_consensus.cc:2243] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.914461  3725 raft_consensus.cc:2272] T 8f6049421c1148129926d6253446994e P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.916704  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.917354  3725 raft_consensus.cc:2243] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.917737  3725 raft_consensus.cc:2272] T 376861a0cfb2413abb6c8e185ca752e6 P 0f432bb7cc334cab9e03fc2623e29f70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.919565  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.920059  3725 raft_consensus.cc:2243] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.920440  3725 raft_consensus.cc:2272] T 21ed58de55d6431c8496d343e0c50b54 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.922314  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.922784  3725 raft_consensus.cc:2243] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.923215  3725 raft_consensus.cc:2272] T 445f42fe2f2b4b2b8b46901dbad66398 P 0f432bb7cc334cab9e03fc2623e29f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.925207  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.925657  3725 raft_consensus.cc:2243] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.926059  3725 raft_consensus.cc:2272] T 8aa26dec8c8c47e696a9310faab15399 P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.928012  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.928529  3725 raft_consensus.cc:2243] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.928911  3725 raft_consensus.cc:2272] T e220f895274648a9a863c02331183ab9 P 0f432bb7cc334cab9e03fc2623e29f70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.930953  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.931383  3725 raft_consensus.cc:2243] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.931766  3725 raft_consensus.cc:2272] T 08beb96a432b4e7eb0cda33ba55b9187 P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.934186  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.934648  3725 raft_consensus.cc:2243] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.935053  3725 raft_consensus.cc:2272] T a6d257be2f944af3979cf750d87a119d P 0f432bb7cc334cab9e03fc2623e29f70 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:06.937712  3725 tablet_replica.cc:333] stopping tablet replica
I20260709 12:13:06.938186  3725 raft_consensus.cc:2243] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:06.938588  3725 raft_consensus.cc:2272] T cc429033ac8244beb03fab61253d9bfb P 0f432bb7cc334cab9e03fc2623e29f70 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:06.960016 12678 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111) [suppressed 65 similar messages]
I20260709 12:13:06.960266  3725 tablet_server.cc:196] TabletServer@127.3.163.65:46153 shutdown complete.
W20260709 12:13:06.963290 12678 consensus_peers.cc:597] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:06.963768 12678 consensus_peers.cc:597] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:06.987241  3725 tablet_server.cc:179] TabletServer@127.3.163.66:0 shutting down...
W20260709 12:13:06.993952 12604 consensus_peers.cc:597] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:07.003330 12678 consensus_peers.cc:597] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb -> Peer 557fc8003f69439db9a4e155fe8344a8 (127.3.163.66:37709): Couldn't send request to peer 557fc8003f69439db9a4e155fe8344a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.015280  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:07.016896  3725 tablet_replica.cc:333] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.017634  3725 raft_consensus.cc:2243] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.018369  3725 raft_consensus.cc:2272] T cc429033ac8244beb03fab61253d9bfb P 557fc8003f69439db9a4e155fe8344a8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.020762  3725 tablet_replica.cc:333] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.021337  3725 raft_consensus.cc:2243] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.022017  3725 raft_consensus.cc:2272] T 9cf9ca1b632140f1a865bfa33c31317d P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.023872  3725 tablet_replica.cc:333] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.024408  3725 raft_consensus.cc:2243] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.024777  3725 raft_consensus.cc:2272] T 8aa26dec8c8c47e696a9310faab15399 P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.026613  3725 tablet_replica.cc:333] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.027081  3725 raft_consensus.cc:2243] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.027864  3725 raft_consensus.cc:2272] T 445f42fe2f2b4b2b8b46901dbad66398 P 557fc8003f69439db9a4e155fe8344a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.029860  3725 tablet_replica.cc:333] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.030369  3725 raft_consensus.cc:2243] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.030746  3725 raft_consensus.cc:2272] T 21ed58de55d6431c8496d343e0c50b54 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.032618  3725 tablet_replica.cc:333] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.033115  3725 raft_consensus.cc:2243] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.033500  3725 raft_consensus.cc:2272] T a6d257be2f944af3979cf750d87a119d P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.036021  3725 tablet_replica.cc:333] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.036646  3725 raft_consensus.cc:2243] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.037088  3725 raft_consensus.cc:2272] T 8f6049421c1148129926d6253446994e P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.039347  3725 tablet_replica.cc:333] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.039857  3725 raft_consensus.cc:2243] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:07.040124 12678 consensus_peers.cc:597] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb -> Peer 0f432bb7cc334cab9e03fc2623e29f70 (127.3.163.65:46153): Couldn't send request to peer 0f432bb7cc334cab9e03fc2623e29f70. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:46153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.040221  3725 raft_consensus.cc:2272] T 376861a0cfb2413abb6c8e185ca752e6 P 557fc8003f69439db9a4e155fe8344a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.042225  3725 tablet_replica.cc:333] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.042698  3725 raft_consensus.cc:2243] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.043358  3725 raft_consensus.cc:2272] T e220f895274648a9a863c02331183ab9 P 557fc8003f69439db9a4e155fe8344a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.045369  3725 tablet_replica.cc:333] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8: stopping tablet replica
I20260709 12:13:07.045816  3725 raft_consensus.cc:2243] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.046528  3725 raft_consensus.cc:2272] T 08beb96a432b4e7eb0cda33ba55b9187 P 557fc8003f69439db9a4e155fe8344a8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.076270  3725 tablet_server.cc:196] TabletServer@127.3.163.66:0 shutdown complete.
I20260709 12:13:07.097555  3725 tablet_server.cc:179] TabletServer@127.3.163.67:0 shutting down...
I20260709 12:13:07.118007  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:07.118568  3725 tablet_replica.cc:333] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.119100  3725 raft_consensus.cc:2243] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.119481  3725 raft_consensus.cc:2272] T cc429033ac8244beb03fab61253d9bfb P 340a66ee22a04111811e74e948c8aefb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.121843  3725 tablet_replica.cc:333] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.122340  3725 raft_consensus.cc:2243] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.122690  3725 raft_consensus.cc:2272] T 9cf9ca1b632140f1a865bfa33c31317d P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.124454  3725 tablet_replica.cc:333] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.124967  3725 raft_consensus.cc:2243] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.125674  3725 raft_consensus.cc:2272] T a6d257be2f944af3979cf750d87a119d P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.127888  3725 tablet_replica.cc:333] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.128343  3725 raft_consensus.cc:2243] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.128738  3725 raft_consensus.cc:2272] T e220f895274648a9a863c02331183ab9 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.131191  3725 tablet_replica.cc:333] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.131842  3725 raft_consensus.cc:2243] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.132248  3725 raft_consensus.cc:2272] T 08beb96a432b4e7eb0cda33ba55b9187 P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.135097  3725 tablet_replica.cc:333] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.135771  3725 raft_consensus.cc:2243] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.136655  3725 raft_consensus.cc:2272] T 8f6049421c1148129926d6253446994e P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.138566  3725 tablet_replica.cc:333] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.139065  3725 raft_consensus.cc:2243] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:07.139413  3725 raft_consensus.cc:2272] T 445f42fe2f2b4b2b8b46901dbad66398 P 340a66ee22a04111811e74e948c8aefb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.141297  3725 tablet_replica.cc:333] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.141749  3725 raft_consensus.cc:2243] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.142376  3725 raft_consensus.cc:2272] T 21ed58de55d6431c8496d343e0c50b54 P 340a66ee22a04111811e74e948c8aefb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.144167  3725 tablet_replica.cc:333] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.144574  3725 raft_consensus.cc:2243] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.145267  3725 raft_consensus.cc:2272] T 8aa26dec8c8c47e696a9310faab15399 P 340a66ee22a04111811e74e948c8aefb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.147079  3725 tablet_replica.cc:333] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb: stopping tablet replica
I20260709 12:13:07.147483  3725 raft_consensus.cc:2243] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.148180  3725 raft_consensus.cc:2272] T 376861a0cfb2413abb6c8e185ca752e6 P 340a66ee22a04111811e74e948c8aefb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.176888  3725 tablet_server.cc:196] TabletServer@127.3.163.67:0 shutdown complete.
I20260709 12:13:07.197737  3725 master.cc:562] Master@127.3.163.126:46491 shutting down...
I20260709 12:13:07.216197  3725 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:07.216625  3725 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:07.216948  3725 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d80c0ba3d6048e192353f8b6ebd0ded: stopping tablet replica
I20260709 12:13:07.235584  3725 master.cc:584] Master@127.3.163.126:46491 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12546 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:13:07.273499  3725 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.163.126:36009
I20260709 12:13:07.274602  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:07.279533 13052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:07.279553 13051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:07.280728 13054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:07.281903  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:07.282670  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:07.282843  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:07.282958  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599187282948 us; error 0 us; skew 500 ppm
I20260709 12:13:07.283386  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:07.285533  3725 webserver.cc:533] Webserver started at http://127.3.163.126:36959/ using document root <none> and password file <none>
I20260709 12:13:07.285945  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:07.286087  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:07.286291  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:07.287273  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/master-0-root/instance:
uuid: "9f3e457cd9cf47cc882c281e292bc212"
format_stamp: "Formatted at 2026-07-09 12:13:07 on dist-test-slave-s43n"
I20260709 12:13:07.291208  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.005s
I20260709 12:13:07.294176 13059 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.294802  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:07.295048  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/master-0-root
uuid: "9f3e457cd9cf47cc882c281e292bc212"
format_stamp: "Formatted at 2026-07-09 12:13:07 on dist-test-slave-s43n"
I20260709 12:13:07.295289  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:07.307714  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:07.308748  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:07.344203  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.126:36009
I20260709 12:13:07.344309 13110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.126:36009 every 8 connection(s)
I20260709 12:13:07.347782 13111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.358418 13111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212: Bootstrap starting.
I20260709 12:13:07.363034 13111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.366814 13111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212: No bootstrap required, opened a new log
I20260709 12:13:07.368768 13111 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3e457cd9cf47cc882c281e292bc212" member_type: VOTER }
I20260709 12:13:07.369153 13111 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.369356 13111 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3e457cd9cf47cc882c281e292bc212, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.369890 13111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3e457cd9cf47cc882c281e292bc212" member_type: VOTER }
I20260709 12:13:07.370476 13111 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:07.370688 13111 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:07.370926 13111 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:07.375047 13111 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3e457cd9cf47cc882c281e292bc212" member_type: VOTER }
I20260709 12:13:07.375504 13111 leader_election.cc:304] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f3e457cd9cf47cc882c281e292bc212; no voters: 
I20260709 12:13:07.376523 13111 leader_election.cc:290] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:07.376796 13114 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:07.378024 13114 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3e457cd9cf47cc882c281e292bc212, State: Running, Role: LEADER
I20260709 12:13:07.378630 13114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3e457cd9cf47cc882c281e292bc212" member_type: VOTER }
I20260709 12:13:07.379220 13111 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:07.381294 13116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f3e457cd9cf47cc882c281e292bc212. Latest consensus state: current_term: 1 leader_uuid: "9f3e457cd9cf47cc882c281e292bc212" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3e457cd9cf47cc882c281e292bc212" member_type: VOTER } }
I20260709 12:13:07.381287 13115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f3e457cd9cf47cc882c281e292bc212" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f3e457cd9cf47cc882c281e292bc212" member_type: VOTER } }
I20260709 12:13:07.381991 13116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:07.382057 13115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:07.384686 13119 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:07.389685 13119 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:07.392956  3725 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:07.397809 13119 catalog_manager.cc:1383] Generated new cluster ID: 7cc11cfed00e435f97ef1f3bd9f5b3d2
I20260709 12:13:07.398015 13119 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:07.441680 13119 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:07.442883 13119 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:07.463980 13119 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212: Generated new TSK 0
I20260709 12:13:07.464452 13119 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:07.523159  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:07.528488 13132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:07.529464 13133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:07.530743 13135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:07.531489  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:07.532269  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:07.532447  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:07.532572  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599187532561 us; error 0 us; skew 500 ppm
I20260709 12:13:07.533102  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:07.535132  3725 webserver.cc:533] Webserver started at http://127.3.163.65:40075/ using document root <none> and password file <none>
I20260709 12:13:07.535528  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:07.535676  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:07.535868  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:07.536799  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-0-root/instance:
uuid: "a6e9fd107a15401187cf73743d379bf0"
format_stamp: "Formatted at 2026-07-09 12:13:07 on dist-test-slave-s43n"
I20260709 12:13:07.540782  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:13:07.543711 13140 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.544339  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:07.544600  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "a6e9fd107a15401187cf73743d379bf0"
format_stamp: "Formatted at 2026-07-09 12:13:07 on dist-test-slave-s43n"
I20260709 12:13:07.544872  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:07.564404  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:07.565546  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:07.566828  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:07.568857  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:07.569032  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.569253  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:07.569401  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.607267  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:34901
I20260709 12:13:07.607383 13202 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:34901 every 8 connection(s)
I20260709 12:13:07.611825  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:07.618409 13207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:07.618743 13208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:07.622305 13210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:07.622447  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:07.623515 13203 heartbeater.cc:344] Connected to a master server at 127.3.163.126:36009
I20260709 12:13:07.623588  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:07.623893  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:07.623931 13203 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:07.624109  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599187624091 us; error 0 us; skew 500 ppm
I20260709 12:13:07.624713  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:07.624709 13203 heartbeater.cc:507] Master 127.3.163.126:36009 requested a full tablet report, sending...
I20260709 12:13:07.627029 13076 ts_manager.cc:194] Registered new tserver with Master: a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901)
I20260709 12:13:07.627228  3725 webserver.cc:533] Webserver started at http://127.3.163.66:39635/ using document root <none> and password file <none>
I20260709 12:13:07.627787  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:07.627960  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:07.628203  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:07.628952 13076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60234
I20260709 12:13:07.629318  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-1-root/instance:
uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
format_stamp: "Formatted at 2026-07-09 12:13:07 on dist-test-slave-s43n"
I20260709 12:13:07.633498  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:07.636425 13215 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.637156  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:07.637410  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-1-root
uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
format_stamp: "Formatted at 2026-07-09 12:13:07 on dist-test-slave-s43n"
I20260709 12:13:07.637640  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:07.652083  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:07.653159  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:07.654454  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:07.656400  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:07.656570  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.656796  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:07.656960  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:13:07.693935  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.66:34975
I20260709 12:13:07.694022 13277 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.66:34975 every 8 connection(s)
I20260709 12:13:07.698398  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:07.705335 13281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:07.706771 13282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:07.709646 13284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:07.709901  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:07.710109 13278 heartbeater.cc:344] Connected to a master server at 127.3.163.126:36009
I20260709 12:13:07.710579 13278 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:07.710855  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:07.711114  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:07.711225 13278 heartbeater.cc:507] Master 127.3.163.126:36009 requested a full tablet report, sending...
I20260709 12:13:07.711269  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599187711252 us; error 0 us; skew 500 ppm
I20260709 12:13:07.712110  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:07.713413 13076 ts_manager.cc:194] Registered new tserver with Master: 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
I20260709 12:13:07.714505  3725 webserver.cc:533] Webserver started at http://127.3.163.67:39193/ using document root <none> and password file <none>
I20260709 12:13:07.714877 13076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51650
I20260709 12:13:07.715008  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:07.715288  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:07.715526  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:07.716917  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-2-root/instance:
uuid: "762e84c2aebd47b28e931cd13923956c"
format_stamp: "Formatted at 2026-07-09 12:13:07 on dist-test-slave-s43n"
I20260709 12:13:07.720988  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:13:07.723855 13289 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.724502  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:07.724758  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-2-root
uuid: "762e84c2aebd47b28e931cd13923956c"
format_stamp: "Formatted at 2026-07-09 12:13:07 on dist-test-slave-s43n"
I20260709 12:13:07.725046  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598894987430-3725-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:07.736351  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:07.737401  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:07.738680  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:07.740635  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:07.740830  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.741055  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:07.741201  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:07.777869  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.67:46445
I20260709 12:13:07.777968 13351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.67:46445 every 8 connection(s)
I20260709 12:13:07.790606 13352 heartbeater.cc:344] Connected to a master server at 127.3.163.126:36009
I20260709 12:13:07.790971 13352 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:07.791606 13352 heartbeater.cc:507] Master 127.3.163.126:36009 requested a full tablet report, sending...
I20260709 12:13:07.793356 13076 ts_manager.cc:194] Registered new tserver with Master: 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:07.793800  3725 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012910115s
I20260709 12:13:07.794679 13076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51654
I20260709 12:13:07.815573 13076 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51664:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:07.817564 13076 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:07.855923 13168 tablet_service.cc:1511] Processing CreateTablet for tablet d0b6049be9964d9382e01baf029d1eb0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e258c2846a14135996a05da8d3eaa51]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:07.857398 13168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b6049be9964d9382e01baf029d1eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.859269 13167 tablet_service.cc:1511] Processing CreateTablet for tablet a22a72ce18b244aca09075497c6ecaa2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e258c2846a14135996a05da8d3eaa51]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:07.860566 13167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22a72ce18b244aca09075497c6ecaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.871105 13243 tablet_service.cc:1511] Processing CreateTablet for tablet d0b6049be9964d9382e01baf029d1eb0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e258c2846a14135996a05da8d3eaa51]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:07.871428 13242 tablet_service.cc:1511] Processing CreateTablet for tablet a22a72ce18b244aca09075497c6ecaa2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e258c2846a14135996a05da8d3eaa51]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:07.872380 13243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b6049be9964d9382e01baf029d1eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.872980 13242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22a72ce18b244aca09075497c6ecaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.884557 13367 tablet_bootstrap.cc:492] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0: Bootstrap starting.
I20260709 12:13:07.890990 13317 tablet_service.cc:1511] Processing CreateTablet for tablet d0b6049be9964d9382e01baf029d1eb0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e258c2846a14135996a05da8d3eaa51]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:07.891372 13367 tablet_bootstrap.cc:654] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.891523 13316 tablet_service.cc:1511] Processing CreateTablet for tablet a22a72ce18b244aca09075497c6ecaa2 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5e258c2846a14135996a05da8d3eaa51]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:07.892295 13317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b6049be9964d9382e01baf029d1eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.892939 13316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22a72ce18b244aca09075497c6ecaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.895292 13368 tablet_bootstrap.cc:492] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967: Bootstrap starting.
I20260709 12:13:07.903064 13368 tablet_bootstrap.cc:654] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.905601 13367 tablet_bootstrap.cc:492] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0: No bootstrap required, opened a new log
I20260709 12:13:07.906060 13367 ts_tablet_manager.cc:1403] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 12:13:07.908799 13367 raft_consensus.cc:359] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:07.909550 13367 raft_consensus.cc:385] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.909842 13367 raft_consensus.cc:740] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e9fd107a15401187cf73743d379bf0, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.910799 13367 consensus_queue.cc:260] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:07.913918 13371 tablet_bootstrap.cc:492] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c: Bootstrap starting.
I20260709 12:13:07.914288 13368 tablet_bootstrap.cc:492] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967: No bootstrap required, opened a new log
I20260709 12:13:07.914824 13368 ts_tablet_manager.cc:1403] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:13:07.915400 13203 heartbeater.cc:499] Master 127.3.163.126:36009 was elected leader, sending a full tablet report...
I20260709 12:13:07.915901 13367 ts_tablet_manager.cc:1434] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:13:07.916848 13367 tablet_bootstrap.cc:492] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0: Bootstrap starting.
I20260709 12:13:07.917713 13368 raft_consensus.cc:359] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:07.918541 13368 raft_consensus.cc:385] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.918846 13368 raft_consensus.cc:740] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.919751 13368 consensus_queue.cc:260] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:07.920900 13371 tablet_bootstrap.cc:654] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.923475 13367 tablet_bootstrap.cc:654] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.929279 13368 ts_tablet_manager.cc:1434] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 12:13:07.930112 13278 heartbeater.cc:499] Master 127.3.163.126:36009 was elected leader, sending a full tablet report...
I20260709 12:13:07.932366 13368 tablet_bootstrap.cc:492] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967: Bootstrap starting.
I20260709 12:13:07.933753 13367 tablet_bootstrap.cc:492] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0: No bootstrap required, opened a new log
I20260709 12:13:07.934271 13367 ts_tablet_manager.cc:1403] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:13:07.937067 13367 raft_consensus.cc:359] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:07.937773 13367 raft_consensus.cc:385] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.938060 13367 raft_consensus.cc:740] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e9fd107a15401187cf73743d379bf0, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.938562 13368 tablet_bootstrap.cc:654] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.938870 13367 consensus_queue.cc:260] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:07.941112 13371 tablet_bootstrap.cc:492] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c: No bootstrap required, opened a new log
I20260709 12:13:07.941619 13371 ts_tablet_manager.cc:1403] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.012s
I20260709 12:13:07.942327 13367 ts_tablet_manager.cc:1434] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:07.944494 13371 raft_consensus.cc:359] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:07.945322 13371 raft_consensus.cc:385] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.945636 13371 raft_consensus.cc:740] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762e84c2aebd47b28e931cd13923956c, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.946465 13371 consensus_queue.cc:260] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:07.947093 13368 tablet_bootstrap.cc:492] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967: No bootstrap required, opened a new log
I20260709 12:13:07.947626 13368 ts_tablet_manager.cc:1403] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:13:07.949028 13352 heartbeater.cc:499] Master 127.3.163.126:36009 was elected leader, sending a full tablet report...
I20260709 12:13:07.949533 13371 ts_tablet_manager.cc:1434] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:13:07.951434 13371 tablet_bootstrap.cc:492] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c: Bootstrap starting.
I20260709 12:13:07.951697 13368 raft_consensus.cc:359] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:07.952314 13368 raft_consensus.cc:385] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.952543 13368 raft_consensus.cc:740] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.953200 13368 consensus_queue.cc:260] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:07.954968 13368 ts_tablet_manager.cc:1434] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:13:07.958071 13371 tablet_bootstrap.cc:654] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:07.963063 13371 tablet_bootstrap.cc:492] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c: No bootstrap required, opened a new log
I20260709 12:13:07.963510 13371 ts_tablet_manager.cc:1403] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:13:07.965582 13371 raft_consensus.cc:359] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:07.966077 13371 raft_consensus.cc:385] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:07.966291 13371 raft_consensus.cc:740] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762e84c2aebd47b28e931cd13923956c, State: Initialized, Role: FOLLOWER
I20260709 12:13:07.966851 13371 consensus_queue.cc:260] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:07.968384 13371 ts_tablet_manager.cc:1434] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:13:08.083550 13373 raft_consensus.cc:493] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.084038 13373 raft_consensus.cc:515] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:08.085963 13373 leader_election.cc:290] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:08.094990 13178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b6049be9964d9382e01baf029d1eb0" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e9fd107a15401187cf73743d379bf0" is_pre_election: true
I20260709 12:13:08.095611 13178 raft_consensus.cc:2468] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 0.
I20260709 12:13:08.096536 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b6049be9964d9382e01baf029d1eb0" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e84c2aebd47b28e931cd13923956c" is_pre_election: true
I20260709 12:13:08.096623 13219 leader_election.cc:304] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:08.097168 13327 raft_consensus.cc:2468] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 0.
I20260709 12:13:08.097451 13373 raft_consensus.cc:2804] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.097826 13373 raft_consensus.cc:493] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.098146 13373 raft_consensus.cc:3060] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.102962 13373 raft_consensus.cc:515] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:08.104329 13373 leader_election.cc:290] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 election: Requested vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:08.105309 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b6049be9964d9382e01baf029d1eb0" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e84c2aebd47b28e931cd13923956c"
I20260709 12:13:08.104914 13178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b6049be9964d9382e01baf029d1eb0" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
I20260709 12:13:08.109074 13327 raft_consensus.cc:3060] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.109117 13178 raft_consensus.cc:3060] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.116120 13178 raft_consensus.cc:2468] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 1.
I20260709 12:13:08.116122 13327 raft_consensus.cc:2468] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 1.
I20260709 12:13:08.117302 13219 leader_election.cc:304] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:08.117897 13373 raft_consensus.cc:2804] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.118650 13373 raft_consensus.cc:697] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Becoming Leader. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Running, Role: LEADER
I20260709 12:13:08.119261 13373 consensus_queue.cc:237] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:08.125275 13076 catalog_manager.cc:5697] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.221292 13373 raft_consensus.cc:493] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.221778 13373 raft_consensus.cc:515] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.224229 13373 leader_election.cc:290] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:08.224224 13178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e9fd107a15401187cf73743d379bf0" is_pre_election: true
I20260709 12:13:08.224493 13372 raft_consensus.cc:493] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.224562 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e84c2aebd47b28e931cd13923956c" is_pre_election: true
I20260709 12:13:08.225234 13372 raft_consensus.cc:515] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.225381 13327 raft_consensus.cc:2468] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 0.
I20260709 12:13:08.226027 13178 raft_consensus.cc:2468] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 0.
I20260709 12:13:08.226527 13217 leader_election.cc:304] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c, 93a8037e5b174ae3bba21aa9c8b8f967; no voters: 
I20260709 12:13:08.227558 13373 raft_consensus.cc:2804] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.227692 13372 leader_election.cc:290] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:08.228101 13373 raft_consensus.cc:493] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.228524 13373 raft_consensus.cc:3060] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.235512 13373 raft_consensus.cc:515] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.238313 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2" candidate_uuid: "a6e9fd107a15401187cf73743d379bf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" is_pre_election: true
I20260709 12:13:08.238320 13178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
I20260709 12:13:08.239099 13373 leader_election.cc:290] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 election: Requested vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:08.238406 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e84c2aebd47b28e931cd13923956c"
I20260709 12:13:08.239488 13253 raft_consensus.cc:2393] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6e9fd107a15401187cf73743d379bf0 in current term 1: Already voted for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in this term.
I20260709 12:13:08.239351 13178 raft_consensus.cc:3060] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.239642 13327 raft_consensus.cc:3060] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.241897 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2" candidate_uuid: "a6e9fd107a15401187cf73743d379bf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e84c2aebd47b28e931cd13923956c" is_pre_election: true
I20260709 12:13:08.242988 13142 leader_election.cc:304] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6e9fd107a15401187cf73743d379bf0; no voters: 762e84c2aebd47b28e931cd13923956c, 93a8037e5b174ae3bba21aa9c8b8f967
I20260709 12:13:08.246311 13178 raft_consensus.cc:2468] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 1.
I20260709 12:13:08.246814 13372 raft_consensus.cc:2749] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:08.247334 13327 raft_consensus.cc:2468] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 1.
I20260709 12:13:08.247344 13219 leader_election.cc:304] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:08.248353 13373 raft_consensus.cc:2804] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.248800 13373 raft_consensus.cc:697] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Becoming Leader. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Running, Role: LEADER
I20260709 12:13:08.249402 13373 consensus_queue.cc:237] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.258510 13076 catalog_manager.cc:5697] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.333302 13076 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51680:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:08.335038 13076 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:08.355233 13167 tablet_service.cc:1511] Processing CreateTablet for tablet 988a87b4f050458683daab26f5cc55ad (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4332d76e0e604f458c385c46c0787128]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:08.356415 13167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988a87b4f050458683daab26f5cc55ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.356487 13243 tablet_service.cc:1511] Processing CreateTablet for tablet 988a87b4f050458683daab26f5cc55ad (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4332d76e0e604f458c385c46c0787128]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:08.358209 13243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988a87b4f050458683daab26f5cc55ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.358342 13316 tablet_service.cc:1511] Processing CreateTablet for tablet 988a87b4f050458683daab26f5cc55ad (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4332d76e0e604f458c385c46c0787128]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:13:08.358953 13168 tablet_service.cc:1511] Processing CreateTablet for tablet b38410f54cca439e99ebdb008f332034 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4332d76e0e604f458c385c46c0787128]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:08.359540 13316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988a87b4f050458683daab26f5cc55ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.362076 13242 tablet_service.cc:1511] Processing CreateTablet for tablet b38410f54cca439e99ebdb008f332034 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4332d76e0e604f458c385c46c0787128]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:08.362465 13317 tablet_service.cc:1511] Processing CreateTablet for tablet b38410f54cca439e99ebdb008f332034 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=4332d76e0e604f458c385c46c0787128]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:13:08.363226 13242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38410f54cca439e99ebdb008f332034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.363586 13317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38410f54cca439e99ebdb008f332034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.366731 13168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38410f54cca439e99ebdb008f332034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:08.376335 13371 tablet_bootstrap.cc:492] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c: Bootstrap starting.
I20260709 12:13:08.382195 13371 tablet_bootstrap.cc:654] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.382529 13367 tablet_bootstrap.cc:492] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0: Bootstrap starting.
W20260709 12:13:08.388257 13124 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:08.389246 13367 tablet_bootstrap.cc:654] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.391188 13368 tablet_bootstrap.cc:492] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: Bootstrap starting.
I20260709 12:13:08.397394 13368 tablet_bootstrap.cc:654] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.402418 13371 tablet_bootstrap.cc:492] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c: No bootstrap required, opened a new log
I20260709 12:13:08.402908 13371 ts_tablet_manager.cc:1403] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 12:13:08.403580 13368 tablet_bootstrap.cc:492] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: No bootstrap required, opened a new log
I20260709 12:13:08.403972 13368 ts_tablet_manager.cc:1403] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 12:13:08.405753 13371 raft_consensus.cc:359] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.406906 13371 raft_consensus.cc:385] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.406580 13368 raft_consensus.cc:359] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.407310 13371 raft_consensus.cc:740] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762e84c2aebd47b28e931cd13923956c, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.407501 13368 raft_consensus.cc:385] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.408295 13368 raft_consensus.cc:740] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.408296 13371 consensus_queue.cc:260] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.409170 13368 consensus_queue.cc:260] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.411309 13368 ts_tablet_manager.cc:1434] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:08.412148 13371 ts_tablet_manager.cc:1434] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:08.413038 13368 tablet_bootstrap.cc:492] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967: Bootstrap starting.
I20260709 12:13:08.413267 13371 tablet_bootstrap.cc:492] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c: Bootstrap starting.
I20260709 12:13:08.413475 13367 tablet_bootstrap.cc:492] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0: No bootstrap required, opened a new log
I20260709 12:13:08.414026 13367 ts_tablet_manager.cc:1403] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.013s
I20260709 12:13:08.419932 13368 tablet_bootstrap.cc:654] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.420674 13371 tablet_bootstrap.cc:654] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.423158 13367 raft_consensus.cc:359] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.423924 13367 raft_consensus.cc:385] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.424213 13367 raft_consensus.cc:740] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e9fd107a15401187cf73743d379bf0, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.425405 13371 tablet_bootstrap.cc:492] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c: No bootstrap required, opened a new log
I20260709 12:13:08.425100 13367 consensus_queue.cc:260] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.425915 13371 ts_tablet_manager.cc:1403] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.002s
I20260709 12:13:08.426208 13368 tablet_bootstrap.cc:492] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967: No bootstrap required, opened a new log
I20260709 12:13:08.427340 13367 ts_tablet_manager.cc:1434] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 12:13:08.427531 13368 ts_tablet_manager.cc:1403] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 12:13:08.428941 13371 raft_consensus.cc:359] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.429651 13371 raft_consensus.cc:385] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.429944 13371 raft_consensus.cc:740] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762e84c2aebd47b28e931cd13923956c, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.430398 13368 raft_consensus.cc:359] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.430776 13371 consensus_queue.cc:260] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.431130 13368 raft_consensus.cc:385] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.431519 13368 raft_consensus.cc:740] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.432266 13368 consensus_queue.cc:260] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.432847 13371 ts_tablet_manager.cc:1434] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:13:08.434453 13368 ts_tablet_manager.cc:1434] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:13:08.436539 13367 tablet_bootstrap.cc:492] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0: Bootstrap starting.
I20260709 12:13:08.443259 13367 tablet_bootstrap.cc:654] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:08.447645 13367 tablet_bootstrap.cc:492] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0: No bootstrap required, opened a new log
I20260709 12:13:08.447965 13367 ts_tablet_manager.cc:1403] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:13:08.449887 13367 raft_consensus.cc:359] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.450343 13367 raft_consensus.cc:385] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:08.450537 13367 raft_consensus.cc:740] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6e9fd107a15401187cf73743d379bf0, State: Initialized, Role: FOLLOWER
I20260709 12:13:08.451045 13367 consensus_queue.cc:260] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.452443 13367 ts_tablet_manager.cc:1434] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:13:08.603224 13373 consensus_queue.cc:1048] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:08.610381 13373 consensus_queue.cc:1048] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:08.628837 13377 raft_consensus.cc:493] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.629204 13377 raft_consensus.cc:515] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.631117 13377 leader_election.cc:290] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
I20260709 12:13:08.631273 13373 raft_consensus.cc:493] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.631772 13373 raft_consensus.cc:515] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.633848 13373 leader_election.cc:290] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:08.635038 13178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e9fd107a15401187cf73743d379bf0" is_pre_election: true
I20260709 12:13:08.635567 13178 raft_consensus.cc:2468] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 0.
I20260709 12:13:08.636580 13219 leader_election.cc:304] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:08.637513 13373 raft_consensus.cc:2804] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.637923 13373 raft_consensus.cc:493] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.638295 13373 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.641548 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e84c2aebd47b28e931cd13923956c" is_pre_election: true
I20260709 12:13:08.642985 13327 raft_consensus.cc:2468] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 0.
I20260709 12:13:08.645619 13373 raft_consensus.cc:515] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.649588 13178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
I20260709 12:13:08.649699 13373 leader_election.cc:290] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 election: Requested vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:08.650143 13178 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.650513 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762e84c2aebd47b28e931cd13923956c"
I20260709 12:13:08.651054 13327 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.656733 13178 raft_consensus.cc:2468] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 1.
I20260709 12:13:08.657693 13327 raft_consensus.cc:2468] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 1.
I20260709 12:13:08.657899 13219 leader_election.cc:304] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:08.658277 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38410f54cca439e99ebdb008f332034" candidate_uuid: "762e84c2aebd47b28e931cd13923956c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" is_pre_election: true
I20260709 12:13:08.658541 13177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38410f54cca439e99ebdb008f332034" candidate_uuid: "762e84c2aebd47b28e931cd13923956c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e9fd107a15401187cf73743d379bf0" is_pre_election: true
I20260709 12:13:08.659233 13253 raft_consensus.cc:2468] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762e84c2aebd47b28e931cd13923956c in term 0.
I20260709 12:13:08.659328 13177 raft_consensus.cc:2468] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762e84c2aebd47b28e931cd13923956c in term 0.
I20260709 12:13:08.659339 13373 raft_consensus.cc:2804] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.660137 13373 raft_consensus.cc:697] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Becoming Leader. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Running, Role: LEADER
I20260709 12:13:08.660313 13291 leader_election.cc:304] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c, 93a8037e5b174ae3bba21aa9c8b8f967; no voters: 
I20260709 12:13:08.661136 13377 raft_consensus.cc:2804] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:08.661520 13377 raft_consensus.cc:493] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:08.661175 13373 consensus_queue.cc:237] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.661736 13377 raft_consensus.cc:3060] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.667728 13377 raft_consensus.cc:515] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.668331 13076 catalog_manager.cc:5697] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:08.669606 13377 leader_election.cc:290] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 1 election: Requested vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
I20260709 12:13:08.670083 13177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38410f54cca439e99ebdb008f332034" candidate_uuid: "762e84c2aebd47b28e931cd13923956c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
I20260709 12:13:08.670648 13177 raft_consensus.cc:3060] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.670766 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38410f54cca439e99ebdb008f332034" candidate_uuid: "762e84c2aebd47b28e931cd13923956c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
I20260709 12:13:08.671288 13253 raft_consensus.cc:3060] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:08.676342 13177 raft_consensus.cc:2468] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762e84c2aebd47b28e931cd13923956c in term 1.
I20260709 12:13:08.676968 13253 raft_consensus.cc:2468] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762e84c2aebd47b28e931cd13923956c in term 1.
I20260709 12:13:08.677806 13293 leader_election.cc:304] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:08.678491 13377 raft_consensus.cc:2804] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:08.679646 13377 raft_consensus.cc:697] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 1 LEADER]: Becoming Leader. State: Replica: 762e84c2aebd47b28e931cd13923956c, State: Running, Role: LEADER
I20260709 12:13:08.680558 13377 consensus_queue.cc:237] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:08.686839 13076 catalog_manager.cc:5697] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c reported cstate change: term changed from 0 to 1, leader changed from <none> to 762e84c2aebd47b28e931cd13923956c (127.3.163.67). New cstate: current_term: 1 leader_uuid: "762e84c2aebd47b28e931cd13923956c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.696046 13373 consensus_queue.cc:1048] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:08.706130 13401 consensus_queue.cc:1048] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:08.762841 13253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0b6049be9964d9382e01baf029d1eb0"
dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
mode: GRACEFUL
new_leader_uuid: "a6e9fd107a15401187cf73743d379bf0"
 from {username='slave'} at 127.0.0.1:43626
I20260709 12:13:08.763309 13253 raft_consensus.cc:606] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Received request to transfer leadership to TS a6e9fd107a15401187cf73743d379bf0
I20260709 12:13:08.767652 13253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2"
dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
mode: GRACEFUL
new_leader_uuid: "762e84c2aebd47b28e931cd13923956c"
 from {username='slave'} at 127.0.0.1:43626
I20260709 12:13:08.768078 13253 raft_consensus.cc:606] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Received request to transfer leadership to TS 762e84c2aebd47b28e931cd13923956c
I20260709 12:13:08.772603 13253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad"
dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
mode: GRACEFUL
new_leader_uuid: "a6e9fd107a15401187cf73743d379bf0"
 from {username='slave'} at 127.0.0.1:43626
I20260709 12:13:08.773049 13253 raft_consensus.cc:606] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Received request to transfer leadership to TS a6e9fd107a15401187cf73743d379bf0
I20260709 12:13:08.783783 13327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b38410f54cca439e99ebdb008f332034"
dest_uuid: "762e84c2aebd47b28e931cd13923956c"
mode: GRACEFUL
new_leader_uuid: "a6e9fd107a15401187cf73743d379bf0"
 from {username='slave'} at 127.0.0.1:57264
I20260709 12:13:08.784214 13327 raft_consensus.cc:606] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 1 LEADER]: Received request to transfer leadership to TS a6e9fd107a15401187cf73743d379bf0
I20260709 12:13:09.079947 13400 raft_consensus.cc:993] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967: : Instructing follower a6e9fd107a15401187cf73743d379bf0 to start an election
I20260709 12:13:09.080353 13401 raft_consensus.cc:1081] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Signalling peer a6e9fd107a15401187cf73743d379bf0 to start an election
I20260709 12:13:09.081600 13177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0b6049be9964d9382e01baf029d1eb0"
dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
 from {username='slave'} at 127.0.0.1:60470
I20260709 12:13:09.082000 13177 raft_consensus.cc:493] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:09.082227 13177 raft_consensus.cc:3060] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.086840 13177 raft_consensus.cc:515] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:09.088322 13177 leader_election.cc:290] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [CANDIDATE]: Term 2 election: Requested vote from peers 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
I20260709 12:13:09.089025 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b6049be9964d9382e01baf029d1eb0" candidate_uuid: "a6e9fd107a15401187cf73743d379bf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762e84c2aebd47b28e931cd13923956c"
I20260709 12:13:09.089174 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b6049be9964d9382e01baf029d1eb0" candidate_uuid: "a6e9fd107a15401187cf73743d379bf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
I20260709 12:13:09.089521 13327 raft_consensus.cc:3060] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.089692 13253 raft_consensus.cc:3055] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:09.090047 13253 raft_consensus.cc:740] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Running, Role: LEADER
I20260709 12:13:09.090677 13253 consensus_queue.cc:260] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:09.091552 13253 raft_consensus.cc:3060] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.094272 13327 raft_consensus.cc:2468] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e9fd107a15401187cf73743d379bf0 in term 2.
I20260709 12:13:09.095201 13142 leader_election.cc:304] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:09.095923 13372 raft_consensus.cc:2804] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:09.096410 13253 raft_consensus.cc:2468] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e9fd107a15401187cf73743d379bf0 in term 2.
I20260709 12:13:09.096853 13372 raft_consensus.cc:697] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Becoming Leader. State: Replica: a6e9fd107a15401187cf73743d379bf0, State: Running, Role: LEADER
I20260709 12:13:09.097697 13372 consensus_queue.cc:237] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:09.102706 13075 catalog_manager.cc:5697] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 reported cstate change: term changed from 1 to 2, leader changed from 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66) to a6e9fd107a15401187cf73743d379bf0 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "a6e9fd107a15401187cf73743d379bf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.119100 13377 consensus_queue.cc:1048] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.124357 13408 raft_consensus.cc:993] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c: : Instructing follower a6e9fd107a15401187cf73743d379bf0 to start an election
I20260709 12:13:09.125119 13377 raft_consensus.cc:1081] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 1 LEADER]: Signalling peer a6e9fd107a15401187cf73743d379bf0 to start an election
I20260709 12:13:09.126729 13178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b38410f54cca439e99ebdb008f332034"
dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
 from {username='slave'} at 127.0.0.1:60484
I20260709 12:13:09.129148 13178 raft_consensus.cc:493] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:09.129781 13178 raft_consensus.cc:3060] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.130820 13408 consensus_queue.cc:1048] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.138810 13178 raft_consensus.cc:515] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.142174 13178 leader_election.cc:290] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [CANDIDATE]: Term 2 election: Requested vote from peers 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:09.143610 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38410f54cca439e99ebdb008f332034" candidate_uuid: "a6e9fd107a15401187cf73743d379bf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762e84c2aebd47b28e931cd13923956c"
I20260709 12:13:09.143699 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38410f54cca439e99ebdb008f332034" candidate_uuid: "a6e9fd107a15401187cf73743d379bf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
I20260709 12:13:09.144178 13327 raft_consensus.cc:3055] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:09.144253 13253 raft_consensus.cc:3060] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.144580 13327 raft_consensus.cc:740] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762e84c2aebd47b28e931cd13923956c, State: Running, Role: LEADER
I20260709 12:13:09.145431 13327 consensus_queue.cc:260] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.146654 13327 raft_consensus.cc:3060] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.150889 13253 raft_consensus.cc:2468] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e9fd107a15401187cf73743d379bf0 in term 2.
I20260709 12:13:09.151908 13142 leader_election.cc:304] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:09.152520 13372 raft_consensus.cc:2804] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:09.153007 13372 raft_consensus.cc:697] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Becoming Leader. State: Replica: a6e9fd107a15401187cf73743d379bf0, State: Running, Role: LEADER
I20260709 12:13:09.153884 13372 consensus_queue.cc:237] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.152952 13327 raft_consensus.cc:2468] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e9fd107a15401187cf73743d379bf0 in term 2.
I20260709 12:13:09.159540 13075 catalog_manager.cc:5697] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 reported cstate change: term changed from 1 to 2, leader changed from 762e84c2aebd47b28e931cd13923956c (127.3.163.67) to a6e9fd107a15401187cf73743d379bf0 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "a6e9fd107a15401187cf73743d379bf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.170989 13401 consensus_queue.cc:1048] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.182199 13373 consensus_queue.cc:1048] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:09.189030 13373 raft_consensus.cc:993] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: : Instructing follower a6e9fd107a15401187cf73743d379bf0 to start an election
I20260709 12:13:09.189399 13400 raft_consensus.cc:1081] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Signalling peer a6e9fd107a15401187cf73743d379bf0 to start an election
I20260709 12:13:09.190877 13178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad"
dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
 from {username='slave'} at 127.0.0.1:60470
I20260709 12:13:09.191442 13178 raft_consensus.cc:493] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:09.191818 13178 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.196344 13178 raft_consensus.cc:515] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.197965 13178 leader_election.cc:290] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [CANDIDATE]: Term 2 election: Requested vote from peers 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:09.198698 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad" candidate_uuid: "a6e9fd107a15401187cf73743d379bf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
I20260709 12:13:09.199056 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad" candidate_uuid: "a6e9fd107a15401187cf73743d379bf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762e84c2aebd47b28e931cd13923956c"
I20260709 12:13:09.199355 13253 raft_consensus.cc:3055] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:09.199645 13327 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.199738 13253 raft_consensus.cc:740] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Running, Role: LEADER
I20260709 12:13:09.200605 13253 consensus_queue.cc:260] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.201826 13253 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.206229 13327 raft_consensus.cc:2468] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e9fd107a15401187cf73743d379bf0 in term 2.
I20260709 12:13:09.207322 13142 leader_election.cc:304] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:09.207909 13372 raft_consensus.cc:2804] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:09.207962 13253 raft_consensus.cc:2468] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6e9fd107a15401187cf73743d379bf0 in term 2.
I20260709 12:13:09.208307 13372 raft_consensus.cc:697] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Becoming Leader. State: Replica: a6e9fd107a15401187cf73743d379bf0, State: Running, Role: LEADER
I20260709 12:13:09.209162 13372 consensus_queue.cc:237] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.214166 13075 catalog_manager.cc:5697] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 reported cstate change: term changed from 1 to 2, leader changed from 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66) to a6e9fd107a15401187cf73743d379bf0 (127.3.163.65). New cstate: current_term: 2 leader_uuid: "a6e9fd107a15401187cf73743d379bf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.237702 13373 raft_consensus.cc:993] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967: : Instructing follower 762e84c2aebd47b28e931cd13923956c to start an election
I20260709 12:13:09.238068 13400 raft_consensus.cc:1081] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Signalling peer 762e84c2aebd47b28e931cd13923956c to start an election
I20260709 12:13:09.239262 13327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2"
dest_uuid: "762e84c2aebd47b28e931cd13923956c"
 from {username='slave'} at 127.0.0.1:57238
I20260709 12:13:09.239676 13327 raft_consensus.cc:493] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:09.239934 13327 raft_consensus.cc:3060] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.244185 13327 raft_consensus.cc:515] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.245713 13327 leader_election.cc:290] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 2 election: Requested vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
I20260709 12:13:09.246318 13178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2" candidate_uuid: "762e84c2aebd47b28e931cd13923956c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
I20260709 12:13:09.246630 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22a72ce18b244aca09075497c6ecaa2" candidate_uuid: "762e84c2aebd47b28e931cd13923956c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
I20260709 12:13:09.246892 13178 raft_consensus.cc:3060] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.247157 13253 raft_consensus.cc:3055] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:09.247424 13253 raft_consensus.cc:740] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Running, Role: LEADER
I20260709 12:13:09.248049 13253 consensus_queue.cc:260] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.248952 13253 raft_consensus.cc:3060] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:09.251260 13178 raft_consensus.cc:2468] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762e84c2aebd47b28e931cd13923956c in term 2.
I20260709 12:13:09.252202 13293 leader_election.cc:304] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c, a6e9fd107a15401187cf73743d379bf0; no voters: 
I20260709 12:13:09.252846 13408 raft_consensus.cc:2804] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:09.253314 13408 raft_consensus.cc:697] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 2 LEADER]: Becoming Leader. State: Replica: 762e84c2aebd47b28e931cd13923956c, State: Running, Role: LEADER
I20260709 12:13:09.253643 13253 raft_consensus.cc:2468] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762e84c2aebd47b28e931cd13923956c in term 2.
I20260709 12:13:09.254098 13408 consensus_queue.cc:237] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.259672 13075 catalog_manager.cc:5697] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c reported cstate change: term changed from 1 to 2, leader changed from 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66) to 762e84c2aebd47b28e931cd13923956c (127.3.163.67). New cstate: current_term: 2 leader_uuid: "762e84c2aebd47b28e931cd13923956c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.464967  3725 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:13:09.466408  3725 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:13:09.466774  3725 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:13:09.476866 13178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad"
dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
mode: GRACEFUL
new_leader_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
 from {username='slave'} at 127.0.0.1:60486
I20260709 12:13:09.477324 13178 raft_consensus.cc:606] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Received request to transfer leadership to TS 93a8037e5b174ae3bba21aa9c8b8f967
I20260709 12:13:09.478327  3725 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:13:09.511504 13253 raft_consensus.cc:1275] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Refusing update from remote peer a6e9fd107a15401187cf73743d379bf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.512581 13372 consensus_queue.cc:1048] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.520321 13327 raft_consensus.cc:1275] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Refusing update from remote peer a6e9fd107a15401187cf73743d379bf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.521855 13372 consensus_queue.cc:1048] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.564524 13253 raft_consensus.cc:1275] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Refusing update from remote peer a6e9fd107a15401187cf73743d379bf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.565606 13372 consensus_queue.cc:1048] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.572263 13327 raft_consensus.cc:1275] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Refusing update from remote peer a6e9fd107a15401187cf73743d379bf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.573717 13372 consensus_queue.cc:1048] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.642124 13253 raft_consensus.cc:1275] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Refusing update from remote peer a6e9fd107a15401187cf73743d379bf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.643190 13372 consensus_queue.cc:1048] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.647486 13422 raft_consensus.cc:993] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0: : Instructing follower 93a8037e5b174ae3bba21aa9c8b8f967 to start an election
I20260709 12:13:09.647984 13414 raft_consensus.cc:1081] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Signalling peer 93a8037e5b174ae3bba21aa9c8b8f967 to start an election
I20260709 12:13:09.650287 13252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad"
dest_uuid: "93a8037e5b174ae3bba21aa9c8b8f967"
 from {username='slave'} at 127.0.0.1:43606
I20260709 12:13:09.650833 13252 raft_consensus.cc:493] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:09.651178 13252 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:09.652626 13327 raft_consensus.cc:1275] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Refusing update from remote peer a6e9fd107a15401187cf73743d379bf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.653856 13372 consensus_queue.cc:1048] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.657773 13252 raft_consensus.cc:515] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.660365 13178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6e9fd107a15401187cf73743d379bf0"
I20260709 12:13:09.660459 13252 leader_election.cc:290] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 3 election: Requested vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 762e84c2aebd47b28e931cd13923956c (127.3.163.67:46445)
I20260709 12:13:09.660657 13327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988a87b4f050458683daab26f5cc55ad" candidate_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "762e84c2aebd47b28e931cd13923956c"
I20260709 12:13:09.660943 13178 raft_consensus.cc:3055] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:09.661268 13327 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:09.661302 13178 raft_consensus.cc:740] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a6e9fd107a15401187cf73743d379bf0, State: Running, Role: LEADER
I20260709 12:13:09.662129 13178 consensus_queue.cc:260] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.662890 13178 raft_consensus.cc:3060] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:09.666780 13327 raft_consensus.cc:2468] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 3.
I20260709 12:13:09.667900 13217 leader_election.cc:304] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c, 93a8037e5b174ae3bba21aa9c8b8f967; no voters: 
I20260709 12:13:09.668331 13178 raft_consensus.cc:2468] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93a8037e5b174ae3bba21aa9c8b8f967 in term 3.
I20260709 12:13:09.668701 13400 raft_consensus.cc:2804] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:09.669860 13400 raft_consensus.cc:697] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 3 LEADER]: Becoming Leader. State: Replica: 93a8037e5b174ae3bba21aa9c8b8f967, State: Running, Role: LEADER
I20260709 12:13:09.670629 13400 consensus_queue.cc:237] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:09.676043 13075 catalog_manager.cc:5697] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 reported cstate change: term changed from 2 to 3, leader changed from a6e9fd107a15401187cf73743d379bf0 (127.3.163.65) to 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66). New cstate: current_term: 3 leader_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.898169 13178 raft_consensus.cc:1275] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Refusing update from remote peer 762e84c2aebd47b28e931cd13923956c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.916010 13252 raft_consensus.cc:1275] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Refusing update from remote peer 762e84c2aebd47b28e931cd13923956c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:09.922021 13408 consensus_queue.cc:1048] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:09.923452 13408 consensus_queue.cc:1048] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [LEADER]: Connected to new peer: Peer: permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:09.950460  3725 tablet_server.cc:179] TabletServer@127.3.163.65:0 shutting down...
I20260709 12:13:09.973841  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:09.974398  3725 tablet_replica.cc:333] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0: stopping tablet replica
I20260709 12:13:09.974915  3725 raft_consensus.cc:2243] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.975660  3725 raft_consensus.cc:2272] T b38410f54cca439e99ebdb008f332034 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.978632  3725 tablet_replica.cc:333] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0: stopping tablet replica
I20260709 12:13:09.979372  3725 raft_consensus.cc:2243] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.980156  3725 raft_consensus.cc:2272] T d0b6049be9964d9382e01baf029d1eb0 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.982314  3725 tablet_replica.cc:333] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0: stopping tablet replica
I20260709 12:13:09.982791  3725 raft_consensus.cc:2243] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.983174  3725 raft_consensus.cc:2272] T 988a87b4f050458683daab26f5cc55ad P a6e9fd107a15401187cf73743d379bf0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.985112  3725 tablet_replica.cc:333] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0: stopping tablet replica
I20260709 12:13:09.985548  3725 raft_consensus.cc:2243] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.985911  3725 raft_consensus.cc:2272] T a22a72ce18b244aca09075497c6ecaa2 P a6e9fd107a15401187cf73743d379bf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.998800  3725 tablet_server.cc:196] TabletServer@127.3.163.65:0 shutdown complete.
I20260709 12:13:10.009400  3725 tablet_server.cc:179] TabletServer@127.3.163.66:0 shutting down...
I20260709 12:13:10.030692  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:10.031313  3725 tablet_replica.cc:333] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967: stopping tablet replica
I20260709 12:13:10.031838  3725 raft_consensus.cc:2243] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.032215  3725 raft_consensus.cc:2272] T b38410f54cca439e99ebdb008f332034 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.034216  3725 tablet_replica.cc:333] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: stopping tablet replica
I20260709 12:13:10.034670  3725 raft_consensus.cc:2243] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:10.035194  3725 pending_rounds.cc:70] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: Trying to abort 1 pending ops.
I20260709 12:13:10.035337  3725 pending_rounds.cc:77] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305622280899321856 op_type: NO_OP noop_request { }
I20260709 12:13:10.035578  3725 raft_consensus.cc:2889] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:13:10.035789  3725 raft_consensus.cc:2272] T 988a87b4f050458683daab26f5cc55ad P 93a8037e5b174ae3bba21aa9c8b8f967 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.037869  3725 tablet_replica.cc:333] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967: stopping tablet replica
I20260709 12:13:10.038292  3725 raft_consensus.cc:2243] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.038640  3725 raft_consensus.cc:2272] T a22a72ce18b244aca09075497c6ecaa2 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.040548  3725 tablet_replica.cc:333] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967: stopping tablet replica
I20260709 12:13:10.041026  3725 raft_consensus.cc:2243] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.041373  3725 raft_consensus.cc:2272] T d0b6049be9964d9382e01baf029d1eb0 P 93a8037e5b174ae3bba21aa9c8b8f967 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:10.352052 13291 consensus_peers.cc:597] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c -> Peer 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975): Couldn't send request to peer 93a8037e5b174ae3bba21aa9c8b8f967. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:34975: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:10.405889 13293 consensus_peers.cc:597] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c -> Peer a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901): Couldn't send request to peer a6e9fd107a15401187cf73743d379bf0. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:34901: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:10.862252 13274 debug-util.cc:398] Leaking SignalData structure 0x7b0800364400 after lost signal to thread 3728
W20260709 12:13:10.863225 13274 debug-util.cc:398] Leaking SignalData structure 0x7b08003006a0 after lost signal to thread 13110
W20260709 12:13:10.865721 13274 debug-util.cc:398] Leaking SignalData structure 0x7b080008d240 after lost signal to thread 13351
W20260709 12:13:11.051061  3725 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13274)
I20260709 12:13:11.077098 13431 raft_consensus.cc:493] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a6e9fd107a15401187cf73743d379bf0)
I20260709 12:13:11.077715 13431 raft_consensus.cc:515] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:11.079818 13431 leader_election.cc:290] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
W20260709 12:13:11.083609 13293 leader_election.cc:336] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901): Network error: Client connection negotiation failed: client connection to 127.3.163.65:34901: connect: Connection refused (error 111)
W20260709 12:13:11.084661 13291 leader_election.cc:336] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975): Network error: Client connection negotiation failed: client connection to 127.3.163.66:34975: connect: Connection refused (error 111)
I20260709 12:13:11.085038 13291 leader_election.cc:304] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c; no voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0
I20260709 12:13:11.085604 13431 raft_consensus.cc:2749] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:11.480134 13431 raft_consensus.cc:493] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a6e9fd107a15401187cf73743d379bf0)
I20260709 12:13:11.480688 13431 raft_consensus.cc:515] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } }
I20260709 12:13:11.482810 13431 leader_election.cc:290] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
W20260709 12:13:11.486250 13293 leader_election.cc:336] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901): Network error: Client connection negotiation failed: client connection to 127.3.163.65:34901: connect: Connection refused (error 111)
W20260709 12:13:11.486827 13291 leader_election.cc:336] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975): Network error: Client connection negotiation failed: client connection to 127.3.163.66:34975: connect: Connection refused (error 111)
I20260709 12:13:11.487164 13291 leader_election.cc:304] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c; no voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0
I20260709 12:13:11.487797 13431 raft_consensus.cc:2749] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:11.572502 13431 raft_consensus.cc:493] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.573024 13431 raft_consensus.cc:515] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:11.575070 13431 leader_election.cc:290] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
W20260709 12:13:11.578512 13293 leader_election.cc:336] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901): Network error: Client connection negotiation failed: client connection to 127.3.163.65:34901: connect: Connection refused (error 111)
W20260709 12:13:11.579130 13291 leader_election.cc:336] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975): Network error: Client connection negotiation failed: client connection to 127.3.163.66:34975: connect: Connection refused (error 111)
I20260709 12:13:11.579569 13291 leader_election.cc:304] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c; no voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0
I20260709 12:13:11.580294 13431 raft_consensus.cc:2749] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:11.983084 13293 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.163.65:34901: connect: Connection refused (error 111) [suppressed 17 similar messages]
W20260709 12:13:12.051468  3725 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 13274)
W20260709 12:13:12.928881 13291 consensus_peers.cc:597] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c -> Peer 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975): Couldn't send request to peer 93a8037e5b174ae3bba21aa9c8b8f967. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:34975: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:13.005470 13293 consensus_peers.cc:597] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c -> Peer a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901): Couldn't send request to peer a6e9fd107a15401187cf73743d379bf0. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:34901: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:13.052012  3725 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 13274)
I20260709 12:13:13.164641 13431 raft_consensus.cc:493] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a6e9fd107a15401187cf73743d379bf0)
I20260709 12:13:13.165571 13431 raft_consensus.cc:515] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:13.167824 13431 leader_election.cc:290] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
W20260709 12:13:13.172139 13293 leader_election.cc:336] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901): Network error: Client connection negotiation failed: client connection to 127.3.163.65:34901: connect: Connection refused (error 111)
W20260709 12:13:13.172720 13291 leader_election.cc:336] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975): Network error: Client connection negotiation failed: client connection to 127.3.163.66:34975: connect: Connection refused (error 111)
I20260709 12:13:13.173197 13291 leader_election.cc:304] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c; no voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0
I20260709 12:13:13.173965 13431 raft_consensus.cc:2749] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:13.311550  3725 tablet_server.cc:196] TabletServer@127.3.163.66:0 shutdown complete.
I20260709 12:13:13.332628 13431 raft_consensus.cc:493] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.333456 13431 raft_consensus.cc:515] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6e9fd107a15401187cf73743d379bf0" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 34901 } } peers { permanent_uuid: "93a8037e5b174ae3bba21aa9c8b8f967" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 34975 } } peers { permanent_uuid: "762e84c2aebd47b28e931cd13923956c" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 46445 } }
I20260709 12:13:13.335543 13431 leader_election.cc:290] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901), 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975)
I20260709 12:13:13.338065  3725 tablet_server.cc:179] TabletServer@127.3.163.67:0 shutting down...
W20260709 12:13:13.340904 13291 leader_election.cc:336] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 93a8037e5b174ae3bba21aa9c8b8f967 (127.3.163.66:34975): Network error: Client connection negotiation failed: client connection to 127.3.163.66:34975: connect: Connection refused (error 111)
W20260709 12:13:13.341964 13293 leader_election.cc:336] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a6e9fd107a15401187cf73743d379bf0 (127.3.163.65:34901): Network error: Client connection negotiation failed: client connection to 127.3.163.65:34901: connect: Connection refused (error 111)
I20260709 12:13:13.342377 13293 leader_election.cc:304] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762e84c2aebd47b28e931cd13923956c; no voters: 93a8037e5b174ae3bba21aa9c8b8f967, a6e9fd107a15401187cf73743d379bf0
I20260709 12:13:13.343151 13431 raft_consensus.cc:2749] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:13.359622  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:13.360431  3725 tablet_replica.cc:333] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c: stopping tablet replica
I20260709 12:13:13.361166  3725 raft_consensus.cc:2243] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.361727  3725 raft_consensus.cc:2272] T b38410f54cca439e99ebdb008f332034 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.364743  3725 tablet_replica.cc:333] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c: stopping tablet replica
I20260709 12:13:13.365274  3725 raft_consensus.cc:2243] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.365797  3725 raft_consensus.cc:2272] T d0b6049be9964d9382e01baf029d1eb0 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.368116  3725 tablet_replica.cc:333] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c: stopping tablet replica
I20260709 12:13:13.368598  3725 raft_consensus.cc:2243] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.369114  3725 raft_consensus.cc:2272] T 988a87b4f050458683daab26f5cc55ad P 762e84c2aebd47b28e931cd13923956c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.371376  3725 tablet_replica.cc:333] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c: stopping tablet replica
I20260709 12:13:13.371809  3725 raft_consensus.cc:2243] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.372691  3725 raft_consensus.cc:2272] T a22a72ce18b244aca09075497c6ecaa2 P 762e84c2aebd47b28e931cd13923956c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.397758  3725 tablet_server.cc:196] TabletServer@127.3.163.67:0 shutdown complete.
I20260709 12:13:13.416733  3725 master.cc:562] Master@127.3.163.126:36009 shutting down...
I20260709 12:13:13.444352  3725 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:13.445084  3725 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.445405  3725 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f3e457cd9cf47cc882c281e292bc212: stopping tablet replica
I20260709 12:13:13.463598  3725 master.cc:584] Master@127.3.163.126:36009 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (6228 ms)
[----------] 6 tests from LeaderRebalancerTest (298355 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:13:13.502910  3725 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.163.126:36891
I20260709 12:13:13.503909  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:13.508870 13437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.510409 13438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.511174 13440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.512208  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:13.513007  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:13.513177  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:13.513310  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599193513294 us; error 0 us; skew 500 ppm
I20260709 12:13:13.513787  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:13.515810  3725 webserver.cc:533] Webserver started at http://127.3.163.126:38541/ using document root <none> and password file <none>
I20260709 12:13:13.516224  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:13.516383  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:13.516623  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:13.517771  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/master-0-root/instance:
uuid: "099aff5687304168bff38aa776f4581e"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-s43n"
I20260709 12:13:13.521710  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:13.524644 13445 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.525292  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:13.525549  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/master-0-root
uuid: "099aff5687304168bff38aa776f4581e"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-s43n"
I20260709 12:13:13.525789  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:13.535112  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:13.536176  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:13.571391  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.126:36891
I20260709 12:13:13.571482 13496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.126:36891 every 8 connection(s)
I20260709 12:13:13.575191 13497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:13.586712 13497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e: Bootstrap starting.
I20260709 12:13:13.591320 13497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:13.595144 13497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e: No bootstrap required, opened a new log
I20260709 12:13:13.597278 13497 raft_consensus.cc:359] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099aff5687304168bff38aa776f4581e" member_type: VOTER }
I20260709 12:13:13.597673 13497 raft_consensus.cc:385] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:13.597854 13497 raft_consensus.cc:740] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099aff5687304168bff38aa776f4581e, State: Initialized, Role: FOLLOWER
I20260709 12:13:13.598331 13497 consensus_queue.cc:260] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099aff5687304168bff38aa776f4581e" member_type: VOTER }
I20260709 12:13:13.598732 13497 raft_consensus.cc:399] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:13.598915 13497 raft_consensus.cc:493] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:13.599107 13497 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:13.603235 13497 raft_consensus.cc:515] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099aff5687304168bff38aa776f4581e" member_type: VOTER }
I20260709 12:13:13.603660 13497 leader_election.cc:304] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 099aff5687304168bff38aa776f4581e; no voters: 
I20260709 12:13:13.604591 13497 leader_election.cc:290] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:13.604960 13500 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:13.606271 13500 raft_consensus.cc:697] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 1 LEADER]: Becoming Leader. State: Replica: 099aff5687304168bff38aa776f4581e, State: Running, Role: LEADER
I20260709 12:13:13.606840 13500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099aff5687304168bff38aa776f4581e" member_type: VOTER }
I20260709 12:13:13.607326 13497 sys_catalog.cc:565] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:13.612708 13501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "099aff5687304168bff38aa776f4581e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099aff5687304168bff38aa776f4581e" member_type: VOTER } }
I20260709 12:13:13.612860 13502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 099aff5687304168bff38aa776f4581e. Latest consensus state: current_term: 1 leader_uuid: "099aff5687304168bff38aa776f4581e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099aff5687304168bff38aa776f4581e" member_type: VOTER } }
I20260709 12:13:13.613358 13501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:13.613428 13502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:13.615018 13509 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:13.619808 13509 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:13.621270  3725 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:13.627795 13509 catalog_manager.cc:1383] Generated new cluster ID: c459f291f316492082f175221a20c53f
I20260709 12:13:13.628014 13509 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:13.640311 13509 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:13.641525 13509 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:13.652644 13509 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e: Generated new TSK 0
I20260709 12:13:13.653124 13509 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:13.686992  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:13.692348 13518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.693361 13519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.694914  3725 server_base.cc:1061] running on GCE node
W20260709 12:13:13.695564 13521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.696367  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:13.696555  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:13.696676  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599193696665 us; error 0 us; skew 500 ppm
I20260709 12:13:13.697160  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:13.699173  3725 webserver.cc:533] Webserver started at http://127.3.163.65:46547/ using document root <none> and password file <none>
I20260709 12:13:13.699579  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:13.699724  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:13.699918  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:13.700958  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-0-root/instance:
uuid: "9d8581c650864064b205d7288bf6b93f"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-s43n"
I20260709 12:13:13.704959  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:13.707952 13526 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.708628  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:13.708894  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "9d8581c650864064b205d7288bf6b93f"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-s43n"
I20260709 12:13:13.709156  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:13.720973  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:13.722010  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:13.723294  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:13.725407  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:13.725592  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.725796  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:13.725958  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.763231  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:38353
I20260709 12:13:13.763332 13588 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:38353 every 8 connection(s)
I20260709 12:13:13.768013  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:13.775506 13593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.776500 13594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.779138  3725 server_base.cc:1061] running on GCE node
W20260709 12:13:13.779446 13596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.780726  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:13.781008  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:13.781208  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599193781188 us; error 0 us; skew 500 ppm
I20260709 12:13:13.781819  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:13.783834 13589 heartbeater.cc:344] Connected to a master server at 127.3.163.126:36891
I20260709 12:13:13.784160 13589 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:13.784544  3725 webserver.cc:533] Webserver started at http://127.3.163.66:44657/ using document root <none> and password file <none>
I20260709 12:13:13.784938 13589 heartbeater.cc:507] Master 127.3.163.126:36891 requested a full tablet report, sending...
I20260709 12:13:13.785072  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:13.785388  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:13.785638  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:13.787079  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-1-root/instance:
uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-s43n"
I20260709 12:13:13.787243 13462 ts_manager.cc:194] Registered new tserver with Master: 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353)
I20260709 12:13:13.789736 13462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33982
I20260709 12:13:13.792516  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:13:13.795785 13601 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.796453  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:13.796692  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-1-root
uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-s43n"
I20260709 12:13:13.796952  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:13.817018  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:13.818060  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:13.819319  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:13.821358  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:13.821538  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.821754  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:13.821894  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.859382  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.66:43977
I20260709 12:13:13.859489 13663 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.66:43977 every 8 connection(s)
I20260709 12:13:13.863955  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:13.870759 13667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:13.871410 13668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.874281  3725 server_base.cc:1061] running on GCE node
W20260709 12:13:13.874356 13670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:13.875264 13664 heartbeater.cc:344] Connected to a master server at 127.3.163.126:36891
I20260709 12:13:13.875679 13664 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:13.875651  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:13.876142  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:13.876356  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599193876338 us; error 0 us; skew 500 ppm
I20260709 12:13:13.876727 13664 heartbeater.cc:507] Master 127.3.163.126:36891 requested a full tablet report, sending...
I20260709 12:13:13.877202  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:13.878867 13462 ts_manager.cc:194] Registered new tserver with Master: bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:13.879580  3725 webserver.cc:533] Webserver started at http://127.3.163.67:35017/ using document root <none> and password file <none>
I20260709 12:13:13.880072  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:13.880234  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:13.880281 13462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33998
I20260709 12:13:13.880467  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:13.881912  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-2-root/instance:
uuid: "69f8cd7011784b0e977a7509c867ff9d"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-s43n"
I20260709 12:13:13.886014  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:13.889156 13675 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.889833  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:13.890096  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-2-root
uuid: "69f8cd7011784b0e977a7509c867ff9d"
format_stamp: "Formatted at 2026-07-09 12:13:13 on dist-test-slave-s43n"
I20260709 12:13:13.890353  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598894987430-3725-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:13.918076  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:13.919081  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:13.920323  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:13.922381  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:13.922559  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.922777  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:13.922916  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:13.959465  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.67:34701
I20260709 12:13:13.959563 13737 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.67:34701 every 8 connection(s)
I20260709 12:13:13.972084 13738 heartbeater.cc:344] Connected to a master server at 127.3.163.126:36891
I20260709 12:13:13.972488 13738 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:13.973174 13738 heartbeater.cc:507] Master 127.3.163.126:36891 requested a full tablet report, sending...
I20260709 12:13:13.974892 13462 ts_manager.cc:194] Registered new tserver with Master: 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:13.975770  3725 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013149348s
I20260709 12:13:13.976186 13462 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34010
I20260709 12:13:13.998270 13462 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34024:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:14.000840 13462 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:14.077857 13629 tablet_service.cc:1511] Processing CreateTablet for tablet 1f38719a66ea4410b5eded50d77c8b45 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:14.078222 13628 tablet_service.cc:1511] Processing CreateTablet for tablet e56e14b0278a4128b5ae66ebc3d02a2b (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:14.079344 13629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f38719a66ea4410b5eded50d77c8b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.080706 13627 tablet_service.cc:1511] Processing CreateTablet for tablet 9380dee5565048cdbc48fea673b1a68b (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:14.080927 13625 tablet_service.cc:1511] Processing CreateTablet for tablet 4350686a78994afcb21ad7f2746051c4 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:14.082103 13627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9380dee5565048cdbc48fea673b1a68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.083218 13624 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3baa3445c0463a9f4895f74fcf0133 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:14.084455 13624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3baa3445c0463a9f4895f74fcf0133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.085260 13703 tablet_service.cc:1511] Processing CreateTablet for tablet 1f38719a66ea4410b5eded50d77c8b45 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:14.085966 13623 tablet_service.cc:1511] Processing CreateTablet for tablet e12a86912b804d989dab9941271b4950 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:14.086750 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f38719a66ea4410b5eded50d77c8b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.087232 13623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12a86912b804d989dab9941271b4950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.089176 13625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4350686a78994afcb21ad7f2746051c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.090250 13626 tablet_service.cc:1511] Processing CreateTablet for tablet d38ac31eefa0495aa61958063bc74f92 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:14.091481 13626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d38ac31eefa0495aa61958063bc74f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.091357 13702 tablet_service.cc:1511] Processing CreateTablet for tablet e56e14b0278a4128b5ae66ebc3d02a2b (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:14.092716 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56e14b0278a4128b5ae66ebc3d02a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.093494 13628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56e14b0278a4128b5ae66ebc3d02a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.096100 13701 tablet_service.cc:1511] Processing CreateTablet for tablet 9380dee5565048cdbc48fea673b1a68b (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:14.097409 13701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9380dee5565048cdbc48fea673b1a68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.099922 13700 tablet_service.cc:1511] Processing CreateTablet for tablet d38ac31eefa0495aa61958063bc74f92 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:14.101159 13700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d38ac31eefa0495aa61958063bc74f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.104097 13699 tablet_service.cc:1511] Processing CreateTablet for tablet 4350686a78994afcb21ad7f2746051c4 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:14.105337 13699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4350686a78994afcb21ad7f2746051c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.108314 13698 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3baa3445c0463a9f4895f74fcf0133 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:14.109634 13698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3baa3445c0463a9f4895f74fcf0133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.112119 13697 tablet_service.cc:1511] Processing CreateTablet for tablet e12a86912b804d989dab9941271b4950 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:14.128839 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12a86912b804d989dab9941271b4950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.132668 13696 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae18c2b785940d89525f0331475c389 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:14.133893 13696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae18c2b785940d89525f0331475c389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.138592 13554 tablet_service.cc:1511] Processing CreateTablet for tablet 1f38719a66ea4410b5eded50d77c8b45 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:14.139987 13554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f38719a66ea4410b5eded50d77c8b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.143406 13553 tablet_service.cc:1511] Processing CreateTablet for tablet e56e14b0278a4128b5ae66ebc3d02a2b (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:14.144770 13553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e56e14b0278a4128b5ae66ebc3d02a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.149755 13552 tablet_service.cc:1511] Processing CreateTablet for tablet 9380dee5565048cdbc48fea673b1a68b (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:14.150249 13622 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2d9c253e3a4e6b965c0f7a6d63e107 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:14.151160 13552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9380dee5565048cdbc48fea673b1a68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.151618 13622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2d9c253e3a4e6b965c0f7a6d63e107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.156972 13627 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae18c2b785940d89525f0331475c389 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:14.158108 13753 tablet_bootstrap.cc:492] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.179131 13695 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2d9c253e3a4e6b965c0f7a6d63e107 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:14.180454 13695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2d9c253e3a4e6b965c0f7a6d63e107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.184594 13551 tablet_service.cc:1511] Processing CreateTablet for tablet d38ac31eefa0495aa61958063bc74f92 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:14.185904 13551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d38ac31eefa0495aa61958063bc74f92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.186371 13550 tablet_service.cc:1511] Processing CreateTablet for tablet 4350686a78994afcb21ad7f2746051c4 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:14.187979 13550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4350686a78994afcb21ad7f2746051c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.194267 13549 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3baa3445c0463a9f4895f74fcf0133 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:14.196679 13549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3baa3445c0463a9f4895f74fcf0133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.201680 13548 tablet_service.cc:1511] Processing CreateTablet for tablet e12a86912b804d989dab9941271b4950 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:14.202946 13548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12a86912b804d989dab9941271b4950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.209818 13547 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae18c2b785940d89525f0331475c389 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:14.211040 13547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae18c2b785940d89525f0331475c389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.158274 13627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae18c2b785940d89525f0331475c389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.225081 13546 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2d9c253e3a4e6b965c0f7a6d63e107 (DEFAULT_TABLE table=test-workload [id=fbb7e9fd8fd4448288ed4fe41282cd2e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:14.226315 13546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2d9c253e3a4e6b965c0f7a6d63e107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:14.225548 13753 tablet_bootstrap.cc:654] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.275305 13754 tablet_bootstrap.cc:492] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:14.288406 13756 tablet_bootstrap.cc:492] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:14.297806 13754 tablet_bootstrap.cc:654] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.299146 13753 tablet_bootstrap.cc:492] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.299654 13753 ts_tablet_manager.cc:1403] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.142s	user 0.036s	sys 0.026s
I20260709 12:13:14.301870 13756 tablet_bootstrap.cc:654] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.302837 13753 raft_consensus.cc:359] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.303632 13753 raft_consensus.cc:385] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.304657 13753 raft_consensus.cc:740] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.305855 13754 tablet_bootstrap.cc:492] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.305629 13753 consensus_queue.cc:260] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.306348 13754 ts_tablet_manager.cc:1403] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.006s
I20260709 12:13:14.307499 13664 heartbeater.cc:499] Master 127.3.163.126:36891 was elected leader, sending a full tablet report...
I20260709 12:13:14.308125 13753 ts_tablet_manager.cc:1434] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:14.309284 13754 raft_consensus.cc:359] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.309765 13753 tablet_bootstrap.cc:492] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.310014 13754 raft_consensus.cc:385] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.310523 13754 raft_consensus.cc:740] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.311448 13754 consensus_queue.cc:260] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.312556 13756 tablet_bootstrap.cc:492] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.313117 13756 ts_tablet_manager.cc:1403] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:13:14.315033 13754 ts_tablet_manager.cc:1434] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:13:14.315346 13756 raft_consensus.cc:359] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.315936 13756 raft_consensus.cc:385] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.316144 13756 raft_consensus.cc:740] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.316167 13754 tablet_bootstrap.cc:492] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:14.316783 13756 consensus_queue.cc:260] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.316988 13738 heartbeater.cc:499] Master 127.3.163.126:36891 was elected leader, sending a full tablet report...
I20260709 12:13:14.318884 13589 heartbeater.cc:499] Master 127.3.163.126:36891 was elected leader, sending a full tablet report...
I20260709 12:13:14.319406 13756 ts_tablet_manager.cc:1434] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:13:14.320308 13756 tablet_bootstrap.cc:492] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:14.323046 13754 tablet_bootstrap.cc:654] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.325951 13756 tablet_bootstrap.cc:654] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.332356 13753 tablet_bootstrap.cc:654] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.337658 13754 tablet_bootstrap.cc:492] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.338187 13754 ts_tablet_manager.cc:1403] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 12:13:14.343207 13756 tablet_bootstrap.cc:492] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.343776 13756 ts_tablet_manager.cc:1403] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.014s
I20260709 12:13:14.344133 13754 raft_consensus.cc:359] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.344923 13754 raft_consensus.cc:385] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.345238 13754 raft_consensus.cc:740] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.346019 13754 consensus_queue.cc:260] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.346940 13756 raft_consensus.cc:359] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.347409 13753 tablet_bootstrap.cc:492] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.347688 13756 raft_consensus.cc:385] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.348013 13753 ts_tablet_manager.cc:1403] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.000s
I20260709 12:13:14.348104 13754 ts_tablet_manager.cc:1434] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:14.348058 13756 raft_consensus.cc:740] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.349113 13756 consensus_queue.cc:260] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.351194 13756 ts_tablet_manager.cc:1434] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:14.351086 13753 raft_consensus.cc:359] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.351929 13754 tablet_bootstrap.cc:492] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:14.352198 13756 tablet_bootstrap.cc:492] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:14.351938 13753 raft_consensus.cc:385] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.352770 13753 raft_consensus.cc:740] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.353658 13753 consensus_queue.cc:260] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.359134 13756 tablet_bootstrap.cc:654] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.359134 13754 tablet_bootstrap.cc:654] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.360172 13753 ts_tablet_manager.cc:1434] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:13:14.361215 13753 tablet_bootstrap.cc:492] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.367838 13753 tablet_bootstrap.cc:654] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.368948 13754 tablet_bootstrap.cc:492] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.369493 13754 ts_tablet_manager.cc:1403] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 12:13:14.372646 13754 raft_consensus.cc:359] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.374471 13754 raft_consensus.cc:385] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.374825 13754 raft_consensus.cc:740] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.375768 13754 consensus_queue.cc:260] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.376166 13756 tablet_bootstrap.cc:492] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.376801 13756 ts_tablet_manager.cc:1403] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 12:13:14.378811 13753 tablet_bootstrap.cc:492] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.379297 13753 ts_tablet_manager.cc:1403] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 12:13:14.380087 13756 raft_consensus.cc:359] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.380676 13754 ts_tablet_manager.cc:1434] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:13:14.380884 13756 raft_consensus.cc:385] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.381276 13756 raft_consensus.cc:740] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.381701 13754 tablet_bootstrap.cc:492] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:14.382213 13756 consensus_queue.cc:260] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.382300 13753 raft_consensus.cc:359] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.383214 13753 raft_consensus.cc:385] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.383566 13753 raft_consensus.cc:740] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.384459 13756 ts_tablet_manager.cc:1434] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:14.384507 13753 consensus_queue.cc:260] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.385684 13756 tablet_bootstrap.cc:492] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:14.387238 13753 ts_tablet_manager.cc:1434] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:14.388284 13753 tablet_bootstrap.cc:492] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.391860 13761 raft_consensus.cc:493] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.394279 13759 raft_consensus.cc:493] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.397768 13756 tablet_bootstrap.cc:654] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.397840 13761 raft_consensus.cc:515] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.397903 13759 raft_consensus.cc:515] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.399495 13760 raft_consensus.cc:493] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.399950 13760 raft_consensus.cc:515] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.400885 13759 leader_election.cc:290] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.402388 13760 leader_election.cc:290] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:14.407063 13761 leader_election.cc:290] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.410198 13753 tablet_bootstrap.cc:654] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.415823 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae18c2b785940d89525f0331475c389" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:14.416610 13564 raft_consensus.cc:2468] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 0.
I20260709 12:13:14.418180 13678 leader_election.cc:304] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:14.419085 13760 raft_consensus.cc:2804] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.419472 13760 raft_consensus.cc:493] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.419835 13760 raft_consensus.cc:3060] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.426760 13754 tablet_bootstrap.cc:654] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.427364 13760 raft_consensus.cc:515] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.434715 13756 tablet_bootstrap.cc:492] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.435287 13756 ts_tablet_manager.cc:1403] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.007s
I20260709 12:13:14.436210 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae18c2b785940d89525f0331475c389" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:14.436764 13564 raft_consensus.cc:3060] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.438324 13756 raft_consensus.cc:359] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.439082 13756 raft_consensus.cc:385] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.439352 13756 raft_consensus.cc:740] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.440099 13756 consensus_queue.cc:260] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.442759 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae18c2b785940d89525f0331475c389" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:14.443928 13756 ts_tablet_manager.cc:1434] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:14.444326 13564 raft_consensus.cc:2468] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 1.
I20260709 12:13:14.445003 13756 tablet_bootstrap.cc:492] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:14.445565 13678 leader_election.cc:304] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
W20260709 12:13:14.447028 13676 leader_election.cc:343] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.454494 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae18c2b785940d89525f0331475c389" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:14.451974 13760 leader_election.cc:290] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
W20260709 12:13:14.456359 13676 leader_election.cc:343] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.461230 13776 raft_consensus.cc:2804] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.461798 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.462668 13713 raft_consensus.cc:2468] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:14.464046 13529 leader_election.cc:304] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:14.464866 13761 raft_consensus.cc:2804] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.465207 13761 raft_consensus.cc:493] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.465540 13761 raft_consensus.cc:3060] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.465490 13756 tablet_bootstrap.cc:654] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.470858 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9380dee5565048cdbc48fea673b1a68b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
W20260709 12:13:14.472411 13604 leader_election.cc:343] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.475147 13753 tablet_bootstrap.cc:492] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.473687 13776 raft_consensus.cc:697] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:14.475641 13753 ts_tablet_manager.cc:1403] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.088s	user 0.026s	sys 0.008s
I20260709 12:13:14.478680 13753 raft_consensus.cc:359] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.479552 13753 raft_consensus.cc:385] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.479995 13753 raft_consensus.cc:740] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.480502 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:14.483083 13754 tablet_bootstrap.cc:492] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.483191 13756 tablet_bootstrap.cc:492] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.483983 13754 ts_tablet_manager.cc:1403] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.005s
I20260709 12:13:14.484014 13756 ts_tablet_manager.cc:1403] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.003s
W20260709 12:13:14.484297 13527 leader_election.cc:343] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.480420 13776 consensus_queue.cc:237] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.485466 13753 consensus_queue.cc:260] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.487329 13754 raft_consensus.cc:359] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.479094 13761 raft_consensus.cc:515] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.489264 13754 raft_consensus.cc:385] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.487637 13753 ts_tablet_manager.cc:1434] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:13:14.495038 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
W20260709 12:13:14.496167 13527 leader_election.cc:343] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.498766 13756 raft_consensus.cc:359] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.500226 13756 raft_consensus.cc:385] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.500515 13756 raft_consensus.cc:740] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.502266 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9380dee5565048cdbc48fea673b1a68b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.494340 13753 tablet_bootstrap.cc:492] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.489625 13754 raft_consensus.cc:740] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.502534 13756 consensus_queue.cc:260] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.504909 13754 consensus_queue.cc:260] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.506861 13713 raft_consensus.cc:2468] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:14.510340 13604 leader_election.cc:304] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:14.511178 13759 raft_consensus.cc:2804] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.505811 13780 raft_consensus.cc:493] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.511650 13759 raft_consensus.cc:493] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.512024 13759 raft_consensus.cc:3060] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.513257 13754 ts_tablet_manager.cc:1434] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:13:14.506287 13761 leader_election.cc:290] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.516852 13761 raft_consensus.cc:493] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.517263 13761 raft_consensus.cc:515] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.519174 13761 leader_election.cc:290] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.516086 13780 raft_consensus.cc:515] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.521170 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38ac31eefa0495aa61958063bc74f92" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:14.521862 13639 raft_consensus.cc:2468] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:14.522096 13638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
W20260709 12:13:14.523589 13527 leader_election.cc:343] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.524605 13527 leader_election.cc:304] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.525775 13761 raft_consensus.cc:2804] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.526150 13761 raft_consensus.cc:493] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.526474 13761 raft_consensus.cc:3060] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.510969 13753 tablet_bootstrap.cc:654] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.527792 13759 raft_consensus.cc:515] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.531312 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9380dee5565048cdbc48fea673b1a68b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:14.531881 13564 raft_consensus.cc:3060] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.534642 13759 leader_election.cc:290] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.539036 13753 tablet_bootstrap.cc:492] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.539606 13753 ts_tablet_manager.cc:1403] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 12:13:14.539996 13564 raft_consensus.cc:2468] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.541198 13604 leader_election.cc:304] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.542266 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9380dee5565048cdbc48fea673b1a68b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:14.542760 13759 raft_consensus.cc:2804] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.542906 13713 raft_consensus.cc:3060] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.547163 13753 raft_consensus.cc:359] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.547909 13753 raft_consensus.cc:385] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.548202 13753 raft_consensus.cc:740] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.549309 13780 leader_election.cc:290] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.550118 13754 tablet_bootstrap.cc:492] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:14.552147 13753 consensus_queue.cc:260] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.553982 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:14.554648 13712 raft_consensus.cc:3060] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.556598 13753 ts_tablet_manager.cc:1434] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:13:14.557631 13753 tablet_bootstrap.cc:492] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.562269 13712 raft_consensus.cc:2468] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 1.
I20260709 12:13:14.562965 13759 raft_consensus.cc:697] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:14.563925 13759 consensus_queue.cc:237] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.569347 13460 catalog_manager.cc:5697] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 1 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.570669 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38ac31eefa0495aa61958063bc74f92" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.571334 13712 raft_consensus.cc:2468] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:14.573385 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.570600 13753 tablet_bootstrap.cc:654] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.574987 13529 leader_election.cc:304] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: bb6b8f66c52744ac8ff012bf0d73ebc5
W20260709 12:13:14.576659 13529 leader_election.cc:343] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.577121 13529 leader_election.cc:304] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f; no voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5
I20260709 12:13:14.577952 13783 raft_consensus.cc:2804] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.578140 13780 raft_consensus.cc:2749] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.578464 13783 raft_consensus.cc:697] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:14.579290 13783 consensus_queue.cc:237] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.582697 13713 raft_consensus.cc:2468] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.569988 13761 raft_consensus.cc:515] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.591022 13753 tablet_bootstrap.cc:492] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.591616 13753 ts_tablet_manager.cc:1403] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.001s
I20260709 12:13:14.591359 13461 catalog_manager.cc:5697] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.593130 13754 tablet_bootstrap.cc:654] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.594482 13753 raft_consensus.cc:359] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.595021 13753 raft_consensus.cc:385] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.595235 13753 raft_consensus.cc:740] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.595839 13753 consensus_queue.cc:260] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.597698 13753 ts_tablet_manager.cc:1434] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:13:14.598048 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38ac31eefa0495aa61958063bc74f92" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:14.598708 13753 tablet_bootstrap.cc:492] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.598625 13639 raft_consensus.cc:3060] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.608279 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d38ac31eefa0495aa61958063bc74f92" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:14.608875 13713 raft_consensus.cc:3060] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.605034 13761 leader_election.cc:290] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
W20260709 12:13:14.617053 13510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:14.620703 13713 raft_consensus.cc:2468] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 1.
I20260709 12:13:14.622818 13756 ts_tablet_manager.cc:1434] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.138s	user 0.041s	sys 0.053s
I20260709 12:13:14.622108 13462 catalog_manager.cc:5697] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 1 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.624214 13756 tablet_bootstrap.cc:492] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:14.625226 13529 leader_election.cc:304] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:14.625996 13783 raft_consensus.cc:2804] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.626453 13783 raft_consensus.cc:697] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:14.627890 13783 consensus_queue.cc:237] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.621511 13639 raft_consensus.cc:2468] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 1.
I20260709 12:13:14.633996 13756 tablet_bootstrap.cc:654] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.636891 13754 tablet_bootstrap.cc:492] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.637384 13754 ts_tablet_manager.cc:1403] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.015s
I20260709 12:13:14.637856 13753 tablet_bootstrap.cc:654] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.640223 13754 raft_consensus.cc:359] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.641013 13754 raft_consensus.cc:385] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.641287 13754 raft_consensus.cc:740] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.642011 13754 consensus_queue.cc:260] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.644156 13754 ts_tablet_manager.cc:1434] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:13:14.645107 13754 tablet_bootstrap.cc:492] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:14.645653 13756 tablet_bootstrap.cc:492] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.646126 13756 ts_tablet_manager.cc:1403] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.009s
I20260709 12:13:14.648898 13756 raft_consensus.cc:359] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.649559 13756 raft_consensus.cc:385] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.649839 13756 raft_consensus.cc:740] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.651053 13754 tablet_bootstrap.cc:654] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.650523 13756 consensus_queue.cc:260] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.650514 13461 catalog_manager.cc:5697] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 1 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.653039 13756 ts_tablet_manager.cc:1434] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:13:14.654050 13756 tablet_bootstrap.cc:492] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:14.660140 13756 tablet_bootstrap.cc:654] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.671191 13756 tablet_bootstrap.cc:492] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.671641 13756 ts_tablet_manager.cc:1403] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 12:13:14.671949 13754 tablet_bootstrap.cc:492] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.672425 13754 ts_tablet_manager.cc:1403] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.014s
I20260709 12:13:14.672941 13753 tablet_bootstrap.cc:492] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.673424 13753 ts_tablet_manager.cc:1403] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.004s
I20260709 12:13:14.673893 13756 raft_consensus.cc:359] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.674422 13756 raft_consensus.cc:385] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.674641 13756 raft_consensus.cc:740] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.675227 13756 consensus_queue.cc:260] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.675356 13754 raft_consensus.cc:359] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.676096 13754 raft_consensus.cc:385] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.676401 13754 raft_consensus.cc:740] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.676247 13753 raft_consensus.cc:359] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.677023 13753 raft_consensus.cc:385] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.677271 13756 ts_tablet_manager.cc:1434] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:13:14.677304 13753 raft_consensus.cc:740] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.677276 13754 consensus_queue.cc:260] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.678661 13756 tablet_bootstrap.cc:492] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:14.678591 13753 consensus_queue.cc:260] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.681684 13754 ts_tablet_manager.cc:1434] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.008s
I20260709 12:13:14.682693 13754 tablet_bootstrap.cc:492] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:14.685526 13756 tablet_bootstrap.cc:654] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.688620 13753 ts_tablet_manager.cc:1434] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:13:14.688797 13754 tablet_bootstrap.cc:654] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.689658 13753 tablet_bootstrap.cc:492] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.696220 13753 tablet_bootstrap.cc:654] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.696674 13756 tablet_bootstrap.cc:492] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.697175 13756 ts_tablet_manager.cc:1403] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:13:14.699738 13756 raft_consensus.cc:359] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.700246 13756 raft_consensus.cc:385] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.700330 13759 raft_consensus.cc:493] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.700608 13756 raft_consensus.cc:740] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.700920 13759 raft_consensus.cc:515] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.701433 13756 consensus_queue.cc:260] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.703001 13759 leader_election.cc:290] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.704902 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3baa3445c0463a9f4895f74fcf0133" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.705408 13756 ts_tablet_manager.cc:1434] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:14.706292 13756 tablet_bootstrap.cc:492] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
W20260709 12:13:14.706246 13604 leader_election.cc:343] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.707362 13754 tablet_bootstrap.cc:492] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.707967 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3baa3445c0463a9f4895f74fcf0133" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:14.707906 13754 ts_tablet_manager.cc:1403] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.003s
I20260709 12:13:14.708629 13564 raft_consensus.cc:2468] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:14.709959 13604 leader_election.cc:304] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 69f8cd7011784b0e977a7509c867ff9d
I20260709 12:13:14.710754 13753 tablet_bootstrap.cc:492] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.711078 13785 raft_consensus.cc:493] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.711211 13753 ts_tablet_manager.cc:1403] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 12:13:14.711596 13785 raft_consensus.cc:515] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.711669 13754 raft_consensus.cc:359] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.712472 13754 raft_consensus.cc:385] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.712627 13756 tablet_bootstrap.cc:654] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.713461 13759 raft_consensus.cc:2804] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.713835 13759 raft_consensus.cc:493] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.714262 13759 raft_consensus.cc:3060] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.715237 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.715837 13713 raft_consensus.cc:2468] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:14.712766 13754 raft_consensus.cc:740] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.717017 13783 raft_consensus.cc:493] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.717149 13753 raft_consensus.cc:359] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.717731 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:14.718010 13753 raft_consensus.cc:385] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.713752 13785 leader_election.cc:290] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.718371 13753 raft_consensus.cc:740] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.717245 13754 consensus_queue.cc:260] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.719189 13786 raft_consensus.cc:493] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.719681 13786 raft_consensus.cc:515] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.718360 13564 raft_consensus.cc:2468] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:14.720242 13783 raft_consensus.cc:515] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.721906 13754 ts_tablet_manager.cc:1434] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:13:14.722353 13783 leader_election.cc:290] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.727463 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.728291 13754 tablet_bootstrap.cc:492] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
W20260709 12:13:14.729426 13529 leader_election.cc:343] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.731235 13604 leader_election.cc:304] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.726898 13759 raft_consensus.cc:515] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.732602 13785 raft_consensus.cc:2804] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.733002 13785 raft_consensus.cc:493] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.733326 13785 raft_consensus.cc:3060] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.733916 13759 leader_election.cc:290] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.723292 13753 consensus_queue.cc:260] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.735932 13753 ts_tablet_manager.cc:1434] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:13:14.737121 13753 tablet_bootstrap.cc:492] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:14.739058 13754 tablet_bootstrap.cc:654] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.740231 13786 leader_election.cc:290] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.742513 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.742527 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:14.743384 13563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:14.745031 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3baa3445c0463a9f4895f74fcf0133" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:14.745222 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f3baa3445c0463a9f4895f74fcf0133" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:14.743355 13712 raft_consensus.cc:2393] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in current term 1: Already voted for candidate 9d8581c650864064b205d7288bf6b93f in this term.
I20260709 12:13:14.745772 13713 raft_consensus.cc:3060] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:14.747504 13527 leader_election.cc:343] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:14.747959 13527 leader_election.cc:304] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f; no voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5
I20260709 12:13:14.748711 13783 raft_consensus.cc:2749] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.745867 13564 raft_consensus.cc:3060] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.753402 13604 leader_election.cc:304] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:14.754218 13786 raft_consensus.cc:3060] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.755632 13753 tablet_bootstrap.cc:654] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.759816 13713 raft_consensus.cc:2468] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.761134 13604 leader_election.cc:304] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.762115 13759 raft_consensus.cc:2804] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.763381 13759 raft_consensus.cc:697] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:14.764254 13759 consensus_queue.cc:237] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.771028 13753 tablet_bootstrap.cc:492] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:14.771571 13753 ts_tablet_manager.cc:1403] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 12:13:14.774747 13753 raft_consensus.cc:359] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.775936 13785 raft_consensus.cc:515] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.776458 13753 raft_consensus.cc:385] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.776891 13753 raft_consensus.cc:740] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.777663 13754 tablet_bootstrap.cc:492] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.777587 13753 consensus_queue.cc:260] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.778127 13754 ts_tablet_manager.cc:1403] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.016s
I20260709 12:13:14.779981 13753 ts_tablet_manager.cc:1434] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:14.780835 13754 raft_consensus.cc:359] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.781348 13754 raft_consensus.cc:385] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.781548 13754 raft_consensus.cc:740] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.782120 13754 consensus_queue.cc:260] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.784083 13564 raft_consensus.cc:2468] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.785620 13786 raft_consensus.cc:2749] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.785987 13754 ts_tablet_manager.cc:1434] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:14.786952 13754 tablet_bootstrap.cc:492] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:14.789477 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:14.790069 13713 raft_consensus.cc:3060] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.793146 13754 tablet_bootstrap.cc:654] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:14.796918 13785 leader_election.cc:290] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.797297 13713 raft_consensus.cc:2468] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.797703 13563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:14.798354 13563 raft_consensus.cc:3060] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.798703 13604 leader_election.cc:304] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.799487 13785 raft_consensus.cc:2804] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.799916 13785 raft_consensus.cc:697] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:14.800563 13785 consensus_queue.cc:237] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.804123 13786 raft_consensus.cc:493] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.804792 13563 raft_consensus.cc:2468] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.804631 13786 raft_consensus.cc:515] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.806030 13756 tablet_bootstrap.cc:492] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:14.804221 13461 catalog_manager.cc:5697] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.807554 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12a86912b804d989dab9941271b4950" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:14.807945 13754 tablet_bootstrap.cc:492] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:14.808276 13562 raft_consensus.cc:2468] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:14.808560 13754 ts_tablet_manager.cc:1403] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.009s
I20260709 12:13:14.807498 13756 ts_tablet_manager.cc:1403] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.101s	user 0.034s	sys 0.048s
I20260709 12:13:14.810922 13604 leader_election.cc:304] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.811715 13759 raft_consensus.cc:2804] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.811710 13754 raft_consensus.cc:359] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.812294 13759 raft_consensus.cc:493] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.812690 13754 raft_consensus.cc:385] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.812733 13759 raft_consensus.cc:3060] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.813221 13754 raft_consensus.cc:740] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.812920 13756 raft_consensus.cc:359] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.813843 13756 raft_consensus.cc:385] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:14.814163 13756 raft_consensus.cc:740] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:14.814138 13754 consensus_queue.cc:260] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.815198 13756 consensus_queue.cc:260] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.817173 13754 ts_tablet_manager.cc:1434] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:13:14.817631 13756 ts_tablet_manager.cc:1434] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:13:14.820184 13759 raft_consensus.cc:515] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.823120 13759 leader_election.cc:290] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.823277 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12a86912b804d989dab9941271b4950" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.823909 13713 raft_consensus.cc:2468] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:14.824599 13786 leader_election.cc:290] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.825197 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12a86912b804d989dab9941271b4950" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:14.825739 13713 raft_consensus.cc:3060] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.828547 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12a86912b804d989dab9941271b4950" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:14.829098 13562 raft_consensus.cc:3060] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.833631 13713 raft_consensus.cc:2468] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.834745 13604 leader_election.cc:304] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.834772 13461 catalog_manager.cc:5697] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.835652 13786 raft_consensus.cc:2804] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.836129 13786 raft_consensus.cc:697] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:14.836988 13562 raft_consensus.cc:2468] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.837420 13786 consensus_queue.cc:237] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.846812 13460 catalog_manager.cc:5697] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.868711 13786 raft_consensus.cc:493] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.869133 13786 raft_consensus.cc:515] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.870719 13786 leader_election.cc:290] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701), 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353)
I20260709 12:13:14.871181 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f38719a66ea4410b5eded50d77c8b45" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.871637 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f38719a66ea4410b5eded50d77c8b45" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:14.871742 13713 raft_consensus.cc:2468] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:14.872134 13562 raft_consensus.cc:2468] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:14.872659 13604 leader_election.cc:304] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.873358 13786 raft_consensus.cc:2804] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:14.873627 13786 raft_consensus.cc:493] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.873862 13786 raft_consensus.cc:3060] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.878551 13786 raft_consensus.cc:515] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.879926 13786 leader_election.cc:290] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701), 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353)
I20260709 12:13:14.880532 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f38719a66ea4410b5eded50d77c8b45" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:14.880833 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f38719a66ea4410b5eded50d77c8b45" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:14.880963 13713 raft_consensus.cc:3060] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.881320 13562 raft_consensus.cc:3060] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.885387 13713 raft_consensus.cc:2468] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.885600 13562 raft_consensus.cc:2468] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:14.886273 13604 leader_election.cc:304] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:14.886808 13786 raft_consensus.cc:2804] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:14.887171 13786 raft_consensus.cc:697] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:14.887853 13786 consensus_queue.cc:237] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:14.893951 13460 catalog_manager.cc:5697] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.912487 13786 raft_consensus.cc:493] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.913005 13786 raft_consensus.cc:515] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:14.914455 13786 leader_election.cc:290] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:14.915043 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae18c2b785940d89525f0331475c389" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:14.915325 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae18c2b785940d89525f0331475c389" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:14.915647 13562 raft_consensus.cc:2393] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in current term 1: Already voted for candidate 69f8cd7011784b0e977a7509c867ff9d in this term.
I20260709 12:13:14.916651 13604 leader_election.cc:304] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:14.917253 13786 raft_consensus.cc:3060] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:14.921659 13786 raft_consensus.cc:2749] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:14.929150 13776 consensus_queue.cc:1048] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:14.939486 13760 consensus_queue.cc:1048] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:14.967962 13786 consensus_queue.cc:1048] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:14.978223 13806 consensus_queue.cc:1048] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:15.085021 13783 consensus_queue.cc:1048] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.094795 13761 consensus_queue.cc:1048] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.158865 13806 raft_consensus.cc:493] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.159323 13806 raft_consensus.cc:515] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.160900 13806 leader_election.cc:290] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:15.161470 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:15.161798 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:15.162039 13562 raft_consensus.cc:2468] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:15.162328 13713 raft_consensus.cc:2468] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:15.162997 13604 leader_election.cc:304] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:15.163560 13806 raft_consensus.cc:2804] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:15.163810 13806 raft_consensus.cc:493] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.164063 13806 raft_consensus.cc:3060] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.168761 13806 raft_consensus.cc:515] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.170221 13806 leader_election.cc:290] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:15.170940 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:15.171226 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:15.171414 13562 raft_consensus.cc:3060] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.171741 13713 raft_consensus.cc:3060] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:15.174932 13806 consensus_queue.cc:1048] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.177433 13562 raft_consensus.cc:2468] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:15.177558 13713 raft_consensus.cc:2468] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:15.178587 13604 leader_election.cc:304] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:15.179225 13806 raft_consensus.cc:2804] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:15.179726 13806 raft_consensus.cc:697] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:15.180604 13806 consensus_queue.cc:237] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.188956 13806 consensus_queue.cc:1048] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:15.189507 13460 catalog_manager.cc:5697] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.205698 13761 consensus_queue.cc:1048] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.215411 13820 consensus_queue.cc:1048] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.257961 13639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f38719a66ea4410b5eded50d77c8b45"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
mode: GRACEFUL
new_leader_uuid: "9d8581c650864064b205d7288bf6b93f"
 from {username='slave'} at 127.0.0.1:57530
I20260709 12:13:15.258450 13639 raft_consensus.cc:606] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Received request to transfer leadership to TS 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:15.264715 13639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9380dee5565048cdbc48fea673b1a68b"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
mode: GRACEFUL
new_leader_uuid: "9d8581c650864064b205d7288bf6b93f"
 from {username='slave'} at 127.0.0.1:57530
I20260709 12:13:15.265182 13639 raft_consensus.cc:606] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Received request to transfer leadership to TS 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:15.283267 13806 consensus_queue.cc:1048] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.285811 13712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ae18c2b785940d89525f0331475c389"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
mode: GRACEFUL
new_leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
 from {username='slave'} at 127.0.0.1:49722
I20260709 12:13:15.286247 13712 raft_consensus.cc:606] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Received request to transfer leadership to TS bb6b8f66c52744ac8ff012bf0d73ebc5
I20260709 12:13:15.292378 13639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
mode: GRACEFUL
new_leader_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:57530
I20260709 12:13:15.292924 13639 raft_consensus.cc:606] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Received request to transfer leadership to TS 69f8cd7011784b0e977a7509c867ff9d
I20260709 12:13:15.296264 13806 consensus_queue.cc:1048] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.309470 13806 consensus_queue.cc:1048] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.319554 13806 consensus_queue.cc:1048] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.325832 13786 raft_consensus.cc:993] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5: : Instructing follower 9d8581c650864064b205d7288bf6b93f to start an election
I20260709 12:13:15.326228 13806 raft_consensus.cc:1081] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Signalling peer 9d8581c650864064b205d7288bf6b93f to start an election
I20260709 12:13:15.327554 13562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f38719a66ea4410b5eded50d77c8b45"
dest_uuid: "9d8581c650864064b205d7288bf6b93f"
 from {username='slave'} at 127.0.0.1:46710
I20260709 12:13:15.328030 13562 raft_consensus.cc:493] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.328365 13562 raft_consensus.cc:3060] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.333096 13562 raft_consensus.cc:515] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:15.334825 13562 leader_election.cc:290] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 2 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:15.335346 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f38719a66ea4410b5eded50d77c8b45" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:15.335880 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f38719a66ea4410b5eded50d77c8b45" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:15.335949 13639 raft_consensus.cc:3055] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.336468 13712 raft_consensus.cc:3060] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.336458 13639 raft_consensus.cc:740] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:15.337466 13639 consensus_queue.cc:260] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:15.338662 13639 raft_consensus.cc:3060] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.343254 13712 raft_consensus.cc:2468] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 2.
I20260709 12:13:15.344265 13529 leader_election.cc:304] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:15.345016 13820 raft_consensus.cc:2804] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.345219 13639 raft_consensus.cc:2468] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 2.
I20260709 12:13:15.345377 13820 raft_consensus.cc:697] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 2 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:15.346242 13820 consensus_queue.cc:237] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } }
I20260709 12:13:15.351586 13460 catalog_manager.cc:5697] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 1 to 2, leader changed from bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66) to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 2 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.411477 13806 raft_consensus.cc:993] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5: : Instructing follower 9d8581c650864064b205d7288bf6b93f to start an election
I20260709 12:13:15.411530 13759 consensus_queue.cc:1048] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.411918 13786 raft_consensus.cc:1081] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Signalling peer 9d8581c650864064b205d7288bf6b93f to start an election
I20260709 12:13:15.413344 13562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9380dee5565048cdbc48fea673b1a68b"
dest_uuid: "9d8581c650864064b205d7288bf6b93f"
 from {username='slave'} at 127.0.0.1:46710
I20260709 12:13:15.413832 13562 raft_consensus.cc:493] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.414189 13562 raft_consensus.cc:3060] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.422832 13806 consensus_queue.cc:1048] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.424290 13562 raft_consensus.cc:515] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.430857 13562 leader_election.cc:290] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 2 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:15.431938 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9380dee5565048cdbc48fea673b1a68b" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:15.432610 13713 raft_consensus.cc:3060] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.432744 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9380dee5565048cdbc48fea673b1a68b" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:15.433828 13639 raft_consensus.cc:3055] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.434085 13639 raft_consensus.cc:740] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:15.434741 13639 consensus_queue.cc:260] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.436055 13639 raft_consensus.cc:3060] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.440055 13713 raft_consensus.cc:2468] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 2.
I20260709 12:13:15.441082 13529 leader_election.cc:304] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:15.441833 13820 raft_consensus.cc:2804] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.442298 13820 raft_consensus.cc:697] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 2 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:15.442677 13639 raft_consensus.cc:2468] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 2.
I20260709 12:13:15.443092 13820 consensus_queue.cc:237] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.449294 13462 catalog_manager.cc:5697] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 1 to 2, leader changed from bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66) to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 2 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.472635 13836 raft_consensus.cc:993] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d: : Instructing follower bb6b8f66c52744ac8ff012bf0d73ebc5 to start an election
I20260709 12:13:15.473016 13760 raft_consensus.cc:1081] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Signalling peer bb6b8f66c52744ac8ff012bf0d73ebc5 to start an election
I20260709 12:13:15.474223 13639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ae18c2b785940d89525f0331475c389"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
 from {username='slave'} at 127.0.0.1:57522
I20260709 12:13:15.474617 13639 raft_consensus.cc:493] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.474874 13639 raft_consensus.cc:3060] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.479059 13639 raft_consensus.cc:515] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.480594 13639 leader_election.cc:290] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:15.481195 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae18c2b785940d89525f0331475c389" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:15.481514 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ae18c2b785940d89525f0331475c389" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:15.481767 13564 raft_consensus.cc:3060] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.482043 13713 raft_consensus.cc:3055] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.482306 13713 raft_consensus.cc:740] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:15.482867 13713 consensus_queue.cc:260] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.483716 13713 raft_consensus.cc:3060] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.486305 13564 raft_consensus.cc:2468] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 2.
I20260709 12:13:15.487491 13604 leader_election.cc:304] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:15.488214 13806 raft_consensus.cc:2804] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.488323 13713 raft_consensus.cc:2468] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 2.
I20260709 12:13:15.488584 13806 raft_consensus.cc:697] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:15.489404 13806 consensus_queue.cc:237] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.494867 13462 catalog_manager.cc:5697] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 1 to 2, leader changed from 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67) to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:15.635675 13806 consensus_queue.cc:1048] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.641438 13785 raft_consensus.cc:993] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5: : Instructing follower 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:15.641945 13786 raft_consensus.cc:1081] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Signalling peer 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:15.643972 13712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:49716
I20260709 12:13:15.646817 13786 consensus_queue.cc:1048] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:15.647312 13712 raft_consensus.cc:493] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:15.647750 13712 raft_consensus.cc:3060] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.654611 13712 raft_consensus.cc:515] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.657526 13712 leader_election.cc:290] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:15.658195 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:15.658859 13564 raft_consensus.cc:3060] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.658810 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2d9c253e3a4e6b965c0f7a6d63e107" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:15.659595 13639 raft_consensus.cc:3055] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:15.659914 13639 raft_consensus.cc:740] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:15.660665 13639 consensus_queue.cc:260] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.661870 13639 raft_consensus.cc:3060] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:15.665557 13564 raft_consensus.cc:2468] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:15.666582 13678 leader_election.cc:304] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:15.667299 13760 raft_consensus.cc:2804] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:15.667717 13760 raft_consensus.cc:697] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:15.668298 13639 raft_consensus.cc:2468] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:15.668284 13760 consensus_queue.cc:237] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:15.673601 13461 catalog_manager.cc:5697] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 1 to 2, leader changed from bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66) to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 2 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:15.862665 13712 raft_consensus.cc:1275] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Refusing update from remote peer 9d8581c650864064b205d7288bf6b93f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.863734 13820 consensus_queue.cc:1048] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.870355 13639 raft_consensus.cc:1275] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 9d8581c650864064b205d7288bf6b93f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.871516 13761 consensus_queue.cc:1048] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.907908 13639 raft_consensus.cc:1275] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 9d8581c650864064b205d7288bf6b93f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.908977 13761 consensus_queue.cc:1048] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:15.916038 13712 raft_consensus.cc:1275] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Refusing update from remote peer 9d8581c650864064b205d7288bf6b93f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:15.917461 13782 consensus_queue.cc:1048] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.015165 13711 raft_consensus.cc:1275] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Refusing update from remote peer bb6b8f66c52744ac8ff012bf0d73ebc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.016342 13806 consensus_queue.cc:1048] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.024178 13564 raft_consensus.cc:1275] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer bb6b8f66c52744ac8ff012bf0d73ebc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.026079 13786 consensus_queue.cc:1048] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.059000 13564 raft_consensus.cc:1275] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.060012 13760 consensus_queue.cc:1048] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.066602 13639 raft_consensus.cc:1275] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:16.068565 13841 consensus_queue.cc:1048] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.323683 13462 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59268:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:18.326540 13462 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:18.373457 13554 tablet_service.cc:1511] Processing CreateTablet for tablet 7d36c39a65a84310be2ebbdbe622b3b3 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:18.374717 13554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d36c39a65a84310be2ebbdbe622b3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.374569 13622 tablet_service.cc:1511] Processing CreateTablet for tablet 7d36c39a65a84310be2ebbdbe622b3b3 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:18.375942 13622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d36c39a65a84310be2ebbdbe622b3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.376837 13695 tablet_service.cc:1511] Processing CreateTablet for tablet 7d36c39a65a84310be2ebbdbe622b3b3 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:18.378041 13695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d36c39a65a84310be2ebbdbe622b3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.377873 13627 tablet_service.cc:1511] Processing CreateTablet for tablet 65e6f8655a55476b8b72cc7fc8ecff09 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:18.379067 13627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e6f8655a55476b8b72cc7fc8ecff09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.382167 13548 tablet_service.cc:1511] Processing CreateTablet for tablet 65e6f8655a55476b8b72cc7fc8ecff09 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:18.383353 13548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e6f8655a55476b8b72cc7fc8ecff09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.384608 13697 tablet_service.cc:1511] Processing CreateTablet for tablet 65e6f8655a55476b8b72cc7fc8ecff09 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:18.384995 13702 tablet_service.cc:1511] Processing CreateTablet for tablet a41c2f73b4b14510bfca143979dd9858 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:18.385931 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e6f8655a55476b8b72cc7fc8ecff09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.386480 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c2f73b4b14510bfca143979dd9858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.383119 13625 tablet_service.cc:1511] Processing CreateTablet for tablet a41c2f73b4b14510bfca143979dd9858 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:18.387534 13625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c2f73b4b14510bfca143979dd9858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.384608 13549 tablet_service.cc:1511] Processing CreateTablet for tablet a41c2f73b4b14510bfca143979dd9858 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:18.389890 13549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41c2f73b4b14510bfca143979dd9858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.401427 13546 tablet_service.cc:1511] Processing CreateTablet for tablet ce11809de5744c1dae2c7ec66a22dc46 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:18.402756 13546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce11809de5744c1dae2c7ec66a22dc46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.417366 13624 tablet_service.cc:1511] Processing CreateTablet for tablet ce11809de5744c1dae2c7ec66a22dc46 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:18.418607 13624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce11809de5744c1dae2c7ec66a22dc46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.421595 13698 tablet_service.cc:1511] Processing CreateTablet for tablet ce11809de5744c1dae2c7ec66a22dc46 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:18.422801 13698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce11809de5744c1dae2c7ec66a22dc46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.428438 13553 tablet_service.cc:1511] Processing CreateTablet for tablet 19729132336640fda7253b5b55ed3c2d (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:18.429649 13553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19729132336640fda7253b5b55ed3c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.443245 13628 tablet_service.cc:1511] Processing CreateTablet for tablet 19729132336640fda7253b5b55ed3c2d (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:18.444451 13628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19729132336640fda7253b5b55ed3c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.452394 13857 tablet_bootstrap.cc:492] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.473585 13554 tablet_service.cc:1511] Processing CreateTablet for tablet 0c19bdb921d54b95a514a69f0f908180 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:18.474975 13554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c19bdb921d54b95a514a69f0f908180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.477560 13698 tablet_service.cc:1511] Processing CreateTablet for tablet 0c19bdb921d54b95a514a69f0f908180 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:18.478780 13698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c19bdb921d54b95a514a69f0f908180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.482041 13702 tablet_service.cc:1511] Processing CreateTablet for tablet 19729132336640fda7253b5b55ed3c2d (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:18.483341 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19729132336640fda7253b5b55ed3c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.476210 13625 tablet_service.cc:1511] Processing CreateTablet for tablet 0c19bdb921d54b95a514a69f0f908180 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:18.484578 13625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c19bdb921d54b95a514a69f0f908180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.487890 13857 tablet_bootstrap.cc:654] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.490151 13548 tablet_service.cc:1511] Processing CreateTablet for tablet b8bf8f2978ad4c0ea5aaeb68f702ca3b (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:18.491102 13622 tablet_service.cc:1511] Processing CreateTablet for tablet b8bf8f2978ad4c0ea5aaeb68f702ca3b (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:18.493108 13622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bf8f2978ad4c0ea5aaeb68f702ca3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.494910 13855 tablet_bootstrap.cc:492] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:18.496047 13553 tablet_service.cc:1511] Processing CreateTablet for tablet a5c854ef7d734ecba708b4f91e84b9e8 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:18.497344 13548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bf8f2978ad4c0ea5aaeb68f702ca3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.503542 13627 tablet_service.cc:1511] Processing CreateTablet for tablet a5c854ef7d734ecba708b4f91e84b9e8 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:18.504908 13627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c854ef7d734ecba708b4f91e84b9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.505242 13553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c854ef7d734ecba708b4f91e84b9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.512909 13697 tablet_service.cc:1511] Processing CreateTablet for tablet a5c854ef7d734ecba708b4f91e84b9e8 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:18.514122 13697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c854ef7d734ecba708b4f91e84b9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.521692 13695 tablet_service.cc:1511] Processing CreateTablet for tablet b8bf8f2978ad4c0ea5aaeb68f702ca3b (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:18.522874 13695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8bf8f2978ad4c0ea5aaeb68f702ca3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.520134 13855 tablet_bootstrap.cc:654] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.526700 13624 tablet_service.cc:1511] Processing CreateTablet for tablet 65de0ea4b2eb4dd29b48e169dbf3e9a6 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:18.528033 13624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de0ea4b2eb4dd29b48e169dbf3e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.541776 13698 tablet_service.cc:1511] Processing CreateTablet for tablet 65de0ea4b2eb4dd29b48e169dbf3e9a6 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:18.549530 13698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de0ea4b2eb4dd29b48e169dbf3e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.545936 13554 tablet_service.cc:1511] Processing CreateTablet for tablet 65de0ea4b2eb4dd29b48e169dbf3e9a6 (DEFAULT_TABLE table=soft_deleted_table [id=7221d48b5029424480f959ad5a951c33]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:18.551388 13554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65de0ea4b2eb4dd29b48e169dbf3e9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:18.550408 13858 tablet_bootstrap.cc:492] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:18.560397 13857 tablet_bootstrap.cc:492] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:18.560947 13857 ts_tablet_manager.cc:1403] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.011s
I20260709 12:13:18.564438 13857 raft_consensus.cc:359] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.568454 13858 tablet_bootstrap.cc:654] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.569168 13857 raft_consensus.cc:385] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.573711 13857 raft_consensus.cc:740] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.574410 13857 consensus_queue.cc:260] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.576917 13857 ts_tablet_manager.cc:1434] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:18.577903 13857 tablet_bootstrap.cc:492] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.583914 13857 tablet_bootstrap.cc:654] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.586503 13858 tablet_bootstrap.cc:492] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:18.586926 13858 ts_tablet_manager.cc:1403] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.013s
I20260709 12:13:18.588663 13855 tablet_bootstrap.cc:492] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:18.589257 13855 ts_tablet_manager.cc:1403] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.009s
I20260709 12:13:18.589766 13858 raft_consensus.cc:359] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.590509 13858 raft_consensus.cc:385] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.590799 13858 raft_consensus.cc:740] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.591596 13858 consensus_queue.cc:260] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.592098 13855 raft_consensus.cc:359] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.592945 13855 raft_consensus.cc:385] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.593254 13855 raft_consensus.cc:740] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.594074 13858 ts_tablet_manager.cc:1434] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:18.593983 13855 consensus_queue.cc:260] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.596192 13858 tablet_bootstrap.cc:492] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:18.596272 13855 ts_tablet_manager.cc:1434] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:18.597577 13855 tablet_bootstrap.cc:492] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:18.603322 13858 tablet_bootstrap.cc:654] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.606596 13855 tablet_bootstrap.cc:654] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.599864 13857 tablet_bootstrap.cc:492] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:18.607374 13857 ts_tablet_manager.cc:1403] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.006s
I20260709 12:13:18.610416 13857 raft_consensus.cc:359] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.611033 13857 raft_consensus.cc:385] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.611500 13857 raft_consensus.cc:740] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.611855 13855 tablet_bootstrap.cc:492] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:18.612388 13855 ts_tablet_manager.cc:1403] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:13:18.612185 13857 consensus_queue.cc:260] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.614745 13857 ts_tablet_manager.cc:1434] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:18.615609 13857 tablet_bootstrap.cc:492] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.615450 13855 raft_consensus.cc:359] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.616521 13855 raft_consensus.cc:385] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.616896 13855 raft_consensus.cc:740] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.617705 13855 consensus_queue.cc:260] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.620065 13855 ts_tablet_manager.cc:1434] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:13:18.621515 13855 tablet_bootstrap.cc:492] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:18.622284 13857 tablet_bootstrap.cc:654] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.624843 13858 tablet_bootstrap.cc:492] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:18.625362 13858 ts_tablet_manager.cc:1403] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.006s
I20260709 12:13:18.626891 13786 raft_consensus.cc:493] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.627358 13786 raft_consensus.cc:515] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.627722 13855 tablet_bootstrap.cc:654] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.629369 13786 leader_election.cc:290] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.631248 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:18.631934 13711 raft_consensus.cc:2468] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:18.633481 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:18.633766 13604 leader_election.cc:304] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.634994 13786 raft_consensus.cc:2804] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:18.635456 13786 raft_consensus.cc:493] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.635857 13786 raft_consensus.cc:3060] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.639123 13855 tablet_bootstrap.cc:492] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:18.639655 13855 ts_tablet_manager.cc:1403] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.010s
W20260709 12:13:18.635144 13604 leader_election.cc:343] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:18.642719 13855 raft_consensus.cc:359] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.642822 13786 raft_consensus.cc:515] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.643446 13855 raft_consensus.cc:385] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.644246 13855 raft_consensus.cc:740] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.645020 13858 raft_consensus.cc:359] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.645171 13855 consensus_queue.cc:260] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.646013 13857 tablet_bootstrap.cc:492] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:18.646059 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:18.646663 13786 leader_election.cc:290] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.646683 13857 ts_tablet_manager.cc:1403] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.005s
I20260709 12:13:18.647226 13858 raft_consensus.cc:385] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.647619 13858 raft_consensus.cc:740] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
W20260709 12:13:18.648309 13604 leader_election.cc:343] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:18.647588 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:18.648897 13711 raft_consensus.cc:3060] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.648561 13858 consensus_queue.cc:260] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.650867 13858 ts_tablet_manager.cc:1434] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:13:18.651839 13858 tablet_bootstrap.cc:492] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
W20260709 12:13:18.652245 13510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:18.658254 13858 tablet_bootstrap.cc:654] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.660224 13855 ts_tablet_manager.cc:1434] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.012s
I20260709 12:13:18.650506 13857 raft_consensus.cc:359] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.662154 13855 tablet_bootstrap.cc:492] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:18.662114 13857 raft_consensus.cc:385] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.663015 13857 raft_consensus.cc:740] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.663787 13857 consensus_queue.cc:260] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.666016 13857 ts_tablet_manager.cc:1434] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:13:18.661055 13711 raft_consensus.cc:2468] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:18.668084 13855 tablet_bootstrap.cc:654] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.668228 13604 leader_election.cc:304] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:18.669057 13786 raft_consensus.cc:2804] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:18.669523 13786 raft_consensus.cc:697] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:18.670185 13857 tablet_bootstrap.cc:492] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.670281 13786 consensus_queue.cc:237] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.676740 13857 tablet_bootstrap.cc:654] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.677795 13858 tablet_bootstrap.cc:492] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:18.678409 13858 ts_tablet_manager.cc:1403] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 12:13:18.681540 13858 raft_consensus.cc:359] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.682224 13858 raft_consensus.cc:385] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.682504 13858 raft_consensus.cc:740] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.683190 13858 consensus_queue.cc:260] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.685473 13858 ts_tablet_manager.cc:1434] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:18.686403 13858 tablet_bootstrap.cc:492] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:18.692363 13858 tablet_bootstrap.cc:654] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.697922 13855 tablet_bootstrap.cc:492] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:18.698469 13855 ts_tablet_manager.cc:1403] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.010s
I20260709 12:13:18.698895 13857 tablet_bootstrap.cc:492] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:18.699409 13857 ts_tablet_manager.cc:1403] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.016s
I20260709 12:13:18.699286 13462 catalog_manager.cc:5697] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.701471 13855 raft_consensus.cc:359] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.702244 13855 raft_consensus.cc:385] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.702543 13855 raft_consensus.cc:740] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.702250 13857 raft_consensus.cc:359] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.703267 13855 consensus_queue.cc:260] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.703680 13857 raft_consensus.cc:385] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.704133 13857 raft_consensus.cc:740] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.704684 13858 tablet_bootstrap.cc:492] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:18.705214 13858 ts_tablet_manager.cc:1403] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:13:18.705641 13855 ts_tablet_manager.cc:1434] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:13:18.705220 13857 consensus_queue.cc:260] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.706878 13855 tablet_bootstrap.cc:492] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:18.707702 13857 ts_tablet_manager.cc:1434] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:18.708276 13858 raft_consensus.cc:359] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.708766 13857 tablet_bootstrap.cc:492] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.709008 13858 raft_consensus.cc:385] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.709372 13858 raft_consensus.cc:740] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.710043 13858 consensus_queue.cc:260] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.712110 13858 ts_tablet_manager.cc:1434] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:13:18.713042 13858 tablet_bootstrap.cc:492] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:18.713634 13855 tablet_bootstrap.cc:654] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.717914 13857 tablet_bootstrap.cc:654] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.719194 13858 tablet_bootstrap.cc:654] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.725103 13855 tablet_bootstrap.cc:492] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:18.725597 13855 ts_tablet_manager.cc:1403] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.012s
I20260709 12:13:18.728329 13858 tablet_bootstrap.cc:492] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:18.728782 13858 ts_tablet_manager.cc:1403] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:13:18.729573 13855 raft_consensus.cc:359] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.730363 13855 raft_consensus.cc:385] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.730661 13855 raft_consensus.cc:740] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.731523 13855 consensus_queue.cc:260] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.731540 13858 raft_consensus.cc:359] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.733458 13858 raft_consensus.cc:385] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.733829 13858 raft_consensus.cc:740] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.734560 13858 consensus_queue.cc:260] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.734983 13857 tablet_bootstrap.cc:492] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:18.735062 13855 ts_tablet_manager.cc:1434] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:18.735594 13857 ts_tablet_manager.cc:1403] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.012s
I20260709 12:13:18.736583 13855 tablet_bootstrap.cc:492] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:18.738488 13857 raft_consensus.cc:359] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.738879 13858 ts_tablet_manager.cc:1434] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 12:13:18.739161 13857 raft_consensus.cc:385] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.739511 13857 raft_consensus.cc:740] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.740098 13858 tablet_bootstrap.cc:492] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:18.740227 13857 consensus_queue.cc:260] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.742520 13857 ts_tablet_manager.cc:1434] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:13:18.743461 13857 tablet_bootstrap.cc:492] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.745499 13855 tablet_bootstrap.cc:654] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.747191 13858 tablet_bootstrap.cc:654] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.749619 13857 tablet_bootstrap.cc:654] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.759492 13855 tablet_bootstrap.cc:492] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:18.759994 13855 ts_tablet_manager.cc:1403] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.011s
I20260709 12:13:18.762874 13855 raft_consensus.cc:359] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.763583 13855 raft_consensus.cc:385] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.763872 13855 raft_consensus.cc:740] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.764621 13855 consensus_queue.cc:260] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.767340 13858 tablet_bootstrap.cc:492] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:18.767670 13857 tablet_bootstrap.cc:492] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:18.767756 13855 ts_tablet_manager.cc:1434] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:18.767845 13858 ts_tablet_manager.cc:1403] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.014s
I20260709 12:13:18.768244 13857 ts_tablet_manager.cc:1403] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.012s
I20260709 12:13:18.769387 13855 tablet_bootstrap.cc:492] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:18.770964 13858 raft_consensus.cc:359] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.772109 13858 raft_consensus.cc:385] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.772405 13858 raft_consensus.cc:740] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.773144 13858 consensus_queue.cc:260] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.771260 13857 raft_consensus.cc:359] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.774705 13857 raft_consensus.cc:385] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.775004 13857 raft_consensus.cc:740] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.775462 13858 ts_tablet_manager.cc:1434] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:13:18.775851 13857 consensus_queue.cc:260] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.776439 13858 tablet_bootstrap.cc:492] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:18.778108 13857 ts_tablet_manager.cc:1434] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 12:13:18.780925 13857 tablet_bootstrap.cc:492] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.783928 13858 tablet_bootstrap.cc:654] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.785776 13855 tablet_bootstrap.cc:654] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.787523 13857 tablet_bootstrap.cc:654] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.799315 13857 tablet_bootstrap.cc:492] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:18.799875 13857 ts_tablet_manager.cc:1403] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:13:18.802906 13857 raft_consensus.cc:359] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.803458 13856 raft_consensus.cc:493] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.803789 13857 raft_consensus.cc:385] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.804265 13857 raft_consensus.cc:740] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.803995 13856 raft_consensus.cc:515] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.805310 13786 raft_consensus.cc:493] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.805789 13786 raft_consensus.cc:515] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.807487 13844 raft_consensus.cc:493] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.807968 13844 raft_consensus.cc:515] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.809592 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce11809de5744c1dae2c7ec66a22dc46" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:18.809906 13844 leader_election.cc:290] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:18.810217 13639 raft_consensus.cc:2468] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:18.810664 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce11809de5744c1dae2c7ec66a22dc46" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:18.811295 13711 raft_consensus.cc:2468] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:18.811630 13527 leader_election.cc:304] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.812461 13842 raft_consensus.cc:2804] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:18.811066 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d36c39a65a84310be2ebbdbe622b3b3" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:18.813077 13856 leader_election.cc:290] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.811182 13858 tablet_bootstrap.cc:492] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:18.813139 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c19bdb921d54b95a514a69f0f908180" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:18.811705 13786 leader_election.cc:290] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.813588 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d36c39a65a84310be2ebbdbe622b3b3" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:18.814150 13858 ts_tablet_manager.cc:1403] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.015s
I20260709 12:13:18.814293 13639 raft_consensus.cc:2468] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 0.
I20260709 12:13:18.813627 13562 raft_consensus.cc:2468] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 0.
I20260709 12:13:18.813235 13842 raft_consensus.cc:493] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.814277 13564 raft_consensus.cc:2468] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:18.815303 13842 raft_consensus.cc:3060] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.813019 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c19bdb921d54b95a514a69f0f908180" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:18.816404 13711 raft_consensus.cc:2468] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:18.818953 13678 leader_election.cc:304] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:18.817708 13604 leader_election.cc:304] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.819602 13856 raft_consensus.cc:493] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.820072 13856 raft_consensus.cc:515] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.822418 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c2f73b4b14510bfca143979dd9858" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:18.822610 13856 leader_election.cc:290] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.822991 13639 raft_consensus.cc:2468] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:18.824474 13855 tablet_bootstrap.cc:492] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:18.824600 13844 raft_consensus.cc:2804] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:18.826434 13844 raft_consensus.cc:493] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.825992 13858 raft_consensus.cc:359] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.826814 13844 raft_consensus.cc:3060] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.824339 13786 raft_consensus.cc:2804] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:18.824033 13857 consensus_queue.cc:260] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.826084 13527 leader_election.cc:304] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.827270 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c2f73b4b14510bfca143979dd9858" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:18.826942 13858 raft_consensus.cc:385] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.828181 13786 raft_consensus.cc:493] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.828244 13842 raft_consensus.cc:515] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.834900 13856 raft_consensus.cc:2804] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:18.828891 13855 ts_tablet_manager.cc:1403] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.010s
I20260709 12:13:18.861480 13856 raft_consensus.cc:493] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.861938 13856 raft_consensus.cc:3060] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.829663 13858 raft_consensus.cc:740] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.862864 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce11809de5744c1dae2c7ec66a22dc46" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:18.863446 13639 raft_consensus.cc:3060] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.863380 13858 consensus_queue.cc:260] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.864158 13855 raft_consensus.cc:359] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.830066 13786 raft_consensus.cc:3060] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.866852 13858 ts_tablet_manager.cc:1434] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.008s
I20260709 12:13:18.869045 13856 raft_consensus.cc:515] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.829579 13711 raft_consensus.cc:2468] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:18.869817 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce11809de5744c1dae2c7ec66a22dc46" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:18.870431 13712 raft_consensus.cc:3060] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.871179 13856 leader_election.cc:290] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.871837 13638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c2f73b4b14510bfca143979dd9858" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:18.872421 13638 raft_consensus.cc:3060] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.865165 13842 leader_election.cc:290] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.839192 13844 raft_consensus.cc:515] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.872963 13855 raft_consensus.cc:385] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.876582 13855 raft_consensus.cc:740] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.877468 13855 consensus_queue.cc:260] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.878872 13639 raft_consensus.cc:2468] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 1.
I20260709 12:13:18.880141 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d36c39a65a84310be2ebbdbe622b3b3" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:18.880733 13855 ts_tablet_manager.cc:1434] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:13:18.880752 13562 raft_consensus.cc:3060] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.881958 13855 tablet_bootstrap.cc:492] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:18.884558 13844 leader_election.cc:290] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:18.885187 13637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d36c39a65a84310be2ebbdbe622b3b3" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:18.885347 13638 raft_consensus.cc:2468] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 1.
I20260709 12:13:18.885838 13637 raft_consensus.cc:3060] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.886497 13527 leader_election.cc:304] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.886554 13786 raft_consensus.cc:515] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.887502 13842 raft_consensus.cc:2804] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:18.887959 13842 raft_consensus.cc:697] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:18.889226 13855 tablet_bootstrap.cc:654] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.888827 13842 consensus_queue.cc:237] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.893899 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c19bdb921d54b95a514a69f0f908180" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:18.894500 13564 raft_consensus.cc:3060] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.896020 13562 raft_consensus.cc:2468] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 1.
I20260709 12:13:18.897446 13678 leader_election.cc:304] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:18.898437 13844 raft_consensus.cc:2804] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:18.898619 13637 raft_consensus.cc:2468] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 1.
I20260709 12:13:18.898382 13858 tablet_bootstrap.cc:492] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:18.902256 13564 raft_consensus.cc:2468] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:18.903390 13604 leader_election.cc:304] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.904245 13867 raft_consensus.cc:2804] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:18.910116 13786 leader_election.cc:290] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.911545 13527 leader_election.cc:304] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.912348 13883 raft_consensus.cc:2804] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:18.912765 13883 raft_consensus.cc:697] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:18.913559 13883 consensus_queue.cc:237] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.880117 13712 raft_consensus.cc:2468] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 1.
I20260709 12:13:18.919889 13858 tablet_bootstrap.cc:654] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.918120 13857 ts_tablet_manager.cc:1434] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.118s	user 0.012s	sys 0.012s
I20260709 12:13:18.926014 13857 tablet_bootstrap.cc:492] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.928045 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c19bdb921d54b95a514a69f0f908180" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:18.934779 13855 tablet_bootstrap.cc:492] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:18.935400 13855 ts_tablet_manager.cc:1403] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.054s	user 0.027s	sys 0.005s
I20260709 12:13:18.936655 13711 raft_consensus.cc:3060] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:18.918321 13529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:34701, user_credentials={real_user=slave}} blocked reactor thread for 47735.8us
I20260709 12:13:18.941772 13461 catalog_manager.cc:5697] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 1 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.924041 13867 raft_consensus.cc:697] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:18.944672 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41c2f73b4b14510bfca143979dd9858" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:18.945276 13712 raft_consensus.cc:3060] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.946528 13855 raft_consensus.cc:359] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.947144 13857 tablet_bootstrap.cc:654] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.947237 13855 raft_consensus.cc:385] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.947695 13855 raft_consensus.cc:740] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.945060 13867 consensus_queue.cc:237] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.950155 13856 raft_consensus.cc:493] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.950618 13856 raft_consensus.cc:515] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.951244 13855 consensus_queue.cc:260] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.952898 13856 leader_election.cc:290] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.953578 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:18.954180 13639 raft_consensus.cc:2468] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:18.954233 13713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:18.954572 13711 raft_consensus.cc:2468] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:18.954938 13713 raft_consensus.cc:2468] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 0.
I20260709 12:13:18.956468 13844 raft_consensus.cc:697] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:18.958634 13527 leader_election.cc:304] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.964977 13856 raft_consensus.cc:2804] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:18.965080 13857 tablet_bootstrap.cc:492] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:18.965399 13856 raft_consensus.cc:493] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.965742 13857 ts_tablet_manager.cc:1403] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.008s
I20260709 12:13:18.965842 13856 raft_consensus.cc:3060] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:18.968480 13857 raft_consensus.cc:359] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.969252 13857 raft_consensus.cc:385] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:18.969517 13857 raft_consensus.cc:740] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:18.970172 13857 consensus_queue.cc:260] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.972550 13857 ts_tablet_manager.cc:1434] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:18.973999 13857 tablet_bootstrap.cc:492] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d: Bootstrap starting.
I20260709 12:13:18.975212 13461 catalog_manager.cc:5697] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 1 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.956893 13888 raft_consensus.cc:493] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.963264 13844 consensus_queue.cc:237] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.980930 13883 raft_consensus.cc:493] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:18.981393 13883 raft_consensus.cc:515] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.985517 13460 catalog_manager.cc:5697] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.986789 13883 leader_election.cc:290] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.988121 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:18.989550 13712 raft_consensus.cc:2468] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 1.
I20260709 12:13:18.990108 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:18.990355 13888 raft_consensus.cc:515] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:18.991640 13711 raft_consensus.cc:2393] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d8581c650864064b205d7288bf6b93f in current term 1: Already voted for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in this term.
I20260709 12:13:18.992695 13888 leader_election.cc:290] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:18.994505 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:18.995102 13711 raft_consensus.cc:2468] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:18.996114 13604 leader_election.cc:304] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:18.997225 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:18.998569 13858 tablet_bootstrap.cc:492] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:18.996361 13857 tablet_bootstrap.cc:654] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:18.999048 13856 raft_consensus.cc:515] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.001109 13867 raft_consensus.cc:2804] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:18.999089 13858 ts_tablet_manager.cc:1403] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.003s
I20260709 12:13:19.001426 13564 raft_consensus.cc:2393] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in current term 1: Already voted for candidate 9d8581c650864064b205d7288bf6b93f in this term.
I20260709 12:13:19.005976 13786 raft_consensus.cc:493] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.006422 13786 raft_consensus.cc:515] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.001497 13867 raft_consensus.cc:493] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:18.999094 13527 leader_election.cc:304] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f; no voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5
I20260709 12:13:19.007956 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:19.008590 13711 raft_consensus.cc:3060] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.009088 13883 raft_consensus.cc:3060] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.010533 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:19.012883 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bf8f2978ad4c0ea5aaeb68f702ca3b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:19.013469 13564 raft_consensus.cc:2468] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:19.008302 13786 leader_election.cc:290] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.014472 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bf8f2978ad4c0ea5aaeb68f702ca3b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:19.015085 13712 raft_consensus.cc:2468] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:19.003328 13855 ts_tablet_manager.cc:1434] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.068s	user 0.016s	sys 0.024s
I20260709 12:13:19.016510 13604 leader_election.cc:304] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:19.017697 13867 raft_consensus.cc:3060] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.018895 13858 raft_consensus.cc:359] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.019587 13883 raft_consensus.cc:2749] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:19.019800 13888 raft_consensus.cc:2804] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:19.020162 13888 raft_consensus.cc:493] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.020462 13888 raft_consensus.cc:3060] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.020629 13855 tablet_bootstrap.cc:492] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5: Bootstrap starting.
I20260709 12:13:19.026952 13855 tablet_bootstrap.cc:654] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:19.026844 13461 catalog_manager.cc:5697] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 1 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.019546 13858 raft_consensus.cc:385] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:19.029657 13858 raft_consensus.cc:740] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.015614 13711 raft_consensus.cc:2468] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 1.
I20260709 12:13:19.030951 13529 leader_election.cc:304] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:19.031814 13883 raft_consensus.cc:2804] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:19.016033 13856 leader_election.cc:290] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 1 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.033305 13858 consensus_queue.cc:260] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.033922 13883 raft_consensus.cc:697] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:19.034734 13883 consensus_queue.cc:237] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.035287 13858 ts_tablet_manager.cc:1434] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.000s
I20260709 12:13:19.036756 13858 tablet_bootstrap.cc:492] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f: Bootstrap starting.
I20260709 12:13:19.039999 13888 raft_consensus.cc:515] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.043413 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bf8f2978ad4c0ea5aaeb68f702ca3b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:19.043951 13564 raft_consensus.cc:3060] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.048601 13867 raft_consensus.cc:515] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.049724 13639 raft_consensus.cc:2393] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d8581c650864064b205d7288bf6b93f in current term 1: Already voted for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in this term.
I20260709 12:13:19.054327 13564 raft_consensus.cc:2468] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:19.055353 13857 tablet_bootstrap.cc:492] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d: No bootstrap required, opened a new log
I20260709 12:13:19.055488 13604 leader_election.cc:304] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:19.055837 13857 ts_tablet_manager.cc:1403] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.014s
I20260709 12:13:19.056311 13894 raft_consensus.cc:2804] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:19.056782 13894 raft_consensus.cc:697] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:19.058320 13894 consensus_queue.cc:237] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.059135 13857 raft_consensus.cc:359] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.059813 13857 raft_consensus.cc:385] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:19.060068 13857 raft_consensus.cc:740] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.061156 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bf8f2978ad4c0ea5aaeb68f702ca3b" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:19.061764 13711 raft_consensus.cc:3060] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.060832 13857 consensus_queue.cc:260] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.063710 13857 ts_tablet_manager.cc:1434] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:19.068691 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:19.071883 13888 leader_election.cc:290] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.074378 13867 leader_election.cc:290] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.076681 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:19.077487 13712 raft_consensus.cc:2393] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in current term 1: Already voted for candidate 9d8581c650864064b205d7288bf6b93f in this term.
I20260709 12:13:19.077844 13711 raft_consensus.cc:2468] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:19.075469 13858 tablet_bootstrap.cc:654] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:19.078157 13460 catalog_manager.cc:5697] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 1 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.078964 13855 tablet_bootstrap.cc:492] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5: No bootstrap required, opened a new log
I20260709 12:13:19.079504 13855 ts_tablet_manager.cc:1403] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.004s
I20260709 12:13:19.080374 13461 catalog_manager.cc:5697] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.081707 13604 leader_election.cc:304] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:19.083267 13867 raft_consensus.cc:2749] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:19.084929 13855 raft_consensus.cc:359] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.085808 13855 raft_consensus.cc:385] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:19.086134 13855 raft_consensus.cc:740] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.086723 13855 consensus_queue.cc:260] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.089187 13855 ts_tablet_manager.cc:1434] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:19.092010 13858 tablet_bootstrap.cc:492] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f: No bootstrap required, opened a new log
I20260709 12:13:19.092458 13858 ts_tablet_manager.cc:1403] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.000s
I20260709 12:13:19.094928 13858 raft_consensus.cc:359] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.095533 13858 raft_consensus.cc:385] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:19.095731 13858 raft_consensus.cc:740] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Initialized, Role: FOLLOWER
I20260709 12:13:19.096269 13858 consensus_queue.cc:260] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.097831 13858 ts_tablet_manager.cc:1434] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:13:19.104434 13844 raft_consensus.cc:493] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.104854 13844 raft_consensus.cc:515] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.106374 13844 leader_election.cc:290] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:19.106926 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c854ef7d734ecba708b4f91e84b9e8" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:19.107230 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c854ef7d734ecba708b4f91e84b9e8" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" is_pre_election: true
I20260709 12:13:19.107416 13564 raft_consensus.cc:2468] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 0.
I20260709 12:13:19.107748 13639 raft_consensus.cc:2468] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 0.
I20260709 12:13:19.108333 13678 leader_election.cc:304] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:19.109043 13844 raft_consensus.cc:2804] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:19.109359 13844 raft_consensus.cc:493] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.109570 13844 raft_consensus.cc:3060] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.113996 13844 raft_consensus.cc:515] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.115404 13844 leader_election.cc:290] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:19.115947 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c854ef7d734ecba708b4f91e84b9e8" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:19.116394 13564 raft_consensus.cc:3060] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.116258 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c854ef7d734ecba708b4f91e84b9e8" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:19.116909 13639 raft_consensus.cc:3060] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.120707 13564 raft_consensus.cc:2468] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 1.
I20260709 12:13:19.121325 13639 raft_consensus.cc:2468] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 1.
I20260709 12:13:19.121564 13678 leader_election.cc:304] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:19.122222 13844 raft_consensus.cc:2804] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:19.122576 13844 raft_consensus.cc:697] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:19.123129 13844 consensus_queue.cc:237] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.129194 13460 catalog_manager.cc:5697] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 0 to 1, leader changed from <none> to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 1 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.141678 13867 consensus_queue.cc:1048] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.151252 13888 consensus_queue.cc:1048] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.315352 13883 consensus_queue.cc:1048] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.324414 13856 consensus_queue.cc:1048] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.406069 13842 consensus_queue.cc:1048] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.418709 13887 consensus_queue.cc:1048] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:19.431677 13888 raft_consensus.cc:493] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:19.432040 13888 raft_consensus.cc:515] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.433723 13888 leader_election.cc:290] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.434170 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de0ea4b2eb4dd29b48e169dbf3e9a6" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f" is_pre_election: true
I20260709 12:13:19.434523 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de0ea4b2eb4dd29b48e169dbf3e9a6" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d" is_pre_election: true
I20260709 12:13:19.434732 13564 raft_consensus.cc:2468] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:19.435063 13712 raft_consensus.cc:2468] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 0.
I20260709 12:13:19.435626 13604 leader_election.cc:304] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:19.436192 13888 raft_consensus.cc:2804] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:19.436446 13888 raft_consensus.cc:493] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:19.436697 13888 raft_consensus.cc:3060] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.441184 13888 raft_consensus.cc:515] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.442509 13888 leader_election.cc:290] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.443077 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de0ea4b2eb4dd29b48e169dbf3e9a6" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:19.443329 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de0ea4b2eb4dd29b48e169dbf3e9a6" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:19.443643 13564 raft_consensus.cc:3060] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.443871 13712 raft_consensus.cc:3060] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:19.450234 13564 raft_consensus.cc:2468] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:19.450234 13712 raft_consensus.cc:2468] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 1.
I20260709 12:13:19.451316 13604 leader_election.cc:304] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:19.451849 13888 raft_consensus.cc:2804] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:19.452325 13888 raft_consensus.cc:697] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:19.453022 13888 consensus_queue.cc:237] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.457895 13887 consensus_queue.cc:1048] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.460085 13460 catalog_manager.cc:5697] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 1 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.471757 13883 consensus_queue.cc:1048] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.511585 13888 consensus_queue.cc:1048] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.520258 13844 consensus_queue.cc:1048] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.521080 13867 consensus_queue.cc:1048] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.532348 13711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d36c39a65a84310be2ebbdbe622b3b3"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
mode: GRACEFUL
new_leader_uuid: "9d8581c650864064b205d7288bf6b93f"
 from {username='slave'} at 127.0.0.1:49722
I20260709 12:13:19.532970 13711 raft_consensus.cc:606] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Received request to transfer leadership to TS 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:19.540062 13890 consensus_queue.cc:1048] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:19.545950 13638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
mode: GRACEFUL
new_leader_uuid: "9d8581c650864064b205d7288bf6b93f"
 from {username='slave'} at 127.0.0.1:57530
I20260709 12:13:19.546548 13638 raft_consensus.cc:606] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Received request to transfer leadership to TS 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:19.581070 13867 consensus_queue.cc:1048] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.581233 13562 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d"
dest_uuid: "9d8581c650864064b205d7288bf6b93f"
mode: GRACEFUL
new_leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
 from {username='slave'} at 127.0.0.1:52774
I20260709 12:13:19.581763 13562 raft_consensus.cc:606] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Received request to transfer leadership to TS bb6b8f66c52744ac8ff012bf0d73ebc5
I20260709 12:13:19.585167 13918 consensus_queue.cc:1048] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.592669 13888 consensus_queue.cc:1048] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.594717 13711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5c854ef7d734ecba708b4f91e84b9e8"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
mode: GRACEFUL
new_leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
 from {username='slave'} at 127.0.0.1:49722
I20260709 12:13:19.595257 13711 raft_consensus.cc:606] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Received request to transfer leadership to TS bb6b8f66c52744ac8ff012bf0d73ebc5
I20260709 12:13:19.601066 13890 consensus_queue.cc:1048] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:19.607199 13637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65de0ea4b2eb4dd29b48e169dbf3e9a6"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
mode: GRACEFUL
new_leader_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:57530
I20260709 12:13:19.607707 13637 raft_consensus.cc:606] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Received request to transfer leadership to TS 69f8cd7011784b0e977a7509c867ff9d
I20260709 12:13:19.622488 13867 raft_consensus.cc:993] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5: : Instructing follower 9d8581c650864064b205d7288bf6b93f to start an election
I20260709 12:13:19.622903 13867 raft_consensus.cc:1081] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Signalling peer 9d8581c650864064b205d7288bf6b93f to start an election
I20260709 12:13:19.624693 13890 raft_consensus.cc:993] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d: : Instructing follower 9d8581c650864064b205d7288bf6b93f to start an election
I20260709 12:13:19.625240 13844 raft_consensus.cc:1081] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Signalling peer 9d8581c650864064b205d7288bf6b93f to start an election
I20260709 12:13:19.626895 13564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d36c39a65a84310be2ebbdbe622b3b3"
dest_uuid: "9d8581c650864064b205d7288bf6b93f"
 from {username='slave'} at 127.0.0.1:46722
I20260709 12:13:19.627791 13564 raft_consensus.cc:493] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.628158 13564 raft_consensus.cc:3060] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.631776 13562 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09"
dest_uuid: "9d8581c650864064b205d7288bf6b93f"
 from {username='slave'} at 127.0.0.1:46710
I20260709 12:13:19.632254 13562 raft_consensus.cc:493] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.632547 13562 raft_consensus.cc:3060] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.634299 13564 raft_consensus.cc:515] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.636755 13637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d36c39a65a84310be2ebbdbe622b3b3" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:19.637308 13637 raft_consensus.cc:3060] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.638435 13562 raft_consensus.cc:515] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.639911 13562 leader_election.cc:290] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 2 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.640914 13712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:19.641495 13712 raft_consensus.cc:3060] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.642042 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e6f8655a55476b8b72cc7fc8ecff09" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:19.642609 13639 raft_consensus.cc:3055] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.642985 13639 raft_consensus.cc:740] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:19.643122 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d36c39a65a84310be2ebbdbe622b3b3" candidate_uuid: "9d8581c650864064b205d7288bf6b93f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:19.643646 13711 raft_consensus.cc:3055] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.643936 13711 raft_consensus.cc:740] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:19.643714 13639 consensus_queue.cc:260] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.644623 13711 consensus_queue.cc:260] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.645049 13639 raft_consensus.cc:3060] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.645684 13711 raft_consensus.cc:3060] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.649616 13712 raft_consensus.cc:2468] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 2.
I20260709 12:13:19.650756 13529 leader_election.cc:304] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:19.651108 13639 raft_consensus.cc:2468] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 2.
I20260709 12:13:19.651530 13883 raft_consensus.cc:2804] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.642586 13637 raft_consensus.cc:2468] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 2.
I20260709 12:13:19.652681 13527 leader_election.cc:304] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:19.652019 13883 raft_consensus.cc:697] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 2 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:19.653327 13711 raft_consensus.cc:2468] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d8581c650864064b205d7288bf6b93f in term 2.
I20260709 12:13:19.653767 13883 consensus_queue.cc:237] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.656661 13883 raft_consensus.cc:2804] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.657435 13883 raft_consensus.cc:697] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 2 LEADER]: Becoming Leader. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:19.642081 13564 leader_election.cc:290] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [CANDIDATE]: Term 2 election: Requested vote from peers bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.658283 13883 consensus_queue.cc:237] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.661036 13460 catalog_manager.cc:5697] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 1 to 2, leader changed from bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66) to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 2 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.671757 13460 catalog_manager.cc:5697] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f reported cstate change: term changed from 1 to 2, leader changed from 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67) to 9d8581c650864064b205d7288bf6b93f (127.3.163.65). New cstate: current_term: 2 leader_uuid: "9d8581c650864064b205d7288bf6b93f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.936296 13917 raft_consensus.cc:993] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d: : Instructing follower bb6b8f66c52744ac8ff012bf0d73ebc5 to start an election
I20260709 12:13:19.936731 13844 raft_consensus.cc:1081] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Signalling peer bb6b8f66c52744ac8ff012bf0d73ebc5 to start an election
I20260709 12:13:19.938244 13639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5c854ef7d734ecba708b4f91e84b9e8"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
 from {username='slave'} at 127.0.0.1:57522
I20260709 12:13:19.938752 13639 raft_consensus.cc:493] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.939109 13639 raft_consensus.cc:3060] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.944574 13639 raft_consensus.cc:515] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.945868 13639 leader_election.cc:290] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.946558 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c854ef7d734ecba708b4f91e84b9e8" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:19.946780 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c854ef7d734ecba708b4f91e84b9e8" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:19.947196 13564 raft_consensus.cc:3060] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.947311 13711 raft_consensus.cc:3055] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.947738 13711 raft_consensus.cc:740] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:19.948513 13711 consensus_queue.cc:260] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.949712 13711 raft_consensus.cc:3060] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.953392 13564 raft_consensus.cc:2468] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 2.
I20260709 12:13:19.954427 13604 leader_election.cc:304] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d8581c650864064b205d7288bf6b93f, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:19.955087 13786 raft_consensus.cc:2804] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.955415 13786 raft_consensus.cc:697] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:19.955984 13711 raft_consensus.cc:2468] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 2.
I20260709 12:13:19.956029 13786 consensus_queue.cc:237] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.962222 13460 catalog_manager.cc:5697] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 1 to 2, leader changed from 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67) to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.970052 13842 raft_consensus.cc:993] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f: : Instructing follower bb6b8f66c52744ac8ff012bf0d73ebc5 to start an election
I20260709 12:13:19.970525 13887 raft_consensus.cc:1081] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Signalling peer bb6b8f66c52744ac8ff012bf0d73ebc5 to start an election
I20260709 12:13:19.971777 13639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
 from {username='slave'} at 127.0.0.1:57508
I20260709 12:13:19.972141 13639 raft_consensus.cc:493] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.972368 13639 raft_consensus.cc:3060] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.976336 13639 raft_consensus.cc:515] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.977712 13639 leader_election.cc:290] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67:34701)
I20260709 12:13:19.978134 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:19.978698 13564 raft_consensus.cc:3055] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.978597 13711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19729132336640fda7253b5b55ed3c2d" candidate_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
I20260709 12:13:19.979087 13564 raft_consensus.cc:740] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:19.979260 13711 raft_consensus.cc:3060] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.979836 13564 consensus_queue.cc:260] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.980985 13564 raft_consensus.cc:3060] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.985427 13711 raft_consensus.cc:2468] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 2.
I20260709 12:13:19.986420 13604 leader_election.cc:304] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:19.986723 13564 raft_consensus.cc:2468] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb6b8f66c52744ac8ff012bf0d73ebc5 in term 2.
I20260709 12:13:19.986979 13786 raft_consensus.cc:2804] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.987401 13786 raft_consensus.cc:697] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 LEADER]: Becoming Leader. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:19.988061 13786 consensus_queue.cc:237] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:19.993463 13460 catalog_manager.cc:5697] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 reported cstate change: term changed from 1 to 2, leader changed from 9d8581c650864064b205d7288bf6b93f (127.3.163.65) to bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66). New cstate: current_term: 2 leader_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.044188 13786 consensus_queue.cc:1048] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:20.053385 13894 consensus_queue.cc:1048] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:20.062268 13786 raft_consensus.cc:993] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5: : Instructing follower 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:20.062702 13894 raft_consensus.cc:1081] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Signalling peer 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:20.064000 13711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65de0ea4b2eb4dd29b48e169dbf3e9a6"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:49716
I20260709 12:13:20.064492 13711 raft_consensus.cc:493] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.064841 13711 raft_consensus.cc:3060] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.070206 13711 raft_consensus.cc:515] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:20.072080 13711 leader_election.cc:290] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:20.072741 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de0ea4b2eb4dd29b48e169dbf3e9a6" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:20.073383 13564 raft_consensus.cc:3060] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.073758 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65de0ea4b2eb4dd29b48e169dbf3e9a6" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:20.074319 13639 raft_consensus.cc:3055] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.074604 13639 raft_consensus.cc:740] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:20.075294 13639 consensus_queue.cc:260] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:20.076668 13639 raft_consensus.cc:3060] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.079573 13564 raft_consensus.cc:2468] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:20.080579 13678 leader_election.cc:304] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:20.081344 13844 raft_consensus.cc:2804] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.081792 13844 raft_consensus.cc:697] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:20.082506 13844 consensus_queue.cc:237] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:20.083247 13639 raft_consensus.cc:2468] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:20.087945 13460 catalog_manager.cc:5697] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 1 to 2, leader changed from bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66) to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 2 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.091709 13639 raft_consensus.cc:1275] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 9d8581c650864064b205d7288bf6b93f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.092900 13887 consensus_queue.cc:1048] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.099721 13711 raft_consensus.cc:1275] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Refusing update from remote peer 9d8581c650864064b205d7288bf6b93f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.101012 13883 consensus_queue.cc:1048] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.105821 13712 raft_consensus.cc:1275] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Refusing update from remote peer 9d8581c650864064b205d7288bf6b93f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.107568 13842 consensus_queue.cc:1048] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.119724 13639 raft_consensus.cc:1275] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 9d8581c650864064b205d7288bf6b93f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.120878 13883 consensus_queue.cc:1048] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.561647 13564 raft_consensus.cc:1275] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer bb6b8f66c52744ac8ff012bf0d73ebc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.562618 13894 consensus_queue.cc:1048] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.575722 13711 raft_consensus.cc:1275] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Refusing update from remote peer bb6b8f66c52744ac8ff012bf0d73ebc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.576999 13786 consensus_queue.cc:1048] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.576634 13639 raft_consensus.cc:1275] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.578691 13844 consensus_queue.cc:1048] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.583433 13564 raft_consensus.cc:1275] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer bb6b8f66c52744ac8ff012bf0d73ebc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.595768 13786 consensus_queue.cc:1048] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.597016 13712 raft_consensus.cc:1275] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Refusing update from remote peer bb6b8f66c52744ac8ff012bf0d73ebc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.599397 13894 consensus_queue.cc:1048] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.600008 13562 raft_consensus.cc:1275] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.601248 13917 consensus_queue.cc:1048] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.610860 13462 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59268:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:13:22.628065 13462 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59268:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:13:22.663363  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:22.702487 13965 tablet.cc:1724] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.778213 13964 tablet.cc:1724] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.810190 13638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8bf8f2978ad4c0ea5aaeb68f702ca3b"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
mode: GRACEFUL
new_leader_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:38326
I20260709 12:13:22.810878 13638 raft_consensus.cc:606] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Received request to transfer leadership to TS 69f8cd7011784b0e977a7509c867ff9d
I20260709 12:13:22.839784 13964 tablet.cc:1724] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.848933 13966 raft_consensus.cc:993] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5: : Instructing follower 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:22.849458 13966 raft_consensus.cc:1081] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Signalling peer 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:22.851097 13970 tablet.cc:1724] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.851472 13993 tablet.cc:1724] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.848184 13965 tablet.cc:1724] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:22.862330 13739 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:19729132336640fda7253b5b55ed3c2d)
W20260709 12:13:22.867974 13739 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:19729132336640fda7253b5b55ed3c2d)
W20260709 12:13:22.868747 13739 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:19729132336640fda7253b5b55ed3c2d)
I20260709 12:13:22.872460 13999 tablet.cc:1724] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.878821 13997 tablet.cc:1724] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.918821 14002 tablet.cc:1724] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.919584 13965 tablet.cc:1724] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.916424 13964 tablet.cc:1724] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.923625 14003 tablet.cc:1724] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.928431 14001 tablet.cc:1724] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.930619 14000 tablet.cc:1724] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:22.938462 13999 tablet.cc:1724] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.017378 14003 tablet.cc:1724] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.019366 13564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce11809de5744c1dae2c7ec66a22dc46"
dest_uuid: "9d8581c650864064b205d7288bf6b93f"
mode: GRACEFUL
new_leader_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:52786
I20260709 12:13:23.020478 13564 raft_consensus.cc:606] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Received request to transfer leadership to TS 69f8cd7011784b0e977a7509c867ff9d
I20260709 12:13:23.025905  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:13:23.029012  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.048453 13980 tablet.cc:1724] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.052789 13993 tablet.cc:1724] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.061682 13712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8bf8f2978ad4c0ea5aaeb68f702ca3b"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:49716
I20260709 12:13:23.062338 13712 raft_consensus.cc:493] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.062781 13712 raft_consensus.cc:3060] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.072784 14002 tablet.cc:1724] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.127739 13999 tablet.cc:1724] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.135701 13712 raft_consensus.cc:515] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.145723 13639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4"
dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
mode: GRACEFUL
new_leader_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:38326
I20260709 12:13:23.146411 13639 raft_consensus.cc:606] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Received request to transfer leadership to TS 69f8cd7011784b0e977a7509c867ff9d
I20260709 12:13:23.146493 13993 tablet.cc:1724] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.149930 14002 tablet.cc:1724] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.153378 13980 tablet.cc:1724] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.154958 13970 tablet.cc:1724] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.156446 13985 raft_consensus.cc:993] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f: : Instructing follower 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:23.156993 13985 raft_consensus.cc:1081] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Signalling peer 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:23.160780 14000 tablet.cc:1724] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.165639 13710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce11809de5744c1dae2c7ec66a22dc46"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:49714
I20260709 12:13:23.166239 13965 tablet.cc:1724] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.166306 13710 raft_consensus.cc:493] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.178998 13710 raft_consensus.cc:3060] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.180011 13562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bf8f2978ad4c0ea5aaeb68f702ca3b" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:23.185309 13712 leader_election.cc:290] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:23.186512 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8bf8f2978ad4c0ea5aaeb68f702ca3b" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:23.187146 13639 raft_consensus.cc:3055] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.187497 13639 raft_consensus.cc:740] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:23.187320 14000 tablet.cc:1724] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:23.188792 13639 consensus_queue.cc:260] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.190429 13639 raft_consensus.cc:3060] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.189491 13564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b"
dest_uuid: "9d8581c650864064b205d7288bf6b93f"
mode: GRACEFUL
new_leader_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:52786
I20260709 12:13:23.191169 13564 raft_consensus.cc:606] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Received request to transfer leadership to TS 69f8cd7011784b0e977a7509c867ff9d
I20260709 12:13:23.198006 13639 raft_consensus.cc:2468] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:23.198987  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:23.199407 13676 leader_election.cc:304] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 9d8581c650864064b205d7288bf6b93f
I20260709 12:13:23.199611  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:23.200416 13844 raft_consensus.cc:2804] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.200906 13844 raft_consensus.cc:697] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:23.201850 13844 consensus_queue.cc:237] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.211259 13710 raft_consensus.cc:515] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.214744 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce11809de5744c1dae2c7ec66a22dc46" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:23.215268 13564 raft_consensus.cc:3055] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.215310 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce11809de5744c1dae2c7ec66a22dc46" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:23.215633 13564 raft_consensus.cc:740] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:23.215898 13710 leader_election.cc:290] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:23.216501 13564 consensus_queue.cc:260] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.216959 13639 raft_consensus.cc:3060] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.217772 13564 raft_consensus.cc:3060] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.224629 13564 raft_consensus.cc:2468] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:23.224629 13639 raft_consensus.cc:2468] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:23.225821 13676 leader_election.cc:304] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:23.226526 13844 raft_consensus.cc:2804] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.226999 13844 raft_consensus.cc:697] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:23.227846 13844 consensus_queue.cc:237] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.229111 13459 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e: soft_deleted_table [id=7221d48b5029424480f959ad5a951c33] alter complete (version 1)
I20260709 12:13:23.239640 13459 catalog_manager.cc:5697] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 1 to 2, leader changed from 9d8581c650864064b205d7288bf6b93f (127.3.163.65) to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 2 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.241360 13459 catalog_manager.cc:5697] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 1 to 2, leader changed from bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66) to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 2 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.458067 13977 raft_consensus.cc:993] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f: : Instructing follower 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:23.458583 13983 raft_consensus.cc:1081] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Signalling peer 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:23.460024 13712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:49714
I20260709 12:13:23.460417 13712 raft_consensus.cc:493] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.460687 13712 raft_consensus.cc:3060] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.465374 13712 raft_consensus.cc:515] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.466641 13712 leader_election.cc:290] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:23.467278 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:23.467622 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e56e14b0278a4128b5ae66ebc3d02a2b" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:23.467855 13564 raft_consensus.cc:3055] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.468173 13639 raft_consensus.cc:3060] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.468152 13564 raft_consensus.cc:740] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d8581c650864064b205d7288bf6b93f, State: Running, Role: LEADER
I20260709 12:13:23.469211 13564 consensus_queue.cc:260] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.470086 13564 raft_consensus.cc:3060] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.472527 13639 raft_consensus.cc:2468] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:23.473510 13676 leader_election.cc:304] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, bb6b8f66c52744ac8ff012bf0d73ebc5; no voters: 
I20260709 12:13:23.474201 13844 raft_consensus.cc:2804] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.474455 13564 raft_consensus.cc:2468] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:23.474568 13844 raft_consensus.cc:697] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:23.475504 13844 consensus_queue.cc:237] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.482015 13459 catalog_manager.cc:5697] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 1 to 2, leader changed from 9d8581c650864064b205d7288bf6b93f (127.3.163.65) to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 2 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.615310 13639 raft_consensus.cc:1275] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:23.616268 13844 consensus_queue.cc:1048] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.623811 13564 raft_consensus.cc:1275] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:23.625459 13844 consensus_queue.cc:1048] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.650100 13976 raft_consensus.cc:993] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5: : Instructing follower 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:23.650570 13978 raft_consensus.cc:1081] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Signalling peer 69f8cd7011784b0e977a7509c867ff9d to start an election
I20260709 12:13:23.651736 13712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4"
dest_uuid: "69f8cd7011784b0e977a7509c867ff9d"
 from {username='slave'} at 127.0.0.1:49716
I20260709 12:13:23.652102 13712 raft_consensus.cc:493] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.652338 13712 raft_consensus.cc:3060] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.656934 13712 raft_consensus.cc:515] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.658402 13712 leader_election.cc:290] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Requested vote from peers 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353), bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977)
I20260709 12:13:23.659055 13564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d8581c650864064b205d7288bf6b93f"
I20260709 12:13:23.659212 13639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4350686a78994afcb21ad7f2746051c4" candidate_uuid: "69f8cd7011784b0e977a7509c867ff9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5"
I20260709 12:13:23.659605 13564 raft_consensus.cc:3060] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.659704 13639 raft_consensus.cc:3055] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.660106 13639 raft_consensus.cc:740] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bb6b8f66c52744ac8ff012bf0d73ebc5, State: Running, Role: LEADER
I20260709 12:13:23.660840 13639 consensus_queue.cc:260] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.661978 13639 raft_consensus.cc:3060] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.664999 13564 raft_consensus.cc:2468] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:23.665889 13678 leader_election.cc:304] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69f8cd7011784b0e977a7509c867ff9d, 9d8581c650864064b205d7288bf6b93f; no voters: 
I20260709 12:13:23.666486 14015 raft_consensus.cc:2804] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.666829 14015 raft_consensus.cc:697] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Becoming Leader. State: Replica: 69f8cd7011784b0e977a7509c867ff9d, State: Running, Role: LEADER
I20260709 12:13:23.666916 13639 raft_consensus.cc:2468] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 69f8cd7011784b0e977a7509c867ff9d in term 2.
I20260709 12:13:23.667667 14015 consensus_queue.cc:237] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } }
I20260709 12:13:23.674016 13461 catalog_manager.cc:5697] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d reported cstate change: term changed from 1 to 2, leader changed from bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66) to 69f8cd7011784b0e977a7509c867ff9d (127.3.163.67). New cstate: current_term: 2 leader_uuid: "69f8cd7011784b0e977a7509c867ff9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69f8cd7011784b0e977a7509c867ff9d" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 34701 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.741767 13639 raft_consensus.cc:1275] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:23.742663 14015 consensus_queue.cc:1048] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.755604 13564 raft_consensus.cc:3060] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.761721 13564 raft_consensus.cc:1275] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:23.762846 14015 consensus_queue.cc:1048] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.856761 13564 raft_consensus.cc:1275] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.858022 14015 consensus_queue.cc:1048] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.867641 13639 raft_consensus.cc:1275] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.869406 14015 consensus_queue.cc:1048] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.190027 13564 raft_consensus.cc:1275] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.191182 14015 consensus_queue.cc:1048] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d8581c650864064b205d7288bf6b93f" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 38353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.200202 13639 raft_consensus.cc:1275] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Refusing update from remote peer 69f8cd7011784b0e977a7509c867ff9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.201058  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:24.202368 14019 consensus_queue.cc:1048] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb6b8f66c52744ac8ff012bf0d73ebc5" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.208585  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:24.209316  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.214401  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:24.214834  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:25.215832  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:25.221045  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:25.221544  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.226788  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:25.227146  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:26.228081  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:26.233929  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:26.234315  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.239523  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:26.239926  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:27.240690  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:27.245421  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:27.245841  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:27.251863  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:27.252158  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:28.252947  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:28.257704  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:28.258095  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.263036  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:28.263357  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:29.264314  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:29.270143  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:29.270519  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:29.274960  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:29.275274  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:30.276062  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:30.281073  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:30.281448  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.285878  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:30.286203  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:31.287010  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:31.292102  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:31.292485  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.297288  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:31.297618  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:32.443946 13603 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.000s	sys 0.015s
W20260709 12:13:32.444557 13603 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.000s	sys 0.016s
W20260709 12:13:32.460035 13679 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.004s	sys 0.015s
W20260709 12:13:32.460536 13679 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.004s	sys 0.016s
W20260709 12:13:32.486845 13677 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.005s	sys 0.018s
W20260709 12:13:32.487210 13677 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.005s	sys 0.018s
W20260709 12:13:32.511258 13676 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.017s	sys 0.103s
W20260709 12:13:32.511498 13676 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.017s	sys 0.103s
I20260709 12:13:32.588039  3725 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:32.592983  3725 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:32.593343  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.597807  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:32.598130  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:33.485688 13734 debug-util.cc:398] Leaking SignalData structure 0x7b0800385640 after lost signal to thread 3728
W20260709 12:13:33.487704 13734 debug-util.cc:398] Leaking SignalData structure 0x7b0800256620 after lost signal to thread 13496
W20260709 12:13:33.489951 13734 debug-util.cc:398] Leaking SignalData structure 0x7b080024b0e0 after lost signal to thread 13588
W20260709 12:13:33.492153 13734 debug-util.cc:398] Leaking SignalData structure 0x7b08003deac0 after lost signal to thread 13663
W20260709 12:13:33.494228 13734 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2de0 after lost signal to thread 13737
I20260709 12:13:33.656236  3725 tablet_server.cc:179] TabletServer@127.3.163.65:0 shutting down...
I20260709 12:13:33.697479  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:33.698444  3725 tablet_replica.cc:333] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.699898  3725 raft_consensus.cc:2243] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.700996  3725 raft_consensus.cc:2272] T a5c854ef7d734ecba708b4f91e84b9e8 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.705132  3725 tablet_replica.cc:333] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.706151  3725 raft_consensus.cc:2243] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.706984  3725 raft_consensus.cc:2272] T 0c19bdb921d54b95a514a69f0f908180 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.710587  3725 tablet_replica.cc:333] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.711452  3725 raft_consensus.cc:2243] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.712335  3725 raft_consensus.cc:2272] T 19729132336640fda7253b5b55ed3c2d P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.715904  3725 tablet_replica.cc:333] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.716742  3725 raft_consensus.cc:2243] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.718012  3725 raft_consensus.cc:2272] T 7d36c39a65a84310be2ebbdbe622b3b3 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.721771  3725 tablet_replica.cc:333] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.722582  3725 raft_consensus.cc:2243] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.723215  3725 raft_consensus.cc:2272] T 9f3baa3445c0463a9f4895f74fcf0133 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.726306  3725 tablet_replica.cc:333] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.726881  3725 raft_consensus.cc:2243] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.727939  3725 raft_consensus.cc:2272] T 1f38719a66ea4410b5eded50d77c8b45 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.731016  3725 tablet_replica.cc:333] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.731666  3725 raft_consensus.cc:2243] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.732196  3725 raft_consensus.cc:2272] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.734902  3725 tablet_replica.cc:333] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.735451  3725 raft_consensus.cc:2243] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.736476  3725 raft_consensus.cc:2272] T 9380dee5565048cdbc48fea673b1a68b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.739071  3725 tablet_replica.cc:333] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.739657  3725 raft_consensus.cc:2243] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.740772  3725 raft_consensus.cc:2272] T d38ac31eefa0495aa61958063bc74f92 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.743503  3725 tablet_replica.cc:333] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.744011  3725 raft_consensus.cc:2243] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.744671  3725 raft_consensus.cc:2272] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.747269  3725 tablet_replica.cc:333] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.747833  3725 raft_consensus.cc:2243] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.748787  3725 raft_consensus.cc:2272] T a41c2f73b4b14510bfca143979dd9858 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.751281  3725 tablet_replica.cc:333] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.751855  3725 raft_consensus.cc:2243] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.752321  3725 raft_consensus.cc:2272] T 4350686a78994afcb21ad7f2746051c4 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.754768  3725 tablet_replica.cc:333] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.755205  3725 raft_consensus.cc:2243] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.755656  3725 raft_consensus.cc:2272] T e12a86912b804d989dab9941271b4950 P 9d8581c650864064b205d7288bf6b93f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.758164  3725 tablet_replica.cc:333] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.758728  3725 raft_consensus.cc:2243] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.759222  3725 raft_consensus.cc:2272] T 6ae18c2b785940d89525f0331475c389 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.761910  3725 tablet_replica.cc:333] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.762475  3725 raft_consensus.cc:2243] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.763036  3725 raft_consensus.cc:2272] T ce11809de5744c1dae2c7ec66a22dc46 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.765656  3725 tablet_replica.cc:333] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.766199  3725 raft_consensus.cc:2243] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.766803  3725 raft_consensus.cc:2272] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.769284  3725 tablet_replica.cc:333] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.769750  3725 raft_consensus.cc:2243] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.770759  3725 raft_consensus.cc:2272] T 65e6f8655a55476b8b72cc7fc8ecff09 P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.774142  3725 tablet_replica.cc:333] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f: stopping tablet replica
I20260709 12:13:33.774749  3725 raft_consensus.cc:2243] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.775480  3725 raft_consensus.cc:2272] T e56e14b0278a4128b5ae66ebc3d02a2b P 9d8581c650864064b205d7288bf6b93f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:33.789826 13678 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 12:13:33.796605 13678 consensus_peers.cc:597] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d -> Peer 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353): Couldn't send request to peer 9d8581c650864064b205d7288bf6b93f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:33.797381 13678 consensus_peers.cc:597] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d -> Peer 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353): Couldn't send request to peer 9d8581c650864064b205d7288bf6b93f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.816834  3725 tablet_server.cc:196] TabletServer@127.3.163.65:0 shutdown complete.
I20260709 12:13:33.868871  3725 tablet_server.cc:179] TabletServer@127.3.163.66:0 shutting down...
W20260709 12:13:33.905411 13678 consensus_peers.cc:597] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d -> Peer 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353): Couldn't send request to peer 9d8581c650864064b205d7288bf6b93f. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.908166  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:33.909065  3725 tablet_replica.cc:333] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.910807  3725 raft_consensus.cc:2243] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.911751  3725 raft_consensus.cc:2272] T a5c854ef7d734ecba708b4f91e84b9e8 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.914378  3725 tablet_replica.cc:333] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.915089  3725 raft_consensus.cc:2243] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.915999  3725 raft_consensus.cc:2272] T 0c19bdb921d54b95a514a69f0f908180 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.918350  3725 tablet_replica.cc:333] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.918864  3725 raft_consensus.cc:2243] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.919713  3725 raft_consensus.cc:2272] T 19729132336640fda7253b5b55ed3c2d P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.922049  3725 tablet_replica.cc:333] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.922575  3725 raft_consensus.cc:2243] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.923285  3725 raft_consensus.cc:2272] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.925432  3725 tablet_replica.cc:333] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.925968  3725 raft_consensus.cc:2243] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.926677  3725 raft_consensus.cc:2272] T a41c2f73b4b14510bfca143979dd9858 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.931524  3725 tablet_replica.cc:333] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.932320  3725 raft_consensus.cc:2243] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:33.932413 13678 consensus_peers.cc:597] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d -> Peer 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353): Couldn't send request to peer 9d8581c650864064b205d7288bf6b93f. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.933213  3725 raft_consensus.cc:2272] T ce11809de5744c1dae2c7ec66a22dc46 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:33.934932 13676 consensus_peers.cc:597] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d -> Peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Couldn't send request to peer bb6b8f66c52744ac8ff012bf0d73ebc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.936064  3725 tablet_replica.cc:333] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.936666  3725 raft_consensus.cc:2243] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.937151  3725 raft_consensus.cc:2272] T 1f38719a66ea4410b5eded50d77c8b45 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.939487  3725 tablet_replica.cc:333] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.940094  3725 raft_consensus.cc:2243] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.940829  3725 raft_consensus.cc:2272] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.944137  3725 tablet_replica.cc:333] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
W20260709 12:13:33.944288 13676 consensus_peers.cc:597] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d -> Peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Couldn't send request to peer bb6b8f66c52744ac8ff012bf0d73ebc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.945058  3725 raft_consensus.cc:2243] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.945999  3725 raft_consensus.cc:2272] T 6ae18c2b785940d89525f0331475c389 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.948302  3725 tablet_replica.cc:333] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.948828  3725 raft_consensus.cc:2243] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.949401  3725 raft_consensus.cc:2272] T 7d36c39a65a84310be2ebbdbe622b3b3 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.951906  3725 tablet_replica.cc:333] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.952419  3725 raft_consensus.cc:2243] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.953701  3725 raft_consensus.cc:2272] T 9f3baa3445c0463a9f4895f74fcf0133 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.956825  3725 tablet_replica.cc:333] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
W20260709 12:13:33.957048 13676 consensus_peers.cc:597] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d -> Peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Couldn't send request to peer bb6b8f66c52744ac8ff012bf0d73ebc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.957567  3725 raft_consensus.cc:2243] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.958331  3725 raft_consensus.cc:2272] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:33.959431 13678 consensus_peers.cc:597] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d -> Peer 9d8581c650864064b205d7288bf6b93f (127.3.163.65:38353): Couldn't send request to peer 9d8581c650864064b205d7288bf6b93f. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:38353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.960935  3725 tablet_replica.cc:333] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.961575  3725 raft_consensus.cc:2243] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.962103  3725 raft_consensus.cc:2272] T e56e14b0278a4128b5ae66ebc3d02a2b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.964359  3725 tablet_replica.cc:333] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.964891  3725 raft_consensus.cc:2243] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.965477  3725 raft_consensus.cc:2272] T 65e6f8655a55476b8b72cc7fc8ecff09 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.967880  3725 tablet_replica.cc:333] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.968427  3725 raft_consensus.cc:2243] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.968900  3725 raft_consensus.cc:2272] T 4350686a78994afcb21ad7f2746051c4 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.971158  3725 tablet_replica.cc:333] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.971679  3725 raft_consensus.cc:2243] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.972146  3725 raft_consensus.cc:2272] T d38ac31eefa0495aa61958063bc74f92 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.974360  3725 tablet_replica.cc:333] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.974805  3725 raft_consensus.cc:2243] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:33.975262  3725 raft_consensus.cc:2272] T 9380dee5565048cdbc48fea673b1a68b P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:33.977658  3725 tablet_replica.cc:333] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5: stopping tablet replica
I20260709 12:13:33.978082  3725 raft_consensus.cc:2243] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:33.978889  3725 raft_consensus.cc:2272] T e12a86912b804d989dab9941271b4950 P bb6b8f66c52744ac8ff012bf0d73ebc5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:34.013224 13676 consensus_peers.cc:597] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d -> Peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Couldn't send request to peer bb6b8f66c52744ac8ff012bf0d73ebc5. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.023298  3725 tablet_server.cc:196] TabletServer@127.3.163.66:0 shutdown complete.
I20260709 12:13:34.066031  3725 tablet_server.cc:179] TabletServer@127.3.163.67:0 shutting down...
W20260709 12:13:34.088213 13676 consensus_peers.cc:597] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d -> Peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Couldn't send request to peer bb6b8f66c52744ac8ff012bf0d73ebc5. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.095336 13676 consensus_peers.cc:597] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d -> Peer bb6b8f66c52744ac8ff012bf0d73ebc5 (127.3.163.66:43977): Couldn't send request to peer bb6b8f66c52744ac8ff012bf0d73ebc5. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:43977: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.102619  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:34.103513  3725 tablet_replica.cc:333] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.104614  3725 raft_consensus.cc:2243] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.105389  3725 raft_consensus.cc:2272] T a5c854ef7d734ecba708b4f91e84b9e8 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.108794  3725 tablet_replica.cc:333] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.109767  3725 raft_consensus.cc:2243] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.110433  3725 raft_consensus.cc:2272] T 19729132336640fda7253b5b55ed3c2d P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.113476  3725 tablet_replica.cc:333] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.114291  3725 raft_consensus.cc:2243] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.114945  3725 raft_consensus.cc:2272] T 0c19bdb921d54b95a514a69f0f908180 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.117890  3725 tablet_replica.cc:333] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.118598  3725 raft_consensus.cc:2243] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.119727  3725 raft_consensus.cc:2272] T b8bf8f2978ad4c0ea5aaeb68f702ca3b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.122695  3725 tablet_replica.cc:333] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.123296  3725 raft_consensus.cc:2243] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.123831  3725 raft_consensus.cc:2272] T a41c2f73b4b14510bfca143979dd9858 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.126003  3725 tablet_replica.cc:333] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.126546  3725 raft_consensus.cc:2243] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.127362  3725 raft_consensus.cc:2272] T ce11809de5744c1dae2c7ec66a22dc46 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.129483  3725 tablet_replica.cc:333] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.129981  3725 raft_consensus.cc:2243] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.130435  3725 raft_consensus.cc:2272] T 1f38719a66ea4410b5eded50d77c8b45 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.132647  3725 tablet_replica.cc:333] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.133116  3725 raft_consensus.cc:2243] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.133896  3725 raft_consensus.cc:2272] T 0b2d9c253e3a4e6b965c0f7a6d63e107 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.136049  3725 tablet_replica.cc:333] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.136544  3725 raft_consensus.cc:2243] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.137089  3725 raft_consensus.cc:2272] T 7d36c39a65a84310be2ebbdbe622b3b3 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.139156  3725 tablet_replica.cc:333] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.139644  3725 raft_consensus.cc:2243] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.140054  3725 raft_consensus.cc:2272] T 9f3baa3445c0463a9f4895f74fcf0133 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.142203  3725 tablet_replica.cc:333] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.142892  3725 raft_consensus.cc:2243] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.143422  3725 raft_consensus.cc:2272] T 9380dee5565048cdbc48fea673b1a68b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.145541  3725 tablet_replica.cc:333] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.146011  3725 raft_consensus.cc:2243] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.146437  3725 raft_consensus.cc:2272] T d38ac31eefa0495aa61958063bc74f92 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.148484  3725 tablet_replica.cc:333] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.149067  3725 raft_consensus.cc:2243] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.149493  3725 raft_consensus.cc:2272] T e12a86912b804d989dab9941271b4950 P 69f8cd7011784b0e977a7509c867ff9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.151597  3725 tablet_replica.cc:333] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.152067  3725 raft_consensus.cc:2243] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.152536  3725 raft_consensus.cc:2272] T 6ae18c2b785940d89525f0331475c389 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.154583  3725 tablet_replica.cc:333] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.155055  3725 raft_consensus.cc:2243] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.155910  3725 raft_consensus.cc:2272] T 65de0ea4b2eb4dd29b48e169dbf3e9a6 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.158136  3725 tablet_replica.cc:333] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.158598  3725 raft_consensus.cc:2243] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.159387  3725 raft_consensus.cc:2272] T e56e14b0278a4128b5ae66ebc3d02a2b P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.161572  3725 tablet_replica.cc:333] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.162006  3725 raft_consensus.cc:2243] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.162563  3725 raft_consensus.cc:2272] T 65e6f8655a55476b8b72cc7fc8ecff09 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.164779  3725 tablet_replica.cc:333] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d: stopping tablet replica
I20260709 12:13:34.165273  3725 raft_consensus.cc:2243] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.166030  3725 raft_consensus.cc:2272] T 4350686a78994afcb21ad7f2746051c4 P 69f8cd7011784b0e977a7509c867ff9d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.205405  3725 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13734)
I20260709 12:13:36.054404  3725 tablet_server.cc:196] TabletServer@127.3.163.67:0 shutdown complete.
I20260709 12:13:36.088848  3725 master.cc:562] Master@127.3.163.126:36891 shutting down...
I20260709 12:13:36.111864  3725 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:36.112430  3725 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:36.112746  3725 tablet_replica.cc:333] T 00000000000000000000000000000000 P 099aff5687304168bff38aa776f4581e: stopping tablet replica
I20260709 12:13:36.132134  3725 master.cc:584] Master@127.3.163.126:36891 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (22678 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:13:36.181154  3725 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.163.126:42641
I20260709 12:13:36.182181  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:36.187179 14057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.187305 14056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.188200 14059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.189579  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:36.190467  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:36.190683  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:36.190834  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599216190816 us; error 0 us; skew 500 ppm
I20260709 12:13:36.191306  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:36.193434  3725 webserver.cc:533] Webserver started at http://127.3.163.126:36247/ using document root <none> and password file <none>
I20260709 12:13:36.193859  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:36.194020  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:36.194255  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:36.195276  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/master-0-root/instance:
uuid: "41d04d6d918a48f6a2f58ebfbea7bed4"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-s43n"
I20260709 12:13:36.199260  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:13:36.202255 14064 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.202891  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:13:36.203140  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/master-0-root
uuid: "41d04d6d918a48f6a2f58ebfbea7bed4"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-s43n"
I20260709 12:13:36.203374  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:36.213904  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:36.214920  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:36.249615  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.126:42641
I20260709 12:13:36.249727 14115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.126:42641 every 8 connection(s)
I20260709 12:13:36.253197 14116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.264041 14116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4: Bootstrap starting.
I20260709 12:13:36.268783 14116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.272571 14116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4: No bootstrap required, opened a new log
I20260709 12:13:36.274638 14116 raft_consensus.cc:359] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d04d6d918a48f6a2f58ebfbea7bed4" member_type: VOTER }
I20260709 12:13:36.275051 14116 raft_consensus.cc:385] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.275226 14116 raft_consensus.cc:740] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d04d6d918a48f6a2f58ebfbea7bed4, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.275723 14116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d04d6d918a48f6a2f58ebfbea7bed4" member_type: VOTER }
I20260709 12:13:36.276149 14116 raft_consensus.cc:399] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:36.276361 14116 raft_consensus.cc:493] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:36.276571 14116 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:36.280607 14116 raft_consensus.cc:515] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d04d6d918a48f6a2f58ebfbea7bed4" member_type: VOTER }
I20260709 12:13:36.281068 14116 leader_election.cc:304] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41d04d6d918a48f6a2f58ebfbea7bed4; no voters: 
I20260709 12:13:36.282024 14116 leader_election.cc:290] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:36.282373 14119 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:36.283535 14119 raft_consensus.cc:697] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 1 LEADER]: Becoming Leader. State: Replica: 41d04d6d918a48f6a2f58ebfbea7bed4, State: Running, Role: LEADER
I20260709 12:13:36.284178 14119 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d04d6d918a48f6a2f58ebfbea7bed4" member_type: VOTER }
I20260709 12:13:36.284686 14116 sys_catalog.cc:565] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:36.289165 14121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41d04d6d918a48f6a2f58ebfbea7bed4. Latest consensus state: current_term: 1 leader_uuid: "41d04d6d918a48f6a2f58ebfbea7bed4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d04d6d918a48f6a2f58ebfbea7bed4" member_type: VOTER } }
I20260709 12:13:36.289780 14121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:36.290030 14120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41d04d6d918a48f6a2f58ebfbea7bed4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41d04d6d918a48f6a2f58ebfbea7bed4" member_type: VOTER } }
I20260709 12:13:36.290563 14120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:36.291599 14127 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:36.296159 14127 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:36.298200  3725 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:36.304327 14127 catalog_manager.cc:1383] Generated new cluster ID: 5e27395bd664414eb732c034cf7765dc
I20260709 12:13:36.304600 14127 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:36.324605 14127 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:36.325842 14127 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:36.339573 14127 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4: Generated new TSK 0
I20260709 12:13:36.340112 14127 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:36.364001  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:36.369274 14137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.370615 14138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.371872 14140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.372224  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:36.373116  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:36.373288  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:36.373404  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599216373393 us; error 0 us; skew 500 ppm
I20260709 12:13:36.373836  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:36.375737  3725 webserver.cc:533] Webserver started at http://127.3.163.65:35775/ using document root <none> and password file <none>
I20260709 12:13:36.376124  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:36.376266  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:36.376462  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:36.377556  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-0-root/instance:
uuid: "3b7ecc60066f4cbd9ba27353391146be"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-s43n"
I20260709 12:13:36.381402  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:36.384251 14145 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.384896  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:13:36.385162  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-0-root
uuid: "3b7ecc60066f4cbd9ba27353391146be"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-s43n"
I20260709 12:13:36.385412  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:36.437139  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:36.438202  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:36.439512  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:36.441561  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:36.441751  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.441958  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:36.442127  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.478993  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.65:44337
I20260709 12:13:36.479096 14207 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.65:44337 every 8 connection(s)
I20260709 12:13:36.483320  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:36.490446 14212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.490702 14213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.494112 14215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.494962  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:36.495764  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:36.495949  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:36.496104  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599216496077 us; error 0 us; skew 500 ppm
I20260709 12:13:36.496587  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:36.498723  3725 webserver.cc:533] Webserver started at http://127.3.163.66:40841/ using document root <none> and password file <none>
I20260709 12:13:36.499246  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:36.499473  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:36.499786  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:36.501204  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-1-root/instance:
uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-s43n"
I20260709 12:13:36.501335 14208 heartbeater.cc:344] Connected to a master server at 127.3.163.126:42641
I20260709 12:13:36.501739 14208 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:36.502367 14208 heartbeater.cc:507] Master 127.3.163.126:42641 requested a full tablet report, sending...
I20260709 12:13:36.504385 14081 ts_manager.cc:194] Registered new tserver with Master: 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337)
I20260709 12:13:36.506206  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:36.506685 14081 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60788
I20260709 12:13:36.509907 14220 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.510603  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:36.510833  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-1-root
uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-s43n"
I20260709 12:13:36.511046  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:36.531291  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:36.532267  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:36.533525  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:36.535506  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:36.535670  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.535899  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:36.536034  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.572522  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.66:38321
I20260709 12:13:36.572624 14282 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.66:38321 every 8 connection(s)
I20260709 12:13:36.576973  3725 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:36.582974 14286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.584407 14287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:36.585741 14289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:36.587486  3725 server_base.cc:1061] running on GCE node
I20260709 12:13:36.587587 14283 heartbeater.cc:344] Connected to a master server at 127.3.163.126:42641
I20260709 12:13:36.588135 14283 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:36.588680  3725 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:36.589027  3725 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:36.589048 14283 heartbeater.cc:507] Master 127.3.163.126:42641 requested a full tablet report, sending...
I20260709 12:13:36.589304  3725 hybrid_clock.cc:648] HybridClock initialized: now 1783599216589283 us; error 0 us; skew 500 ppm
I20260709 12:13:36.590106  3725 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:36.591315 14081 ts_manager.cc:194] Registered new tserver with Master: 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:36.592363  3725 webserver.cc:533] Webserver started at http://127.3.163.67:34541/ using document root <none> and password file <none>
I20260709 12:13:36.592893  3725 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:36.592836 14081 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60804
I20260709 12:13:36.593298  3725 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:36.593586  3725 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:36.594878  3725 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-2-root/instance:
uuid: "83908830118f4d05bad7445c0787e347"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-s43n"
I20260709 12:13:36.599012  3725 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:36.601954 14294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.602615  3725 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:36.602871  3725 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-2-root
uuid: "83908830118f4d05bad7445c0787e347"
format_stamp: "Formatted at 2026-07-09 12:13:36 on dist-test-slave-s43n"
I20260709 12:13:36.603119  3725 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskOIrchh/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598894987430-3725-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:36.614611  3725 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:36.615617  3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:36.616917  3725 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:36.618860  3725 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:36.619050  3725 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.619253  3725 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:36.619400  3725 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:36.655829  3725 rpc_server.cc:307] RPC server started. Bound to: 127.3.163.67:38565
I20260709 12:13:36.655925 14356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.163.67:38565 every 8 connection(s)
I20260709 12:13:36.668669 14357 heartbeater.cc:344] Connected to a master server at 127.3.163.126:42641
I20260709 12:13:36.669095 14357 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:36.669775 14357 heartbeater.cc:507] Master 127.3.163.126:42641 requested a full tablet report, sending...
I20260709 12:13:36.671486 14081 ts_manager.cc:194] Registered new tserver with Master: 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:36.671635  3725 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013036773s
I20260709 12:13:36.672770 14081 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60816
I20260709 12:13:36.694360 14081 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60826:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:36.696915 14081 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:36.770419 14173 tablet_service.cc:1511] Processing CreateTablet for tablet f1fe6f20f561487fb267d3a629481669 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:36.770924 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 865bd1a347b0463fbb3d141ae6987d56 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:36.772336 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865bd1a347b0463fbb3d141ae6987d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.773620 14170 tablet_service.cc:1511] Processing CreateTablet for tablet 82b6d036eac84e9785398d28b710f4e4 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:36.774946 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b6d036eac84e9785398d28b710f4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.777520 14169 tablet_service.cc:1511] Processing CreateTablet for tablet 7d07f3cdd4924349852444f47b2ff44d (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:36.778846 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d07f3cdd4924349852444f47b2ff44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.781515 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fe6f20f561487fb267d3a629481669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.772205 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 87871ccaf1dc47ae8f26dd9cd0ac25b4 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:36.785894 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87871ccaf1dc47ae8f26dd9cd0ac25b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.791208 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 63019e141ca9403cb7799475cca37657 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:36.792562 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63019e141ca9403cb7799475cca37657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.793841 14322 tablet_service.cc:1511] Processing CreateTablet for tablet f1fe6f20f561487fb267d3a629481669 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:36.794669 14319 tablet_service.cc:1511] Processing CreateTablet for tablet 82b6d036eac84e9785398d28b710f4e4 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:36.797533 14318 tablet_service.cc:1511] Processing CreateTablet for tablet 7d07f3cdd4924349852444f47b2ff44d (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:36.797945 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 865bd1a347b0463fbb3d141ae6987d56 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:36.796486 14167 tablet_service.cc:1511] Processing CreateTablet for tablet b272e04e516c4710b058f8cf232bd70a (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:36.800334 14320 tablet_service.cc:1511] Processing CreateTablet for tablet 87871ccaf1dc47ae8f26dd9cd0ac25b4 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:36.800654 14317 tablet_service.cc:1511] Processing CreateTablet for tablet 63019e141ca9403cb7799475cca37657 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:36.795197 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fe6f20f561487fb267d3a629481669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.802416 14318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d07f3cdd4924349852444f47b2ff44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.803229 14166 tablet_service.cc:1511] Processing CreateTablet for tablet 0652e1447ce34e63908d5de2879a3e70 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:36.804559 14166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652e1447ce34e63908d5de2879a3e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.808779 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b272e04e516c4710b058f8cf232bd70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.810312 14316 tablet_service.cc:1511] Processing CreateTablet for tablet b272e04e516c4710b058f8cf232bd70a (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:36.810824 14165 tablet_service.cc:1511] Processing CreateTablet for tablet cf4151f44d6246b4b76f45d638162081 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:36.812062 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4151f44d6246b4b76f45d638162081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.812080 14315 tablet_service.cc:1511] Processing CreateTablet for tablet 0652e1447ce34e63908d5de2879a3e70 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:36.813423 14314 tablet_service.cc:1511] Processing CreateTablet for tablet cf4151f44d6246b4b76f45d638162081 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:36.816752 14314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4151f44d6246b4b76f45d638162081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.817368 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865bd1a347b0463fbb3d141ae6987d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.818715 14316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b272e04e516c4710b058f8cf232bd70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.819900 14315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652e1447ce34e63908d5de2879a3e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.822242 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87871ccaf1dc47ae8f26dd9cd0ac25b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.825171 14317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63019e141ca9403cb7799475cca37657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.829159 14319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b6d036eac84e9785398d28b710f4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.881493 14373 tablet_bootstrap.cc:492] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:36.892608 14248 tablet_service.cc:1511] Processing CreateTablet for tablet f1fe6f20f561487fb267d3a629481669 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:36.893937 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fe6f20f561487fb267d3a629481669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.897899 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 865bd1a347b0463fbb3d141ae6987d56 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:36.899204 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 865bd1a347b0463fbb3d141ae6987d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.901890 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 87871ccaf1dc47ae8f26dd9cd0ac25b4 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:36.903141 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87871ccaf1dc47ae8f26dd9cd0ac25b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.905719 14245 tablet_service.cc:1511] Processing CreateTablet for tablet 82b6d036eac84e9785398d28b710f4e4 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:36.906952 14245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b6d036eac84e9785398d28b710f4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.909900 14244 tablet_service.cc:1511] Processing CreateTablet for tablet 7d07f3cdd4924349852444f47b2ff44d (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:36.911293 14244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d07f3cdd4924349852444f47b2ff44d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.913108 14243 tablet_service.cc:1511] Processing CreateTablet for tablet 63019e141ca9403cb7799475cca37657 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:36.914309 14243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63019e141ca9403cb7799475cca37657. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.917953 14242 tablet_service.cc:1511] Processing CreateTablet for tablet b272e04e516c4710b058f8cf232bd70a (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:36.919205 14242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b272e04e516c4710b058f8cf232bd70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.921033 14241 tablet_service.cc:1511] Processing CreateTablet for tablet 0652e1447ce34e63908d5de2879a3e70 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:36.922283 14241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652e1447ce34e63908d5de2879a3e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.925148 14240 tablet_service.cc:1511] Processing CreateTablet for tablet cf4151f44d6246b4b76f45d638162081 (DEFAULT_TABLE table=test-workload [id=92c98c6ececb459aafecd7c8f6c0bf00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:36.926370 14240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4151f44d6246b4b76f45d638162081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:36.927496 14373 tablet_bootstrap.cc:654] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:36.987254 14373 tablet_bootstrap.cc:492] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:36.987919 14373 ts_tablet_manager.cc:1403] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.019s
I20260709 12:13:36.990787 14373 raft_consensus.cc:359] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:36.991536 14373 raft_consensus.cc:385] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:36.992101 14373 raft_consensus.cc:740] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:36.993755 14373 consensus_queue.cc:260] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.018406 14373 ts_tablet_manager.cc:1434] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.005s
I20260709 12:13:37.019102 14372 tablet_bootstrap.cc:492] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.019223 14357 heartbeater.cc:499] Master 127.3.163.126:42641 was elected leader, sending a full tablet report...
I20260709 12:13:37.019465 14373 tablet_bootstrap.cc:492] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:37.025583 14373 tablet_bootstrap.cc:654] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.030764 14375 tablet_bootstrap.cc:492] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.034504 14372 tablet_bootstrap.cc:654] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.038106 14375 tablet_bootstrap.cc:654] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.054090 14373 tablet_bootstrap.cc:492] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:37.054468 14373 ts_tablet_manager.cc:1403] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.020s
I20260709 12:13:37.054587 14372 tablet_bootstrap.cc:492] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.055109 14372 ts_tablet_manager.cc:1403] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.005s
I20260709 12:13:37.055318 14375 tablet_bootstrap.cc:492] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:37.055786 14375 ts_tablet_manager.cc:1403] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.009s
I20260709 12:13:37.056571 14373 raft_consensus.cc:359] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.057144 14373 raft_consensus.cc:385] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.057355 14373 raft_consensus.cc:740] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.057976 14373 consensus_queue.cc:260] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.057920 14372 raft_consensus.cc:359] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.058441 14375 raft_consensus.cc:359] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.058842 14372 raft_consensus.cc:385] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.059226 14375 raft_consensus.cc:385] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.059305 14372 raft_consensus.cc:740] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.059655 14375 raft_consensus.cc:740] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.060048 14373 ts_tablet_manager.cc:1434] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:37.060384 14375 consensus_queue.cc:260] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.060418 14372 consensus_queue.cc:260] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.061089 14373 tablet_bootstrap.cc:492] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:37.067823 14373 tablet_bootstrap.cc:654] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.069933 14372 ts_tablet_manager.cc:1434] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 12:13:37.071389 14283 heartbeater.cc:499] Master 127.3.163.126:42641 was elected leader, sending a full tablet report...
I20260709 12:13:37.071890 14375 ts_tablet_manager.cc:1434] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.008s
I20260709 12:13:37.072830 14375 tablet_bootstrap.cc:492] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.073586 14208 heartbeater.cc:499] Master 127.3.163.126:42641 was elected leader, sending a full tablet report...
I20260709 12:13:37.074867 14373 tablet_bootstrap.cc:492] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:37.075407 14373 ts_tablet_manager.cc:1403] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.015s	user 0.002s	sys 0.011s
W20260709 12:13:37.076305 14284 tablet.cc:2406] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:37.078188 14373 raft_consensus.cc:359] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.078877 14373 raft_consensus.cc:385] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.079183 14373 raft_consensus.cc:740] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.080169 14375 tablet_bootstrap.cc:654] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.079936 14373 consensus_queue.cc:260] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.081333 14372 tablet_bootstrap.cc:492] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.084079 14373 ts_tablet_manager.cc:1434] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:37.085115 14373 tablet_bootstrap.cc:492] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:37.090952 14373 tablet_bootstrap.cc:654] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.091746 14375 tablet_bootstrap.cc:492] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:37.092283 14375 ts_tablet_manager.cc:1403] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:13:37.095008 14375 raft_consensus.cc:359] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.095798 14375 raft_consensus.cc:385] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.096139 14375 raft_consensus.cc:740] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.097015 14375 consensus_queue.cc:260] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.099014 14375 ts_tablet_manager.cc:1434] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:13:37.099936 14375 tablet_bootstrap.cc:492] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.105993 14375 tablet_bootstrap.cc:654] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.107005 14373 tablet_bootstrap.cc:492] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:37.107514 14373 ts_tablet_manager.cc:1403] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.009s
I20260709 12:13:37.107851 14372 tablet_bootstrap.cc:654] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.110500 14373 raft_consensus.cc:359] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.111248 14373 raft_consensus.cc:385] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.111564 14373 raft_consensus.cc:740] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.112386 14373 consensus_queue.cc:260] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.114868 14373 ts_tablet_manager.cc:1434] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:37.115911 14373 tablet_bootstrap.cc:492] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:37.120796 14372 tablet_bootstrap.cc:492] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.121495 14372 ts_tablet_manager.cc:1403] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.003s
I20260709 12:13:37.121908 14373 tablet_bootstrap.cc:654] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.124284 14372 raft_consensus.cc:359] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.125164 14372 raft_consensus.cc:385] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.125485 14372 raft_consensus.cc:740] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.126340 14372 consensus_queue.cc:260] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.128212 14373 tablet_bootstrap.cc:492] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:37.128764 14372 ts_tablet_manager.cc:1434] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:37.129281 14375 tablet_bootstrap.cc:492] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:37.129791 14375 ts_tablet_manager.cc:1403] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 12:13:37.129808 14372 tablet_bootstrap.cc:492] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.130120 14373 ts_tablet_manager.cc:1403] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.001s
I20260709 12:13:37.133091 14373 raft_consensus.cc:359] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.133819 14373 raft_consensus.cc:385] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.134182 14373 raft_consensus.cc:740] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.135010 14373 consensus_queue.cc:260] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.136580 14372 tablet_bootstrap.cc:654] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.137115 14373 ts_tablet_manager.cc:1434] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:13:37.138108 14373 tablet_bootstrap.cc:492] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:37.141924 14375 raft_consensus.cc:359] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.142653 14375 raft_consensus.cc:385] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.142794 14372 tablet_bootstrap.cc:492] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.142959 14375 raft_consensus.cc:740] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.143361 14372 ts_tablet_manager.cc:1403] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:13:37.144014 14373 tablet_bootstrap.cc:654] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.143941 14375 consensus_queue.cc:260] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.146273 14372 raft_consensus.cc:359] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.147010 14372 raft_consensus.cc:385] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.147305 14372 raft_consensus.cc:740] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.148176 14372 consensus_queue.cc:260] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.149467 14375 ts_tablet_manager.cc:1434] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:13:37.150610 14375 tablet_bootstrap.cc:492] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.152603 14372 ts_tablet_manager.cc:1434] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:37.153667 14372 tablet_bootstrap.cc:492] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.155911 14376 raft_consensus.cc:493] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.156427 14376 raft_consensus.cc:515] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.159610 14372 tablet_bootstrap.cc:654] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.167141 14376 leader_election.cc:290] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.175932 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
W20260709 12:13:37.177867 14295 leader_election.cc:343] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.185623 14375 tablet_bootstrap.cc:654] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.185767 14376 raft_consensus.cc:493] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.186609 14376 raft_consensus.cc:515] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.189946 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63019e141ca9403cb7799475cca37657" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.190541 14258 raft_consensus.cc:2468] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:37.191324 14373 tablet_bootstrap.cc:492] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:37.191257 14376 leader_election.cc:290] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.191639 14295 leader_election.cc:304] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.191955 14373 ts_tablet_manager.cc:1403] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.037s
I20260709 12:13:37.191973 14376 raft_consensus.cc:493] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.192710 14376 raft_consensus.cc:515] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.194703 14376 leader_election.cc:290] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.195152 14376 raft_consensus.cc:2804] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.195557 14376 raft_consensus.cc:493] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.195770 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.195876 14376 raft_consensus.cc:3060] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:37.197139 14295 leader_election.cc:343] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.192188 14372 tablet_bootstrap.cc:492] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.197518 14375 tablet_bootstrap.cc:492] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:37.198055 14372 ts_tablet_manager.cc:1403] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.020s
I20260709 12:13:37.198097 14375 ts_tablet_manager.cc:1403] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.000s
I20260709 12:13:37.198189 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.200322 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63019e141ca9403cb7799475cca37657" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.200927 14183 raft_consensus.cc:2468] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:37.201063 14372 raft_consensus.cc:359] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.201412 14375 raft_consensus.cc:359] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.201908 14372 raft_consensus.cc:385] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.202131 14375 raft_consensus.cc:385] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.202275 14372 raft_consensus.cc:740] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.202503 14375 raft_consensus.cc:740] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.202548 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.203184 14376 raft_consensus.cc:515] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.203413 14375 consensus_queue.cc:260] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
W20260709 12:13:37.203890 14296 leader_election.cc:343] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.203413 14372 consensus_queue.cc:260] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.204473 14296 leader_election.cc:304] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:37.205521 14376 leader_election.cc:290] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
W20260709 12:13:37.206075 14296 leader_election.cc:343] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.206050 14376 raft_consensus.cc:2749] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:37.206578 14296 leader_election.cc:304] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:37.208114 14375 ts_tablet_manager.cc:1434] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:13:37.208091 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63019e141ca9403cb7799475cca37657" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:37.208506 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63019e141ca9403cb7799475cca37657" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:37.208855 14258 raft_consensus.cc:3060] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.209157 14183 raft_consensus.cc:3060] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.209347 14375 tablet_bootstrap.cc:492] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.215816 14375 tablet_bootstrap.cc:654] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.216509 14183 raft_consensus.cc:2468] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:37.195139 14373 raft_consensus.cc:359] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.217535 14373 raft_consensus.cc:385] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.217046 14376 raft_consensus.cc:2749] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:37.217836 14373 raft_consensus.cc:740] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.218268 14296 leader_election.cc:304] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.218619 14373 consensus_queue.cc:260] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.219285 14376 raft_consensus.cc:2804] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.221791 14258 raft_consensus.cc:2468] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:37.224640 14372 ts_tablet_manager.cc:1434] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:13:37.226701 14376 raft_consensus.cc:697] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:37.227628 14376 consensus_queue.cc:237] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.228513 14373 ts_tablet_manager.cc:1434] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:13:37.229691 14373 tablet_bootstrap.cc:492] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:37.231679 14372 tablet_bootstrap.cc:492] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.236109 14373 tablet_bootstrap.cc:654] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.244553 14372 tablet_bootstrap.cc:654] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.245070 14375 tablet_bootstrap.cc:492] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:37.245638 14375 ts_tablet_manager.cc:1403] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.022s
I20260709 12:13:37.248895 14375 raft_consensus.cc:359] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.249680 14375 raft_consensus.cc:385] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.250036 14375 raft_consensus.cc:740] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.251003 14375 consensus_queue.cc:260] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.252395 14079 catalog_manager.cc:5697] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.260203 14375 ts_tablet_manager.cc:1434] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.006s
I20260709 12:13:37.264768 14381 raft_consensus.cc:493] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.265344 14381 raft_consensus.cc:515] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.270570 14381 leader_election.cc:290] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.271600 14375 tablet_bootstrap.cc:492] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.278650 14375 tablet_bootstrap.cc:654] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.279210 14373 tablet_bootstrap.cc:492] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:37.279739 14373 ts_tablet_manager.cc:1403] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.022s
I20260709 12:13:37.284001 14373 raft_consensus.cc:359] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.285058 14373 raft_consensus.cc:385] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.285395 14373 raft_consensus.cc:740] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.286227 14373 consensus_queue.cc:260] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.289026 14373 ts_tablet_manager.cc:1434] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.006s
I20260709 12:13:37.289390 14380 raft_consensus.cc:493] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.290112 14373 tablet_bootstrap.cc:492] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:37.289965 14380 raft_consensus.cc:515] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.295373 14380 leader_election.cc:290] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.297238 14373 tablet_bootstrap.cc:654] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.303279 14381 raft_consensus.cc:493] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.303840 14381 raft_consensus.cc:515] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.306142 14381 leader_election.cc:290] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.312772 14381 raft_consensus.cc:493] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.313256 14381 raft_consensus.cc:515] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.315296 14381 leader_election.cc:290] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.321169 14373 tablet_bootstrap.cc:492] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:37.321301 14376 raft_consensus.cc:493] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.321727 14373 ts_tablet_manager.cc:1403] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.013s
I20260709 12:13:37.321885 14376 raft_consensus.cc:515] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.324190 14376 leader_election.cc:290] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.324882 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.324366 14373 raft_consensus.cc:359] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.326136 14373 raft_consensus.cc:385] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:37.326331 14296 leader_election.cc:343] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.326419 14373 raft_consensus.cc:740] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.286635 14372 tablet_bootstrap.cc:492] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.328321 14372 ts_tablet_manager.cc:1403] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.097s	user 0.019s	sys 0.022s
I20260709 12:13:37.328444 14373 consensus_queue.cc:260] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.330128 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.330874 14258 raft_consensus.cc:2468] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:37.330399 14373 ts_tablet_manager.cc:1434] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:37.332006 14295 leader_election.cc:304] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:37.333115 14373 tablet_bootstrap.cc:492] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:37.333082 14376 raft_consensus.cc:2804] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.333519 14376 raft_consensus.cc:493] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.333827 14376 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.338969 14373 tablet_bootstrap.cc:654] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.341115 14376 raft_consensus.cc:515] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.344216 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
W20260709 12:13:37.345876 14296 leader_election.cc:343] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.348067 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:37.348654 14258 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.351835 14372 raft_consensus.cc:359] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.352658 14372 raft_consensus.cc:385] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.353040 14372 raft_consensus.cc:740] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.354004 14372 consensus_queue.cc:260] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.356603 14258 raft_consensus.cc:2468] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:37.357888 14295 leader_election.cc:304] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:37.358852 14376 leader_election.cc:290] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.359346 14394 raft_consensus.cc:2804] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.359934 14394 raft_consensus.cc:697] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:37.360800 14394 consensus_queue.cc:237] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.369326 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.370055 14332 raft_consensus.cc:2468] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:37.370266 14380 raft_consensus.cc:493] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.370757 14380 raft_consensus.cc:515] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.372239 14148 leader_election.cc:304] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.372759 14380 leader_election.cc:290] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.373090 14381 raft_consensus.cc:2804] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.375211 14381 raft_consensus.cc:493] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.375555 14381 raft_consensus.cc:3060] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.373288 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865bd1a347b0463fbb3d141ae6987d56" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.373719 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.382654 14330 raft_consensus.cc:2468] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:37.385176 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.385412 14381 raft_consensus.cc:515] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.385841 14183 raft_consensus.cc:2468] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 0.
I20260709 12:13:37.387456 14381 leader_election.cc:290] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.387588 14222 leader_election.cc:304] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:37.388768 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
W20260709 12:13:37.390213 14222 leader_election.cc:343] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:37.391585 14148 leader_election.cc:343] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.392280 14148 leader_election.cc:304] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.393666 14380 raft_consensus.cc:2804] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.398403 14380 raft_consensus.cc:493] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.398722 14380 raft_consensus.cc:3060] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.399359 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865bd1a347b0463fbb3d141ae6987d56" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.400005 14257 raft_consensus.cc:2468] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:37.401087 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.401197 14146 leader_election.cc:304] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 83908830118f4d05bad7445c0787e347
W20260709 12:13:37.392683 14129 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:37.402872 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.403959 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.404178 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.404328 14373 tablet_bootstrap.cc:492] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:37.393811 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:37.395380 14394 raft_consensus.cc:493] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.405473 14330 raft_consensus.cc:3060] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.405921 14394 raft_consensus.cc:515] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.407976 14394 leader_election.cc:290] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.404613 14331 raft_consensus.cc:2468] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 0.
I20260709 12:13:37.410085 14380 raft_consensus.cc:515] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.394353 14376 raft_consensus.cc:493] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.412863 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:37.414167 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.414783 14258 raft_consensus.cc:2468] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:37.413519 14183 raft_consensus.cc:3060] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.411386 14376 raft_consensus.cc:515] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.393788 14381 raft_consensus.cc:2804] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.404211 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:37.417874 14381 raft_consensus.cc:493] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.418218 14381 raft_consensus.cc:3060] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.419042 14295 leader_election.cc:304] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.412945 14332 raft_consensus.cc:2468] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 0.
I20260709 12:13:37.397346 14372 ts_tablet_manager.cc:1434] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.005s
I20260709 12:13:37.422053 14394 raft_consensus.cc:2804] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.422533 14394 raft_consensus.cc:493] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.422742 14223 leader_election.cc:304] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:37.423606 14330 raft_consensus.cc:2468] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:37.424932 14148 leader_election.cc:304] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.425103 14376 leader_election.cc:290] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.405055 14373 ts_tablet_manager.cc:1403] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.072s	user 0.045s	sys 0.021s
I20260709 12:13:37.424145 14394 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.428381 14373 raft_consensus.cc:359] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.396490 14375 tablet_bootstrap.cc:492] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:37.429159 14373 raft_consensus.cc:385] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.429548 14373 raft_consensus.cc:740] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.429500 14375 ts_tablet_manager.cc:1403] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.165s	user 0.028s	sys 0.044s
I20260709 12:13:37.430446 14373 consensus_queue.cc:260] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.432909 14373 ts_tablet_manager.cc:1434] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:37.434564 14183 raft_consensus.cc:2468] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 1.
I20260709 12:13:37.435802 14222 leader_election.cc:304] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:37.437444 14380 leader_election.cc:290] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.423349 14081 catalog_manager.cc:5697] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.438073 14380 raft_consensus.cc:2804] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.438449 14380 raft_consensus.cc:493] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.438786 14380 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.422052 14372 tablet_bootstrap.cc:492] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.436169 14375 raft_consensus.cc:359] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.441705 14375 raft_consensus.cc:385] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.442028 14375 raft_consensus.cc:740] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.442795 14375 consensus_queue.cc:260] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.447839 14394 raft_consensus.cc:515] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.452080 14381 raft_consensus.cc:515] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.453248 14375 ts_tablet_manager.cc:1434] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:13:37.454320 14375 tablet_bootstrap.cc:492] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.466445 14380 raft_consensus.cc:515] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.470185 14413 raft_consensus.cc:2804] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.470628 14413 raft_consensus.cc:493] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.470935 14413 raft_consensus.cc:3060] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.464767 14375 tablet_bootstrap.cc:654] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.468715 14380 leader_election.cc:290] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
W20260709 12:13:37.472951 14148 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:38565, user_credentials={real_user=slave}} blocked reactor thread for 48116.2us
W20260709 12:13:37.475378 14223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.67:38565, user_credentials={real_user=slave}} blocked reactor thread for 52833.5us
I20260709 12:13:37.476456 14394 leader_election.cc:290] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.477118 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:37.477718 14330 raft_consensus.cc:3060] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.479067 14372 tablet_bootstrap.cc:654] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.473003 14380 raft_consensus.cc:2804] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.483191 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:37.483554 14380 raft_consensus.cc:697] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:37.483870 14332 raft_consensus.cc:3060] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.484385 14380 consensus_queue.cc:237] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.484654 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:37.485641 14331 raft_consensus.cc:2393] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 71ca7f4e83cb41219e57b0f71945cc7f in current term 1: Already voted for candidate 83908830118f4d05bad7445c0787e347 in this term.
I20260709 12:13:37.488866 14381 leader_election.cc:290] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.489434 14381 raft_consensus.cc:2804] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.489487 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4151f44d6246b4b76f45d638162081" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.489925 14381 raft_consensus.cc:697] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:37.490150 14255 raft_consensus.cc:2468] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:37.490737 14381 consensus_queue.cc:237] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.491156 14295 leader_election.cc:304] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.491158 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:37.492841 14258 raft_consensus.cc:2393] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 83908830118f4d05bad7445c0787e347 in current term 1: Already voted for candidate 71ca7f4e83cb41219e57b0f71945cc7f in this term.
I20260709 12:13:37.493611 14394 raft_consensus.cc:2804] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.494048 14394 raft_consensus.cc:493] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.494382 14394 raft_consensus.cc:3060] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:37.501436 14146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.66:38321, user_credentials={real_user=slave}} blocked reactor thread for 100428us
I20260709 12:13:37.502996 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
W20260709 12:13:37.503479 14222 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.163.65:44337, user_credentials={real_user=slave}} blocked reactor thread for 67762.2us
I20260709 12:13:37.504895 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.505877 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:37.506443 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4151f44d6246b4b76f45d638162081" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.504142 14330 raft_consensus.cc:2468] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 1.
I20260709 12:13:37.507947 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:37.506855 14413 raft_consensus.cc:515] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
W20260709 12:13:37.509042 14146 leader_election.cc:343] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:37.510097 14146 leader_election.cc:343] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:37.511058 14146 leader_election.cc:343] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:37.507670 14222 leader_election.cc:343] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.511257 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865bd1a347b0463fbb3d141ae6987d56" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:37.512678 14331 raft_consensus.cc:3060] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:37.512849 14146 leader_election.cc:343] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:37.513953 14296 leader_election.cc:343] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.514721 14375 tablet_bootstrap.cc:492] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
W20260709 12:13:37.515126 14296 leader_election.cc:343] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.513160 14332 raft_consensus.cc:2468] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:37.515993 14413 leader_election.cc:290] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.506789 14394 raft_consensus.cc:515] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
W20260709 12:13:37.516623 14296 leader_election.cc:343] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.517067 14296 leader_election.cc:304] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:37.517748 14376 raft_consensus.cc:2749] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:37.520357 14148 leader_election.cc:304] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:37.515206 14375 ts_tablet_manager.cc:1403] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.001s
I20260709 12:13:37.521239 14381 raft_consensus.cc:2804] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.522289 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "865bd1a347b0463fbb3d141ae6987d56" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:37.522696 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4151f44d6246b4b76f45d638162081" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:37.523041 14258 raft_consensus.cc:3060] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.522917 14381 raft_consensus.cc:697] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:37.524072 14381 consensus_queue.cc:237] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
W20260709 12:13:37.525120 14296 leader_election.cc:343] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:37.526959 14375 raft_consensus.cc:359] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.528543 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4151f44d6246b4b76f45d638162081" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:37.530407 14255 raft_consensus.cc:3060] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.530702 14080 catalog_manager.cc:5697] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.533779 14258 raft_consensus.cc:2468] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:37.532117 14331 raft_consensus.cc:2468] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:37.536015 14148 leader_election.cc:304] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.527971 14375 raft_consensus.cc:385] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.537060 14375 raft_consensus.cc:740] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.537110 14413 raft_consensus.cc:2804] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.537923 14375 consensus_queue.cc:260] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.538472 14413 raft_consensus.cc:697] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:37.539412 14413 consensus_queue.cc:237] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.540198 14375 ts_tablet_manager.cc:1434] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.002s
I20260709 12:13:37.521118 14394 leader_election.cc:290] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:37.540148 14255 raft_consensus.cc:2468] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:37.541888 14295 leader_election.cc:304] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:37.543432 14394 raft_consensus.cc:2804] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.543807 14394 raft_consensus.cc:697] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:37.521891 14222 leader_election.cc:304] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347
I20260709 12:13:37.545781 14394 consensus_queue.cc:237] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.547719 14380 raft_consensus.cc:2749] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:37.549906 14375 tablet_bootstrap.cc:492] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.551952 14080 catalog_manager.cc:5697] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 1 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.564281 14079 catalog_manager.cc:5697] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.565640 14375 tablet_bootstrap.cc:654] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.559353 14372 tablet_bootstrap.cc:492] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.567667 14081 catalog_manager.cc:5697] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.568504 14372 ts_tablet_manager.cc:1403] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.147s	user 0.004s	sys 0.019s
I20260709 12:13:37.569340 14079 catalog_manager.cc:5697] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.571707 14372 raft_consensus.cc:359] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.572542 14372 raft_consensus.cc:385] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.572903 14372 raft_consensus.cc:740] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.573266 14375 tablet_bootstrap.cc:492] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:37.573782 14375 ts_tablet_manager.cc:1403] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 12:13:37.573844 14372 consensus_queue.cc:260] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.576215 14372 ts_tablet_manager.cc:1434] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:13:37.576151 14375 raft_consensus.cc:359] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.576916 14375 raft_consensus.cc:385] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.577234 14375 raft_consensus.cc:740] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.577433 14372 tablet_bootstrap.cc:492] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.577926 14375 consensus_queue.cc:260] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.579865 14375 ts_tablet_manager.cc:1434] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:37.580721 14375 tablet_bootstrap.cc:492] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:37.584619 14372 tablet_bootstrap.cc:654] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.585554 14375 tablet_bootstrap.cc:654] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.589527 14372 tablet_bootstrap.cc:492] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.590019 14372 ts_tablet_manager.cc:1403] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:13:37.590214 14375 tablet_bootstrap.cc:492] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:37.590734 14375 ts_tablet_manager.cc:1403] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:13:37.593137 14375 raft_consensus.cc:359] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.593047 14372 raft_consensus.cc:359] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.593900 14375 raft_consensus.cc:385] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.593992 14372 raft_consensus.cc:385] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.594249 14375 raft_consensus.cc:740] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.594355 14372 raft_consensus.cc:740] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.594961 14375 consensus_queue.cc:260] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.595075 14372 consensus_queue.cc:260] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.596935 14375 ts_tablet_manager.cc:1434] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:13:37.597222 14372 ts_tablet_manager.cc:1434] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:13:37.598176 14372 tablet_bootstrap.cc:492] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.601212 14380 raft_consensus.cc:493] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.601709 14380 raft_consensus.cc:515] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.603288 14372 tablet_bootstrap.cc:654] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.603586 14380 leader_election.cc:290] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.604218 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.604902 14183 raft_consensus.cc:2468] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 0.
I20260709 12:13:37.605046 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.606045 14331 raft_consensus.cc:2468] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 0.
I20260709 12:13:37.606832 14222 leader_election.cc:304] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:37.607606 14380 raft_consensus.cc:2804] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:37.607946 14380 raft_consensus.cc:493] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:37.608210 14380 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.613480 14372 tablet_bootstrap.cc:492] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.613840 14372 ts_tablet_manager.cc:1403] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.009s
I20260709 12:13:37.614248 14380 raft_consensus.cc:515] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.615846 14380 leader_election.cc:290] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.615689 14372 raft_consensus.cc:359] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.616403 14372 raft_consensus.cc:385] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.616686 14372 raft_consensus.cc:740] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.616719 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:37.616791 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:37.617451 14331 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.617560 14183 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.617565 14372 consensus_queue.cc:260] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.619695 14372 ts_tablet_manager.cc:1434] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:13:37.620604 14372 tablet_bootstrap.cc:492] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:37.623828 14331 raft_consensus.cc:2468] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 1.
I20260709 12:13:37.624547 14183 raft_consensus.cc:2468] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 1.
I20260709 12:13:37.624964 14223 leader_election.cc:304] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:37.626042 14372 tablet_bootstrap.cc:654] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:37.626488 14380 raft_consensus.cc:2804] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:37.626991 14380 raft_consensus.cc:697] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:37.627800 14380 consensus_queue.cc:237] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:37.631305 14372 tablet_bootstrap.cc:492] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:37.631860 14372 ts_tablet_manager.cc:1403] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:13:37.634092 14372 raft_consensus.cc:359] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.634708 14372 raft_consensus.cc:385] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:37.634968 14372 raft_consensus.cc:740] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:37.635617 14372 consensus_queue.cc:260] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.635353 14079 catalog_manager.cc:5697] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 1 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.637738 14372 ts_tablet_manager.cc:1434] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:13:37.654515 14380 raft_consensus.cc:493] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.654935 14380 raft_consensus.cc:515] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.656347 14380 leader_election.cc:290] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.657049 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.657285 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.658002 14331 raft_consensus.cc:2393] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71ca7f4e83cb41219e57b0f71945cc7f in current term 1: Already voted for candidate 3b7ecc60066f4cbd9ba27353391146be in this term.
I20260709 12:13:37.658911 14223 leader_election.cc:304] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347
I20260709 12:13:37.659636 14380 raft_consensus.cc:3060] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.660339 14394 consensus_queue.cc:1048] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.665293 14380 raft_consensus.cc:2749] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:37.672304 14392 consensus_queue.cc:1048] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.715337 14380 raft_consensus.cc:493] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.715718 14380 raft_consensus.cc:515] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.717372 14380 leader_election.cc:290] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.717909 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:37.718329 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.719048 14331 raft_consensus.cc:2393] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71ca7f4e83cb41219e57b0f71945cc7f in current term 1: Already voted for candidate 3b7ecc60066f4cbd9ba27353391146be in this term.
I20260709 12:13:37.719764 14223 leader_election.cc:304] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347
I20260709 12:13:37.720324 14380 raft_consensus.cc:3060] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.724911 14380 raft_consensus.cc:2749] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:37.743422 14381 raft_consensus.cc:493] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:37.743861 14381 raft_consensus.cc:515] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:37.745335 14381 leader_election.cc:290] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:37.745960 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:37.746146 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:37.746615 14255 raft_consensus.cc:2393] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b7ecc60066f4cbd9ba27353391146be in current term 1: Already voted for candidate 71ca7f4e83cb41219e57b0f71945cc7f in this term.
I20260709 12:13:37.746775 14331 raft_consensus.cc:2393] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b7ecc60066f4cbd9ba27353391146be in current term 1: Already voted for candidate 83908830118f4d05bad7445c0787e347 in this term.
I20260709 12:13:37.747618 14148 leader_election.cc:304] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be; no voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347
I20260709 12:13:37.748168 14381 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.752509 14381 raft_consensus.cc:2749] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:37.803814 14392 consensus_queue.cc:1048] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.811515 14183 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.819314 14394 consensus_queue.cc:1048] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.882828 14380 consensus_queue.cc:1048] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.892588 14414 consensus_queue.cc:1048] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:37.928158 14381 consensus_queue.cc:1048] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.937276 14394 consensus_queue.cc:1048] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.940110 14381 consensus_queue.cc:1048] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.951020 14183 raft_consensus.cc:3060] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:37.958156 14394 consensus_queue.cc:1048] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:37.992503 14381 consensus_queue.cc:1048] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.002180 14413 consensus_queue.cc:1048] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.037148 14413 consensus_queue.cc:1048] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.037739 14414 consensus_queue.cc:1048] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.047926 14381 consensus_queue.cc:1048] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:38.053845 14380 consensus_queue.cc:1048] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:38.405645 14129 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:39.036303 14394 raft_consensus.cc:493] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:39.036787 14394 raft_consensus.cc:515] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.038856 14394 leader_election.cc:290] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:39.039139 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:39.039348 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:39.039819 14183 raft_consensus.cc:2468] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:39.040011 14258 raft_consensus.cc:2468] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:39.040927 14296 leader_election.cc:304] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:39.041550 14394 raft_consensus.cc:2804] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.041833 14394 raft_consensus.cc:493] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:39.042083 14394 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.047006 14394 raft_consensus.cc:515] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.048418 14394 leader_election.cc:290] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:39.049145 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:39.049530 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:39.049731 14183 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.050086 14258 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.056591 14258 raft_consensus.cc:2468] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 2.
I20260709 12:13:39.056591 14183 raft_consensus.cc:2468] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 2.
I20260709 12:13:39.057785 14296 leader_election.cc:304] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:39.058372 14394 raft_consensus.cc:2804] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.058732 14394 raft_consensus.cc:697] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 2 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:39.059363 14394 consensus_queue.cc:237] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.065768 14080 catalog_manager.cc:5697] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 0 to 2, leader changed from <none> to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 2 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:39.462423 14258 raft_consensus.cc:1275] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Refusing update from remote peer 83908830118f4d05bad7445c0787e347: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:39.463748 14394 consensus_queue.cc:1048] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:39.472393 14258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
mode: GRACEFUL
new_leader_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:34026
I20260709 12:13:39.473173 14258 raft_consensus.cc:606] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Received request to transfer leadership to TS 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:39.481096 14183 raft_consensus.cc:1275] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 83908830118f4d05bad7445c0787e347: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:39.483279 14376 consensus_queue.cc:1048] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:39.489166 14255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
mode: GRACEFUL
new_leader_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:34026
I20260709 12:13:39.489720 14255 raft_consensus.cc:606] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Received request to transfer leadership to TS 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:39.510337 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4"
dest_uuid: "83908830118f4d05bad7445c0787e347"
mode: GRACEFUL
new_leader_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:56744
I20260709 12:13:39.510815 14331 raft_consensus.cc:606] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 2 LEADER]: Received request to transfer leadership to TS 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:39.521668 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
mode: GRACEFUL
new_leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:57898
I20260709 12:13:39.522084 14183 raft_consensus.cc:606] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Received request to transfer leadership to TS 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:39.526048 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63019e141ca9403cb7799475cca37657"
dest_uuid: "83908830118f4d05bad7445c0787e347"
mode: GRACEFUL
new_leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:56744
I20260709 12:13:39.526458 14331 raft_consensus.cc:606] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Received request to transfer leadership to TS 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:39.530507 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a"
dest_uuid: "83908830118f4d05bad7445c0787e347"
mode: GRACEFUL
new_leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:56744
I20260709 12:13:39.530892 14331 raft_consensus.cc:606] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Received request to transfer leadership to TS 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:39.534970 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
mode: GRACEFUL
new_leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:57898
I20260709 12:13:39.535483 14183 raft_consensus.cc:606] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Received request to transfer leadership to TS 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:39.630923 14463 raft_consensus.cc:993] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f: : Instructing follower 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:39.631351 14380 raft_consensus.cc:1081] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Signalling peer 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:39.632781 14183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:51480
I20260709 12:13:39.633244 14183 raft_consensus.cc:493] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.633505 14183 raft_consensus.cc:3060] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.638106 14183 raft_consensus.cc:515] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.639901 14183 leader_election.cc:290] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 2 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:39.640255 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:39.640403 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87871ccaf1dc47ae8f26dd9cd0ac25b4" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:39.640795 14258 raft_consensus.cc:3055] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.641053 14331 raft_consensus.cc:3060] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.641163 14258 raft_consensus.cc:740] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:39.641888 14258 consensus_queue.cc:260] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.642791 14258 raft_consensus.cc:3060] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.645547 14331 raft_consensus.cc:2468] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 2.
I20260709 12:13:39.646493 14148 leader_election.cc:304] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:39.647083 14413 raft_consensus.cc:2804] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.647431 14258 raft_consensus.cc:2468] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 2.
I20260709 12:13:39.647913 14413 raft_consensus.cc:697] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:39.648684 14413 consensus_queue.cc:237] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.655006 14080 catalog_manager.cc:5697] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 1 to 2, leader changed from 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66) to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 2 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.675700 14464 raft_consensus.cc:993] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be: : Instructing follower 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:39.676126 14413 raft_consensus.cc:1081] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Signalling peer 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:39.677506 14255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:55554
I20260709 12:13:39.678035 14255 raft_consensus.cc:493] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.678261 14394 raft_consensus.cc:993] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347: : Instructing follower 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:39.678376 14255 raft_consensus.cc:3060] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.678793 14457 raft_consensus.cc:1081] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Signalling peer 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:39.680135 14258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63019e141ca9403cb7799475cca37657"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:55540
I20260709 12:13:39.680522 14258 raft_consensus.cc:493] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.680776 14258 raft_consensus.cc:3060] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.683434 14255 raft_consensus.cc:515] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.685149 14255 leader_election.cc:290] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:39.685148 14258 raft_consensus.cc:515] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.685789 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:39.686180 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d07f3cdd4924349852444f47b2ff44d" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:39.686358 14183 raft_consensus.cc:3055] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.686762 14183 raft_consensus.cc:740] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:39.686666 14331 raft_consensus.cc:3060] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.687812 14258 leader_election.cc:290] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:39.687566 14183 consensus_queue.cc:260] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.689159 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63019e141ca9403cb7799475cca37657" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:39.688898 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63019e141ca9403cb7799475cca37657" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:39.690346 14332 raft_consensus.cc:3055] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.688798 14183 raft_consensus.cc:3060] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.690315 14182 raft_consensus.cc:3060] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.690779 14332 raft_consensus.cc:740] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:39.691644 14332 consensus_queue.cc:260] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.692889 14332 raft_consensus.cc:3060] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.693161 14331 raft_consensus.cc:2468] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:39.694247 14223 leader_election.cc:304] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:39.694916 14380 raft_consensus.cc:2804] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.698701 14463 raft_consensus.cc:993] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f: : Instructing follower 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:39.698962 14182 raft_consensus.cc:2468] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:39.699126 14463 raft_consensus.cc:1081] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Signalling peer 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:39.699771 14332 raft_consensus.cc:2468] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:39.700999 14223 leader_election.cc:304] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:39.701875 14182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:51480
I20260709 12:13:39.702091 14463 raft_consensus.cc:2804] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.702586 14182 raft_consensus.cc:493] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.702618 14463 raft_consensus.cc:697] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:39.703720 14463 consensus_queue.cc:237] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.705057 14394 raft_consensus.cc:993] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347: : Instructing follower 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:39.705533 14457 raft_consensus.cc:1081] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Signalling peer 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:39.706058 14183 raft_consensus.cc:2468] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:39.707242 14182 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.707254 14258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:55540
I20260709 12:13:39.707930 14380 raft_consensus.cc:697] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:39.708015 14258 raft_consensus.cc:493] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.708685 14258 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.708969 14380 consensus_queue.cc:237] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.713681 14182 raft_consensus.cc:515] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:39.715433 14258 raft_consensus.cc:515] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.716349 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:39.717043 14332 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.717360 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:39.717935 14255 raft_consensus.cc:3055] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.718214 14255 raft_consensus.cc:740] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:39.718955 14255 consensus_queue.cc:260] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:39.719513 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:39.720112 14255 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.719704 14080 catalog_manager.cc:5697] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 1 to 2, leader changed from 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65) to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 2 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.720643 14258 leader_election.cc:290] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:39.721895 14182 leader_election.cc:290] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 2 election: Requested vote from peers 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:39.722543 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:39.723114 14331 raft_consensus.cc:3055] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.723421 14331 raft_consensus.cc:740] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:39.724166 14331 consensus_queue.cc:260] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.720155 14183 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.725284 14332 raft_consensus.cc:2468] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 2.
I20260709 12:13:39.726365 14148 leader_election.cc:304] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:39.726908 14331 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.727226 14413 raft_consensus.cc:2804] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.727773 14413 raft_consensus.cc:697] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:39.728658 14413 consensus_queue.cc:237] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:39.733608 14331 raft_consensus.cc:2468] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:39.733673 14183 raft_consensus.cc:2468] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:39.733860 14255 raft_consensus.cc:2468] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 2.
I20260709 12:13:39.735239 14222 leader_election.cc:304] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:39.736501 14380 raft_consensus.cc:2804] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.736291 14080 catalog_manager.cc:5697] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 1 to 2, leader changed from 83908830118f4d05bad7445c0787e347 (127.3.163.67) to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 2 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.737012 14380 raft_consensus.cc:697] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:39.737864 14380 consensus_queue.cc:237] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.740290 14079 catalog_manager.cc:5697] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 1 to 2, leader changed from 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66) to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 2 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.748857 14079 catalog_manager.cc:5697] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 1 to 2, leader changed from 83908830118f4d05bad7445c0787e347 (127.3.163.67) to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 2 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.887455 14457 raft_consensus.cc:993] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347: : Instructing follower 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:39.887645 14464 raft_consensus.cc:993] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be: : Instructing follower 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:39.888006 14394 raft_consensus.cc:1081] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 2 LEADER]: Signalling peer 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:39.888192 14413 raft_consensus.cc:1081] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Signalling peer 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:39.889428 14183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:51472
I20260709 12:13:39.889981 14255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:55554
I20260709 12:13:39.890082 14183 raft_consensus.cc:493] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.890479 14255 raft_consensus.cc:493] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:39.890540 14183 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.890826 14255 raft_consensus.cc:3060] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.895603 14183 raft_consensus.cc:515] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.895864 14255 raft_consensus.cc:515] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.897188 14183 leader_election.cc:290] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 3 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:39.897675 14255 leader_election.cc:290] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:39.897979 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:39.898488 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:39.898525 14258 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.899200 14183 raft_consensus.cc:3055] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.899564 14183 raft_consensus.cc:740] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:39.898952 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0652e1447ce34e63908d5de2879a3e70" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:39.899993 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b6d036eac84e9785398d28b710f4e4" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:39.900226 14331 raft_consensus.cc:3060] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.900579 14332 raft_consensus.cc:3055] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:39.900383 14183 consensus_queue.cc:260] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.901027 14332 raft_consensus.cc:740] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:39.901696 14183 raft_consensus.cc:3060] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.901845 14332 consensus_queue.cc:260] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.903340 14332 raft_consensus.cc:3060] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.905587 14258 raft_consensus.cc:2468] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 3.
I20260709 12:13:39.906581 14146 leader_election.cc:304] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:39.907191 14331 raft_consensus.cc:2468] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:39.907335 14413 raft_consensus.cc:2804] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:39.907814 14413 raft_consensus.cc:697] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 3 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:39.908408 14223 leader_election.cc:304] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:39.908608 14413 consensus_queue.cc:237] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.908455 14183 raft_consensus.cc:2468] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:39.910983 14332 raft_consensus.cc:2468] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 3.
I20260709 12:13:39.909147 14380 raft_consensus.cc:2804] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.911712 14380 raft_consensus.cc:697] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:39.912535 14380 consensus_queue.cc:237] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:39.916386 14079 catalog_manager.cc:5697] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 2 to 3, leader changed from 83908830118f4d05bad7445c0787e347 (127.3.163.67) to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 3 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:39.919764 14080 catalog_manager.cc:5697] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 1 to 2, leader changed from 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65) to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 2 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:40.069339 14332 raft_consensus.cc:1275] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.070489 14413 consensus_queue.cc:1048] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.071352 14258 raft_consensus.cc:1275] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.072616 14413 consensus_queue.cc:1048] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.098238 14183 raft_consensus.cc:1275] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.099181 14380 consensus_queue.cc:1048] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.107839 14332 raft_consensus.cc:1275] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.109488 14463 consensus_queue.cc:1048] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.155736 14332 raft_consensus.cc:1275] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.156718 14463 consensus_queue.cc:1048] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.166550 14183 raft_consensus.cc:1275] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.167815 14332 raft_consensus.cc:1275] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.167980 14463 consensus_queue.cc:1048] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.169629 14464 consensus_queue.cc:1048] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.180385 14258 raft_consensus.cc:1275] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.182310 14413 consensus_queue.cc:1048] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.318974 14183 raft_consensus.cc:1275] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.320034 14332 raft_consensus.cc:1275] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.320149 14481 consensus_queue.cc:1048] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.321262 14463 consensus_queue.cc:1048] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.327185 14331 raft_consensus.cc:1275] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:40.328545 14486 consensus_queue.cc:1048] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.341473 14258 raft_consensus.cc:1275] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:40.342773 14486 consensus_queue.cc:1048] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.354801 14183 raft_consensus.cc:1275] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.355911 14469 consensus_queue.cc:1048] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:40.365629 14332 raft_consensus.cc:1275] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.366832 14469 consensus_queue.cc:1048] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:41.726878 14297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.009s	sys 0.007s
W20260709 12:13:41.727248 14297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.009s	sys 0.007s
W20260709 12:13:42.459681  3730 debug-util.cc:398] Leaking SignalData structure 0x7b080000f2a0 after lost signal to thread 14297
W20260709 12:13:42.617022 14112 debug-util.cc:398] Leaking SignalData structure 0x7b0800180b60 after lost signal to thread 3728
W20260709 12:13:42.617978 14112 debug-util.cc:398] Leaking SignalData structure 0x7b0800086340 after lost signal to thread 14115
W20260709 12:13:42.619059 14112 debug-util.cc:398] Leaking SignalData structure 0x7b0800311b00 after lost signal to thread 14207
W20260709 12:13:42.619997 14112 debug-util.cc:398] Leaking SignalData structure 0x7b08002a98e0 after lost signal to thread 14282
W20260709 12:13:42.620959 14112 debug-util.cc:398] Leaking SignalData structure 0x7b080024c000 after lost signal to thread 14356
I20260709 12:13:42.741308 14079 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45056:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:42.743379 14079 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 12:13:42.763193 14129 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:42.794761 14170 tablet_service.cc:1511] Processing CreateTablet for tablet 4df90fddfb504abf832ba15818e34a12 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:42.796070 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df90fddfb504abf832ba15818e34a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.797209 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 4df90fddfb504abf832ba15818e34a12 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:42.797742 14244 tablet_service.cc:1511] Processing CreateTablet for tablet 4df90fddfb504abf832ba15818e34a12 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:42.798465 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df90fddfb504abf832ba15818e34a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.798950 14244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df90fddfb504abf832ba15818e34a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.802079 14167 tablet_service.cc:1511] Processing CreateTablet for tablet 380bb6406e3341c1983816ebe5a1da9c (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:42.802685 14315 tablet_service.cc:1511] Processing CreateTablet for tablet 380bb6406e3341c1983816ebe5a1da9c (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:42.803278 14167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380bb6406e3341c1983816ebe5a1da9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.803879 14315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380bb6406e3341c1983816ebe5a1da9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.806594 14172 tablet_service.cc:1511] Processing CreateTablet for tablet ca3034c3e42b49968c32aa86a075e51f (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:42.807758 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca3034c3e42b49968c32aa86a075e51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.810521 14165 tablet_service.cc:1511] Processing CreateTablet for tablet 98d05a2698654ed685a743c3cdca1de1 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:42.813265 14318 tablet_service.cc:1511] Processing CreateTablet for tablet ca3034c3e42b49968c32aa86a075e51f (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:42.814465 14318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca3034c3e42b49968c32aa86a075e51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.817731 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 170a4abc54c44e00ab91e97be147807e (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:42.816517 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8dd7608078408589de6ce879563845 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:42.818696 14319 tablet_service.cc:1511] Processing CreateTablet for tablet 98d05a2698654ed685a743c3cdca1de1 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:42.819918 14319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d05a2698654ed685a743c3cdca1de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.821360 14166 tablet_service.cc:1511] Processing CreateTablet for tablet d23c6108d3b14b75a805faa78588f175 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:42.824143 14316 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8dd7608078408589de6ce879563845 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:42.825297 14320 tablet_service.cc:1511] Processing CreateTablet for tablet d23c6108d3b14b75a805faa78588f175 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:42.824221 14317 tablet_service.cc:1511] Processing CreateTablet for tablet 170a4abc54c44e00ab91e97be147807e (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:42.826800 14314 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7112e8f6e04e08b51523772802af7e (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:42.829195 14322 tablet_service.cc:1511] Processing CreateTablet for tablet 3644b1098aa44469a42f2dc81f380f25 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:42.825793 14316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8dd7608078408589de6ce879563845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.830284 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23c6108d3b14b75a805faa78588f175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.831415 14314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7112e8f6e04e08b51523772802af7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.833014 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3644b1098aa44469a42f2dc81f380f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.834059 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7112e8f6e04e08b51523772802af7e (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:42.837071 14317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170a4abc54c44e00ab91e97be147807e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.837005 14169 tablet_service.cc:1511] Processing CreateTablet for tablet 3644b1098aa44469a42f2dc81f380f25 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:42.838122 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7112e8f6e04e08b51523772802af7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.838699 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170a4abc54c44e00ab91e97be147807e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.840106 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8dd7608078408589de6ce879563845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.841130 14165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d05a2698654ed685a743c3cdca1de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.845152 14166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23c6108d3b14b75a805faa78588f175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.847556 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3644b1098aa44469a42f2dc81f380f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.858129 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 380bb6406e3341c1983816ebe5a1da9c (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:42.859418 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380bb6406e3341c1983816ebe5a1da9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.863473 14243 tablet_service.cc:1511] Processing CreateTablet for tablet ca3034c3e42b49968c32aa86a075e51f (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:42.864676 14243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca3034c3e42b49968c32aa86a075e51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.898049 14241 tablet_service.cc:1511] Processing CreateTablet for tablet 98d05a2698654ed685a743c3cdca1de1 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:42.898581 14240 tablet_service.cc:1511] Processing CreateTablet for tablet 9c8dd7608078408589de6ce879563845 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:42.899073 14245 tablet_service.cc:1511] Processing CreateTablet for tablet d23c6108d3b14b75a805faa78588f175 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:42.899905 14240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8dd7608078408589de6ce879563845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.899684 14242 tablet_service.cc:1511] Processing CreateTablet for tablet 170a4abc54c44e00ab91e97be147807e (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:42.900520 14245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23c6108d3b14b75a805faa78588f175. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.901450 14241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d05a2698654ed685a743c3cdca1de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.902837 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 3644b1098aa44469a42f2dc81f380f25 (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:42.902902 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7112e8f6e04e08b51523772802af7e (DEFAULT_TABLE table=soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:42.903677 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3644b1098aa44469a42f2dc81f380f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.904160 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7112e8f6e04e08b51523772802af7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.906698 14242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170a4abc54c44e00ab91e97be147807e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:42.983659 14513 tablet_bootstrap.cc:492] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:42.990494 14513 tablet_bootstrap.cc:654] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:42.993535 14514 tablet_bootstrap.cc:492] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:42.998528 14512 tablet_bootstrap.cc:492] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.005290 14512 tablet_bootstrap.cc:654] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.005364 14514 tablet_bootstrap.cc:654] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.010845 14514 tablet_bootstrap.cc:492] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.010812 14513 tablet_bootstrap.cc:492] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.011246 14512 tablet_bootstrap.cc:492] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.011493 14514 ts_tablet_manager.cc:1403] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.018s	user 0.000s	sys 0.011s
I20260709 12:13:43.011620 14513 ts_tablet_manager.cc:1403] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 12:13:43.011955 14512 ts_tablet_manager.cc:1403] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.014s	user 0.000s	sys 0.012s
I20260709 12:13:43.015017 14512 raft_consensus.cc:359] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.015556 14513 raft_consensus.cc:359] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.016530 14514 raft_consensus.cc:359] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.016973 14512 raft_consensus.cc:385] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.017211 14513 raft_consensus.cc:385] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.017370 14514 raft_consensus.cc:385] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.017405 14512 raft_consensus.cc:740] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.017727 14513 raft_consensus.cc:740] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.017998 14514 raft_consensus.cc:740] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.018563 14512 consensus_queue.cc:260] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.018654 14513 consensus_queue.cc:260] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.018872 14514 consensus_queue.cc:260] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.020928 14512 ts_tablet_manager.cc:1434] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:13:43.021333 14513 ts_tablet_manager.cc:1434] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:43.021874 14512 tablet_bootstrap.cc:492] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.022307 14513 tablet_bootstrap.cc:492] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:43.028793 14512 tablet_bootstrap.cc:654] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.035072 14514 ts_tablet_manager.cc:1434] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:13:43.042968 14514 tablet_bootstrap.cc:492] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:43.043735 14513 tablet_bootstrap.cc:654] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.050055 14514 tablet_bootstrap.cc:654] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.052692 14512 tablet_bootstrap.cc:492] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.053277 14512 ts_tablet_manager.cc:1403] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.013s
I20260709 12:13:43.055058 14513 tablet_bootstrap.cc:492] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.055617 14513 ts_tablet_manager.cc:1403] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.006s
I20260709 12:13:43.056473 14512 raft_consensus.cc:359] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.057330 14512 raft_consensus.cc:385] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.057658 14512 raft_consensus.cc:740] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.058466 14512 consensus_queue.cc:260] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.059800 14513 raft_consensus.cc:359] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.060562 14513 raft_consensus.cc:385] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.060710 14512 ts_tablet_manager.cc:1434] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:43.060930 14513 raft_consensus.cc:740] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.061722 14512 tablet_bootstrap.cc:492] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.068459 14513 consensus_queue.cc:260] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.070109 14514 tablet_bootstrap.cc:492] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.070668 14514 ts_tablet_manager.cc:1403] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 12:13:43.074038 14512 tablet_bootstrap.cc:654] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.075132 14514 raft_consensus.cc:359] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.075911 14514 raft_consensus.cc:385] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.076241 14514 raft_consensus.cc:740] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.077344 14514 consensus_queue.cc:260] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.079783 14514 ts_tablet_manager.cc:1434] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:13:43.080037 14513 ts_tablet_manager.cc:1434] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:13:43.080633 14499 raft_consensus.cc:493] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.081158 14499 raft_consensus.cc:515] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.083086 14514 tablet_bootstrap.cc:492] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:43.085357 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
W20260709 12:13:43.086755 14222 leader_election.cc:343] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.090301 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.094957 14513 tablet_bootstrap.cc:492] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:43.083187 14499 leader_election.cc:290] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.098785 14514 tablet_bootstrap.cc:654] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.101639 14513 tablet_bootstrap.cc:654] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:43.136221 14223 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.163.67:38565, user_credentials={real_user=slave}} blocked reactor thread for 44498.2us
W20260709 12:13:43.137638 14223 leader_election.cc:343] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.138269 14223 leader_election.cc:304] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.144321 14496 raft_consensus.cc:2749] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.109345 14512 tablet_bootstrap.cc:492] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.147136 14512 ts_tablet_manager.cc:1403] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.016s
I20260709 12:13:43.147748 14496 raft_consensus.cc:493] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.148777 14514 tablet_bootstrap.cc:492] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.149844 14514 ts_tablet_manager.cc:1403] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.000s
I20260709 12:13:43.148748 14496 raft_consensus.cc:515] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.153081 14513 tablet_bootstrap.cc:492] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.154275 14513 ts_tablet_manager.cc:1403] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.003s
I20260709 12:13:43.154294 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.156136 14514 raft_consensus.cc:359] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
W20260709 12:13:43.156684 14222 leader_election.cc:343] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.157218 14514 raft_consensus.cc:385] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.157655 14514 raft_consensus.cc:740] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.160265 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.161414 14332 raft_consensus.cc:2468] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 0.
I20260709 12:13:43.162741 14464 raft_consensus.cc:493] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.163079 14223 leader_election.cc:304] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:43.163498 14464 raft_consensus.cc:515] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.164209 14523 raft_consensus.cc:2804] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.164595 14523 raft_consensus.cc:493] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.164942 14523 raft_consensus.cc:3060] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.167713 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d05a2698654ed685a743c3cdca1de1" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.160233 14513 raft_consensus.cc:359] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.169140 14513 raft_consensus.cc:385] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:43.169332 14148 leader_election.cc:343] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.169910 14513 raft_consensus.cc:740] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.170104 14464 leader_election.cc:290] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.161351 14496 leader_election.cc:290] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.171150 14513 consensus_queue.cc:260] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.175091 14513 ts_tablet_manager.cc:1434] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:13:43.175712 14514 consensus_queue.cc:260] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.176787 14513 tablet_bootstrap.cc:492] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:43.184685 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d05a2698654ed685a743c3cdca1de1" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.185417 14258 raft_consensus.cc:2468] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:43.180729 14512 raft_consensus.cc:359] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.182801 14523 raft_consensus.cc:515] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.186353 14512 raft_consensus.cc:385] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.186805 14512 raft_consensus.cc:740] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.189570 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:43.190165 14332 raft_consensus.cc:3060] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.190560 14512 consensus_queue.cc:260] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.197783 14512 ts_tablet_manager.cc:1434] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.002s
I20260709 12:13:43.199407 14512 tablet_bootstrap.cc:492] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.187443 14146 leader_election.cc:304] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.188066 14523 leader_election.cc:290] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.181031 14514 ts_tablet_manager.cc:1434] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 12:13:43.189157 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:43.187505 14464 raft_consensus.cc:493] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.203058 14514 tablet_bootstrap.cc:492] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:43.202788 14464 raft_consensus.cc:515] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.205161 14526 raft_consensus.cc:2804] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.205633 14526 raft_consensus.cc:493] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.205811 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
W20260709 12:13:43.206470 14222 leader_election.cc:343] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.205302 14464 leader_election.cc:290] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
W20260709 12:13:43.207373 14146 leader_election.cc:343] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.207237 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
W20260709 12:13:43.210189 14148 leader_election.cc:343] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.210604 14148 leader_election.cc:304] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be; no voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.211419 14464 raft_consensus.cc:2749] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.211793 14526 raft_consensus.cc:3060] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.214128 14512 tablet_bootstrap.cc:654] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.215317 14332 raft_consensus.cc:2468] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 1.
I20260709 12:13:43.218165 14223 leader_election.cc:304] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:43.223093 14523 raft_consensus.cc:2804] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.223588 14523 raft_consensus.cc:697] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:43.224651 14523 consensus_queue.cc:237] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.227504 14512 tablet_bootstrap.cc:492] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.228184 14512 ts_tablet_manager.cc:1403] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 12:13:43.214190 14514 tablet_bootstrap.cc:654] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.239084 14512 raft_consensus.cc:359] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.239814 14512 raft_consensus.cc:385] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.240463 14512 raft_consensus.cc:740] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.241312 14512 consensus_queue.cc:260] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.241858 14513 tablet_bootstrap.cc:654] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.245814 14512 ts_tablet_manager.cc:1434] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:13:43.247255 14512 tablet_bootstrap.cc:492] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.248880 14514 tablet_bootstrap.cc:492] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.249619 14081 catalog_manager.cc:5697] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 1 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.251046 14526 raft_consensus.cc:515] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.258219 14512 tablet_bootstrap.cc:654] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.260414 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d05a2698654ed685a743c3cdca1de1" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:43.260969 14258 raft_consensus.cc:3060] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.261438 14526 leader_election.cc:290] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.261746 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d05a2698654ed685a743c3cdca1de1" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
W20260709 12:13:43.263327 14148 leader_election.cc:343] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.267841 14513 tablet_bootstrap.cc:492] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.268380 14513 ts_tablet_manager.cc:1403] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.092s	user 0.007s	sys 0.004s
I20260709 12:13:43.269922 14258 raft_consensus.cc:2468] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:43.271675 14513 raft_consensus.cc:359] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.249457 14514 ts_tablet_manager.cc:1403] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 12:13:43.280664 14514 raft_consensus.cc:359] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.281332 14514 raft_consensus.cc:385] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.281543 14514 raft_consensus.cc:740] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.282183 14514 consensus_queue.cc:260] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.284075 14514 ts_tablet_manager.cc:1434] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:13:43.284941 14513 raft_consensus.cc:385] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.285202 14514 tablet_bootstrap.cc:492] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:43.285297 14513 raft_consensus.cc:740] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.286177 14513 consensus_queue.cc:260] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.288542 14513 ts_tablet_manager.cc:1434] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:13:43.289764 14513 tablet_bootstrap.cc:492] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:43.276916 14512 tablet_bootstrap.cc:492] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.293155 14512 ts_tablet_manager.cc:1403] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.007s
I20260709 12:13:43.296003 14146 leader_election.cc:304] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.297025 14464 raft_consensus.cc:2804] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.298310 14512 raft_consensus.cc:359] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.299052 14512 raft_consensus.cc:385] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.299358 14512 raft_consensus.cc:740] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.300127 14512 consensus_queue.cc:260] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.305774 14513 tablet_bootstrap.cc:654] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.306610 14464 raft_consensus.cc:697] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:43.307747 14464 consensus_queue.cc:237] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.314015 14514 tablet_bootstrap.cc:654] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.320322 14512 ts_tablet_manager.cc:1434] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.006s
I20260709 12:13:43.321712 14512 tablet_bootstrap.cc:492] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.323870 14513 tablet_bootstrap.cc:492] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.327920 14513 ts_tablet_manager.cc:1403] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.002s
I20260709 12:13:43.331423 14513 raft_consensus.cc:359] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.337152 14513 raft_consensus.cc:385] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.337535 14513 raft_consensus.cc:740] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.338423 14513 consensus_queue.cc:260] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.338913 14081 catalog_manager.cc:5697] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.340837 14513 ts_tablet_manager.cc:1434] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:13:43.336311 14512 tablet_bootstrap.cc:654] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.343009 14513 tablet_bootstrap.cc:492] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:43.350131 14514 tablet_bootstrap.cc:492] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.350632 14514 ts_tablet_manager.cc:1403] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.066s	user 0.026s	sys 0.000s
I20260709 12:13:43.352046 14513 tablet_bootstrap.cc:654] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.353745 14514 raft_consensus.cc:359] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.354465 14514 raft_consensus.cc:385] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.354748 14514 raft_consensus.cc:740] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.355852 14514 consensus_queue.cc:260] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.357722 14512 tablet_bootstrap.cc:492] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.358274 14512 ts_tablet_manager.cc:1403] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.008s
I20260709 12:13:43.358827 14514 ts_tablet_manager.cc:1434] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:43.360100 14514 tablet_bootstrap.cc:492] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:43.361521 14512 raft_consensus.cc:359] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.362329 14512 raft_consensus.cc:385] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.362676 14512 raft_consensus.cc:740] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.363564 14512 consensus_queue.cc:260] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.365972 14512 ts_tablet_manager.cc:1434] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:43.367997 14514 tablet_bootstrap.cc:654] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.367918 14512 tablet_bootstrap.cc:492] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.373004 14511 raft_consensus.cc:493] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.373590 14511 raft_consensus.cc:515] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.376255 14513 tablet_bootstrap.cc:492] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.376756 14513 ts_tablet_manager.cc:1403] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.010s
I20260709 12:13:43.377521 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8dd7608078408589de6ce879563845" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.378108 14258 raft_consensus.cc:2468] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:43.376757 14511 leader_election.cc:290] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:43.379504 14295 leader_election.cc:304] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:43.378252 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8dd7608078408589de6ce879563845" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.381938 14183 raft_consensus.cc:2468] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:43.383589 14511 raft_consensus.cc:2804] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.384045 14511 raft_consensus.cc:493] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.384429 14511 raft_consensus.cc:3060] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.379848 14513 raft_consensus.cc:359] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.386101 14513 raft_consensus.cc:385] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.389084 14513 raft_consensus.cc:740] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.390154 14512 tablet_bootstrap.cc:654] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.390404 14513 consensus_queue.cc:260] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.395273 14514 tablet_bootstrap.cc:492] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.400389 14514 ts_tablet_manager.cc:1403] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.019s
I20260709 12:13:43.402633 14513 ts_tablet_manager.cc:1434] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:13:43.404625 14513 tablet_bootstrap.cc:492] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:43.406023 14514 raft_consensus.cc:359] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.399462 14511 raft_consensus.cc:515] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.410259 14512 tablet_bootstrap.cc:492] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.410730 14512 ts_tablet_manager.cc:1403] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.007s
I20260709 12:13:43.411516 14511 leader_election.cc:290] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:43.412211 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8dd7608078408589de6ce879563845" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:43.412426 14464 raft_consensus.cc:493] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.412741 14511 raft_consensus.cc:493] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.412858 14183 raft_consensus.cc:3060] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.413125 14464 raft_consensus.cc:515] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.413250 14511 raft_consensus.cc:515] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.413563 14512 raft_consensus.cc:359] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.414860 14512 raft_consensus.cc:385] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.415130 14512 raft_consensus.cc:740] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.411724 14514 raft_consensus.cc:385] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.415452 14464 leader_election.cc:290] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.415788 14514 raft_consensus.cc:740] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.415848 14512 consensus_queue.cc:260] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.415467 14511 leader_election.cc:290] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:43.416953 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.417610 14258 raft_consensus.cc:2468] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:43.418294 14512 ts_tablet_manager.cc:1434] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:43.416563 14514 consensus_queue.cc:260] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.419606 14512 tablet_bootstrap.cc:492] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.421568 14514 ts_tablet_manager.cc:1434] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:13:43.421777 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.422448 14332 raft_consensus.cc:2468] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:43.422761 14514 tablet_bootstrap.cc:492] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:43.423904 14146 leader_election.cc:304] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:43.424115 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.424790 14182 raft_consensus.cc:2468] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:43.425017 14464 raft_consensus.cc:2804] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.425526 14464 raft_consensus.cc:493] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.425863 14464 raft_consensus.cc:3060] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.427291 14512 tablet_bootstrap.cc:654] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.419691 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.430637 14514 tablet_bootstrap.cc:654] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:43.431492 14295 leader_election.cc:343] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.433099 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8dd7608078408589de6ce879563845" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:43.433643 14258 raft_consensus.cc:3060] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.433961 14513 tablet_bootstrap.cc:654] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.437727 14296 leader_election.cc:304] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:43.438880 14511 raft_consensus.cc:2804] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.439242 14511 raft_consensus.cc:493] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.439664 14511 raft_consensus.cc:3060] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.442879 14514 tablet_bootstrap.cc:492] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.443439 14514 ts_tablet_manager.cc:1403] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 12:13:43.446416 14514 raft_consensus.cc:359] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.447070 14514 raft_consensus.cc:385] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.447361 14514 raft_consensus.cc:740] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.448169 14514 consensus_queue.cc:260] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.449221 14533 raft_consensus.cc:493] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.449746 14533 raft_consensus.cc:515] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.453152 14533 leader_election.cc:290] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.450426 14514 ts_tablet_manager.cc:1434] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:13:43.453809 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.454535 14255 raft_consensus.cc:2468] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:43.455989 14146 leader_election.cc:304] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:43.457202 14533 raft_consensus.cc:2804] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.457552 14533 raft_consensus.cc:493] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.457887 14533 raft_consensus.cc:3060] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.458146 14514 tablet_bootstrap.cc:492] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:43.462980 14513 tablet_bootstrap.cc:492] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.463606 14513 ts_tablet_manager.cc:1403] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.020s
I20260709 12:13:43.454578 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.468106 14513 raft_consensus.cc:359] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.468909 14513 raft_consensus.cc:385] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.469254 14513 raft_consensus.cc:740] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.470186 14513 consensus_queue.cc:260] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.475962 14513 ts_tablet_manager.cc:1434] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:13:43.477339 14513 tablet_bootstrap.cc:492] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:43.469506 14514 tablet_bootstrap.cc:654] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.484274 14513 tablet_bootstrap.cc:654] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.486840 14523 raft_consensus.cc:493] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.487382 14523 raft_consensus.cc:515] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.489554 14523 leader_election.cc:290] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.407413 14541 raft_consensus.cc:493] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.494316 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.509289 14182 raft_consensus.cc:2468] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 0.
I20260709 12:13:43.501575 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.510655 14222 leader_election.cc:304] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:43.497408 14541 raft_consensus.cc:515] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
W20260709 12:13:43.512674 14223 leader_election.cc:343] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.512797 14332 raft_consensus.cc:2468] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:43.512046 14523 raft_consensus.cc:2804] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.514017 14523 raft_consensus.cc:493] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.514467 14523 raft_consensus.cc:3060] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.517532 14541 leader_election.cc:290] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:43.506533 14183 raft_consensus.cc:2468] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:43.519430 14296 leader_election.cc:304] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:43.519587 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.520287 14255 raft_consensus.cc:2468] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 0.
I20260709 12:13:43.506552 14511 raft_consensus.cc:515] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.492774 14258 raft_consensus.cc:2468] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:43.522274 14295 leader_election.cc:304] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:43.520569 14541 raft_consensus.cc:2804] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.523917 14548 raft_consensus.cc:2804] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.521184 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.524744 14548 raft_consensus.cc:493] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.525130 14548 raft_consensus.cc:3060] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.528035 14511 leader_election.cc:290] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:43.529032 14523 raft_consensus.cc:515] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.530061 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:43.506106 14464 raft_consensus.cc:515] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.531152 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:43.532841 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:43.533491 14255 raft_consensus.cc:3060] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.534504 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:43.535151 14181 raft_consensus.cc:3060] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.535414 14464 leader_election.cc:290] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.535986 14523 leader_election.cc:290] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.530738 14183 raft_consensus.cc:3060] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.545019 14523 raft_consensus.cc:493] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.545598 14523 raft_consensus.cc:515] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.507500 14542 raft_consensus.cc:493] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.548676 14542 raft_consensus.cc:515] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.550897 14542 leader_election.cc:290] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:43.553000 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d05a2698654ed685a743c3cdca1de1" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.548696 14180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170a4abc54c44e00ab91e97be147807e" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.553889 14256 raft_consensus.cc:2393] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83908830118f4d05bad7445c0787e347 in current term 1: Already voted for candidate 3b7ecc60066f4cbd9ba27353391146be in this term.
W20260709 12:13:43.554986 14222 leader_election.cc:343] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.553030 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d05a2698654ed685a743c3cdca1de1" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.555575 14548 raft_consensus.cc:515] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.557111 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:43.558063 14548 leader_election.cc:290] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:43.553150 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:43.559331 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
W20260709 12:13:43.558596 14223 leader_election.cc:343] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.561748 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:43.562333 14257 raft_consensus.cc:3060] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.563194 14255 raft_consensus.cc:2468] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:43.559183 14332 raft_consensus.cc:3060] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.508469 14533 raft_consensus.cc:515] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.569702 14146 leader_election.cc:304] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:43.571970 14464 raft_consensus.cc:2804] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.572461 14464 raft_consensus.cc:697] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:43.573345 14464 consensus_queue.cc:237] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.574869 14181 raft_consensus.cc:2468] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 1.
I20260709 12:13:43.577677 14222 leader_election.cc:304] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.580006 14496 raft_consensus.cc:2804] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.580487 14496 raft_consensus.cc:697] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:43.581297 14496 consensus_queue.cc:237] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.583191 14332 raft_consensus.cc:2468] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:43.586903 14523 leader_election.cc:290] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
W20260709 12:13:43.587052 14295 leader_election.cc:343] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.588194 14183 raft_consensus.cc:2468] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:43.589231 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170a4abc54c44e00ab91e97be147807e" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.589946 14331 raft_consensus.cc:2468] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 0.
I20260709 12:13:43.589226 14182 raft_consensus.cc:2393] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83908830118f4d05bad7445c0787e347 in current term 1: Already voted for candidate 3b7ecc60066f4cbd9ba27353391146be in this term.
I20260709 12:13:43.592195 14295 leader_election.cc:304] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:43.592329 14223 leader_election.cc:304] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:43.593341 14548 raft_consensus.cc:3060] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.593828 14533 leader_election.cc:290] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.594432 14523 raft_consensus.cc:2804] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.594882 14523 raft_consensus.cc:493] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.595827 14523 raft_consensus.cc:3060] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.597034 14541 raft_consensus.cc:697] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:43.601289 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:43.604312 14257 raft_consensus.cc:2468] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 1.
I20260709 12:13:43.595707 14296 leader_election.cc:304] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:43.606408 14541 consensus_queue.cc:237] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.601655 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:43.609967 14295 leader_election.cc:304] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:43.611624 14549 raft_consensus.cc:2804] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.612157 14549 raft_consensus.cc:697] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:43.613011 14549 consensus_queue.cc:237] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.617802 14331 raft_consensus.cc:2393] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b7ecc60066f4cbd9ba27353391146be in current term 1: Already voted for candidate 83908830118f4d05bad7445c0787e347 in this term.
I20260709 12:13:43.618413 14542 raft_consensus.cc:2804] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.618862 14542 raft_consensus.cc:697] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:43.619784 14542 consensus_queue.cc:237] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.623261 14512 tablet_bootstrap.cc:492] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.623721 14514 tablet_bootstrap.cc:492] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.623741 14512 ts_tablet_manager.cc:1403] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.204s	user 0.062s	sys 0.075s
I20260709 12:13:43.624220 14514 ts_tablet_manager.cc:1403] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.166s	user 0.039s	sys 0.027s
I20260709 12:13:43.620800 14523 raft_consensus.cc:515] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
W20260709 12:13:43.624981 14222 consensus_peers.cc:597] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f -> Peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Couldn't send request to peer 3b7ecc60066f4cbd9ba27353391146be. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:43.633380 14514 raft_consensus.cc:359] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.634047 14514 raft_consensus.cc:385] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.634287 14514 raft_consensus.cc:740] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.634502 14548 raft_consensus.cc:2749] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.634907 14514 consensus_queue.cc:260] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.635345 14079 catalog_manager.cc:5697] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.638212 14513 tablet_bootstrap.cc:492] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.639927 14513 ts_tablet_manager.cc:1403] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.163s	user 0.020s	sys 0.011s
I20260709 12:13:43.640774 14514 ts_tablet_manager.cc:1434] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:13:43.641846 14514 tablet_bootstrap.cc:492] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347: Bootstrap starting.
I20260709 12:13:43.645198 14513 raft_consensus.cc:359] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.637247 14148 leader_election.cc:304] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be; no voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.645895 14513 raft_consensus.cc:385] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.648358 14513 raft_consensus.cc:740] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.648691 14464 raft_consensus.cc:2749] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.649923 14513 consensus_queue.cc:260] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.651448 14512 raft_consensus.cc:359] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.652915 14512 raft_consensus.cc:385] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.653165 14512 raft_consensus.cc:740] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.653266 14523 leader_election.cc:290] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.653844 14512 consensus_queue.cc:260] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.654956 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170a4abc54c44e00ab91e97be147807e" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:43.655575 14331 raft_consensus.cc:3060] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.656441 14512 ts_tablet_manager.cc:1434] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:13:43.657909 14512 tablet_bootstrap.cc:492] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be: Bootstrap starting.
I20260709 12:13:43.662985 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170a4abc54c44e00ab91e97be147807e" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
W20260709 12:13:43.664146 14222 leader_election.cc:343] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:43.664152 14079 catalog_manager.cc:5697] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.667137 14512 tablet_bootstrap.cc:654] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.671728 14331 raft_consensus.cc:2468] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 1.
I20260709 12:13:43.672900 14223 leader_election.cc:304] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:43.673882 14514 tablet_bootstrap.cc:654] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.674039 14496 raft_consensus.cc:2804] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.676736 14496 raft_consensus.cc:697] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:43.677815 14496 consensus_queue.cc:237] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.679607 14512 tablet_bootstrap.cc:492] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be: No bootstrap required, opened a new log
I20260709 12:13:43.680023 14512 ts_tablet_manager.cc:1403] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:13:43.681526 14081 catalog_manager.cc:5697] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 1 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.682499 14512 raft_consensus.cc:359] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.683250 14512 raft_consensus.cc:385] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.683537 14512 raft_consensus.cc:740] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.684247 14512 consensus_queue.cc:260] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.688652 14512 ts_tablet_manager.cc:1434] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:43.690800 14514 tablet_bootstrap.cc:492] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347: No bootstrap required, opened a new log
I20260709 12:13:43.691217 14514 ts_tablet_manager.cc:1403] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.000s
I20260709 12:13:43.693984 14514 raft_consensus.cc:359] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.694409 14513 ts_tablet_manager.cc:1434] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:13:43.694644 14514 raft_consensus.cc:385] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.695523 14514 raft_consensus.cc:740] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.696642 14513 tablet_bootstrap.cc:492] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f: Bootstrap starting.
I20260709 12:13:43.696275 14514 consensus_queue.cc:260] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.699472 14514 ts_tablet_manager.cc:1434] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:43.706197 14513 tablet_bootstrap.cc:654] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:43.707581 14081 catalog_manager.cc:5697] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.710196 14081 catalog_manager.cc:5697] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 0 to 1, leader changed from <none> to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 1 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.720191 14523 consensus_queue.cc:1048] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:43.726125 14513 tablet_bootstrap.cc:492] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f: No bootstrap required, opened a new log
I20260709 12:13:43.726661 14513 ts_tablet_manager.cc:1403] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.006s
I20260709 12:13:43.729377 14513 raft_consensus.cc:359] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.729977 14513 raft_consensus.cc:385] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:43.730228 14513 raft_consensus.cc:740] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Initialized, Role: FOLLOWER
I20260709 12:13:43.730867 14513 consensus_queue.cc:260] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.732960 14513 ts_tablet_manager.cc:1434] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:13:43.745616 14080 catalog_manager.cc:5697] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 0 to 1, leader changed from <none> to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 1 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.748988 14499 raft_consensus.cc:493] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.749488 14499 raft_consensus.cc:515] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.751601 14499 leader_election.cc:290] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.753649 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.754354 14183 raft_consensus.cc:2393] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71ca7f4e83cb41219e57b0f71945cc7f in current term 1: Already voted for candidate 83908830118f4d05bad7445c0787e347 in this term.
I20260709 12:13:43.755825 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.757131 14223 leader_election.cc:304] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.757853 14499 raft_consensus.cc:3060] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.764444 14499 raft_consensus.cc:2749] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:43.768604 14129 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:43.815212 14542 raft_consensus.cc:493] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.815645 14542 raft_consensus.cc:515] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.817456 14542 leader_election.cc:290] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:43.818039 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b7ecc60066f4cbd9ba27353391146be" is_pre_election: true
I20260709 12:13:43.818797 14183 raft_consensus.cc:2393] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 83908830118f4d05bad7445c0787e347 in current term 1: Already voted for candidate 71ca7f4e83cb41219e57b0f71945cc7f in this term.
I20260709 12:13:43.818773 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.820322 14295 leader_election.cc:304] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 83908830118f4d05bad7445c0787e347; no voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:43.820930 14542 raft_consensus.cc:3060] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.827389 14542 raft_consensus.cc:2749] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.828929 14533 raft_consensus.cc:493] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.829492 14533 raft_consensus.cc:515] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.831779 14533 leader_election.cc:290] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.832417 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380bb6406e3341c1983816ebe5a1da9c" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.832825 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380bb6406e3341c1983816ebe5a1da9c" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.833097 14257 raft_consensus.cc:2468] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:43.833511 14331 raft_consensus.cc:2468] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 0.
I20260709 12:13:43.834465 14146 leader_election.cc:304] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:43.835232 14533 raft_consensus.cc:2804] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:43.835551 14533 raft_consensus.cc:493] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.835906 14533 raft_consensus.cc:3060] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.836155 14526 consensus_queue.cc:1048] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:43.842126 14533 raft_consensus.cc:515] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.848747 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380bb6406e3341c1983816ebe5a1da9c" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:43.849252 14331 raft_consensus.cc:3060] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.853027 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380bb6406e3341c1983816ebe5a1da9c" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:43.853631 14257 raft_consensus.cc:3060] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.857916 14464 raft_consensus.cc:493] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.858453 14464 raft_consensus.cc:515] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.848289 14533 leader_election.cc:290] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.859767 14331 raft_consensus.cc:2468] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:43.861035 14148 leader_election.cc:304] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:43.861804 14464 leader_election.cc:290] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.862156 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170a4abc54c44e00ab91e97be147807e" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.862377 14464 raft_consensus.cc:2804] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:43.862435 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170a4abc54c44e00ab91e97be147807e" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.862946 14257 raft_consensus.cc:2468] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 1.
I20260709 12:13:43.863494 14331 raft_consensus.cc:2393] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b7ecc60066f4cbd9ba27353391146be in current term 1: Already voted for candidate 71ca7f4e83cb41219e57b0f71945cc7f in this term.
I20260709 12:13:43.865115 14148 leader_election.cc:304] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be; no voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.865226 14464 raft_consensus.cc:697] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:43.866367 14464 consensus_queue.cc:237] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.868956 14533 raft_consensus.cc:3060] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:43.874563 14526 consensus_queue.cc:1048] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:43.879632 14533 raft_consensus.cc:2749] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.892377 14080 catalog_manager.cc:5697] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 1 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.902051 14464 raft_consensus.cc:493] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.902621 14464 raft_consensus.cc:515] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:43.905318 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" is_pre_election: true
I20260709 12:13:43.905652 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83908830118f4d05bad7445c0787e347" is_pre_election: true
I20260709 12:13:43.905293 14464 leader_election.cc:290] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:43.907187 14146 leader_election.cc:304] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be; no voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.907748 14464 raft_consensus.cc:2749] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:43.922210 14257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
mode: GRACEFUL
new_leader_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:34026
I20260709 12:13:43.922775 14257 raft_consensus.cc:606] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Received request to transfer leadership to TS 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:43.929527 14257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
mode: GRACEFUL
new_leader_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:34026
I20260709 12:13:43.929924 14257 raft_consensus.cc:606] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Received request to transfer leadership to TS 3b7ecc60066f4cbd9ba27353391146be
I20260709 12:13:43.936868 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c8dd7608078408589de6ce879563845"
dest_uuid: "83908830118f4d05bad7445c0787e347"
mode: GRACEFUL
new_leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:56744
I20260709 12:13:43.937288 14332 raft_consensus.cc:606] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Received request to transfer leadership to TS 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:43.943697 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175"
dest_uuid: "83908830118f4d05bad7445c0787e347"
mode: GRACEFUL
new_leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:56744
I20260709 12:13:43.944087 14332 raft_consensus.cc:606] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Received request to transfer leadership to TS 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:43.948246 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e"
dest_uuid: "83908830118f4d05bad7445c0787e347"
mode: GRACEFUL
new_leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:56744
I20260709 12:13:43.948632 14332 raft_consensus.cc:606] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Received request to transfer leadership to TS 71ca7f4e83cb41219e57b0f71945cc7f
I20260709 12:13:43.953047 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
mode: GRACEFUL
new_leader_uuid: "83908830118f4d05bad7445c0787e347"
 from {username='slave'} at 127.0.0.1:57898
I20260709 12:13:43.953482 14183 raft_consensus.cc:606] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Received request to transfer leadership to TS 83908830118f4d05bad7445c0787e347
I20260709 12:13:43.975191 14499 consensus_queue.cc:1048] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:43.989040 14568 consensus_queue.cc:1048] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:44.006201 14542 consensus_queue.cc:1048] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.009163 14181 raft_consensus.cc:3060] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:44.014797 14542 consensus_queue.cc:1048] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.019702 14499 raft_consensus.cc:993] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: : Instructing follower 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:44.020112 14499 raft_consensus.cc:1081] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Signalling peer 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:44.021801 14179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:51480
I20260709 12:13:44.022441 14179 raft_consensus.cc:493] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:44.022820 14179 raft_consensus.cc:3060] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.030834 14542 consensus_queue.cc:1048] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.033062 14179 raft_consensus.cc:515] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.043041 14542 raft_consensus.cc:993] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347: : Instructing follower 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:44.043521 14542 raft_consensus.cc:1081] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Signalling peer 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:44.043581 14179 leader_election.cc:290] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 2 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:44.048453 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:44.049000 14331 raft_consensus.cc:3060] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.051055 14255 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:55540
I20260709 12:13:44.051604 14255 raft_consensus.cc:493] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:44.051915 14255 raft_consensus.cc:3060] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.055027 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca3034c3e42b49968c32aa86a075e51f" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:44.058755 14256 raft_consensus.cc:3055] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:44.059114 14256 raft_consensus.cc:740] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:44.059404 14255 raft_consensus.cc:515] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.062103 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:44.062630 14182 raft_consensus.cc:3060] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.063306 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d23c6108d3b14b75a805faa78588f175" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:44.063889 14332 raft_consensus.cc:3055] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:44.064173 14332 raft_consensus.cc:740] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:44.064888 14332 consensus_queue.cc:260] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.065743 14332 raft_consensus.cc:3060] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.066310 14256 consensus_queue.cc:260] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.067570 14256 raft_consensus.cc:3060] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.065747 14511 consensus_queue.cc:1048] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:13:44.071451 14182 raft_consensus.cc:2468] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:44.073091 14222 leader_election.cc:304] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:44.074066 14569 raft_consensus.cc:2804] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:44.074494 14569 raft_consensus.cc:697] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:44.075063 14332 raft_consensus.cc:2468] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:44.075263 14569 consensus_queue.cc:237] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.076459 14255 leader_election.cc:290] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:44.081809 14179 raft_consensus.cc:1240] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Rejecting Update request from peer 83908830118f4d05bad7445c0787e347 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:44.084095 14331 raft_consensus.cc:2468] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 2.
I20260709 12:13:44.089588 14080 catalog_manager.cc:5697] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 1 to 2, leader changed from 83908830118f4d05bad7445c0787e347 (127.3.163.67) to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 2 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.090751 14148 leader_election.cc:304] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:44.091670 14464 raft_consensus.cc:2804] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:44.092123 14464 raft_consensus.cc:697] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:44.092935 14464 consensus_queue.cc:237] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.099212 14548 consensus_queue.cc:1048] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.103979 14568 raft_consensus.cc:993] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f: : Instructing follower 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:44.104436 14568 raft_consensus.cc:1081] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Signalling peer 3b7ecc60066f4cbd9ba27353391146be to start an election
I20260709 12:13:44.100680 14548 raft_consensus.cc:993] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347: : Instructing follower 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:44.105613 14548 raft_consensus.cc:1081] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Signalling peer 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:44.110493 14257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:55540
I20260709 12:13:44.111063 14257 raft_consensus.cc:493] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:44.113449 14257 raft_consensus.cc:3060] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.088337 14256 raft_consensus.cc:2468] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 2.
I20260709 12:13:44.116494 14569 consensus_queue.cc:1048] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.113947 14179 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
 from {username='slave'} at 127.0.0.1:51480
I20260709 12:13:44.123549 14179 raft_consensus.cc:493] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:44.124378 14179 raft_consensus.cc:3060] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.124446 14079 catalog_manager.cc:5697] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 1 to 2, leader changed from 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66) to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 2 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.136193 14569 consensus_queue.cc:1048] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.158442 14533 consensus_queue.cc:1048] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.160961 14533 consensus_queue.cc:1048] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.170512 14257 raft_consensus.cc:515] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.174234 14533 raft_consensus.cc:993] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: : Instructing follower 83908830118f4d05bad7445c0787e347 to start an election
I20260709 12:13:44.181488 14533 raft_consensus.cc:1081] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Signalling peer 83908830118f4d05bad7445c0787e347 to start an election
I20260709 12:13:44.184194 14332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25"
dest_uuid: "83908830118f4d05bad7445c0787e347"
 from {username='slave'} at 127.0.0.1:54630
I20260709 12:13:44.192593 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:44.193135 14183 raft_consensus.cc:3060] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.193291 14332 raft_consensus.cc:493] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:44.193670 14332 raft_consensus.cc:3060] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.200028 14183 raft_consensus.cc:2468] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:44.201789 14222 leader_election.cc:304] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:44.202654 14499 raft_consensus.cc:2804] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:44.203119 14499 raft_consensus.cc:697] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:44.203302 14332 raft_consensus.cc:515] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.203976 14499 consensus_queue.cc:237] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.206010 14332 leader_election.cc:290] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:44.206351 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:44.206954 14181 raft_consensus.cc:3055] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:44.207285 14181 raft_consensus.cc:740] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:44.208032 14181 consensus_queue.cc:260] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.210345 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3644b1098aa44469a42f2dc81f380f25" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:44.210911 14256 raft_consensus.cc:3060] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.173980 14179 raft_consensus.cc:515] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.215438 14179 leader_election.cc:290] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 2 election: Requested vote from peers 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:44.217129 14181 raft_consensus.cc:3060] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.217330 14542 raft_consensus.cc:993] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: : Instructing follower 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:44.217914 14542 raft_consensus.cc:1081] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Signalling peer 71ca7f4e83cb41219e57b0f71945cc7f to start an election
I20260709 12:13:44.218225 14257 leader_election.cc:290] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:44.219077 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:44.219604 14255 raft_consensus.cc:3055] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:44.219825 14255 raft_consensus.cc:740] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:44.220507 14255 consensus_queue.cc:260] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.222214 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7112e8f6e04e08b51523772802af7e" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:44.222744 14331 raft_consensus.cc:3055] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:44.223014 14331 raft_consensus.cc:740] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:44.223682 14331 consensus_queue.cc:260] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.221632 14255 raft_consensus.cc:3060] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.224840 14331 raft_consensus.cc:3060] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.223804 14080 catalog_manager.cc:5697] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 1 to 2, leader changed from 83908830118f4d05bad7445c0787e347 (127.3.163.67) to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 2 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.228032 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df90fddfb504abf832ba15818e34a12" candidate_uuid: "3b7ecc60066f4cbd9ba27353391146be" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:44.228574 14332 raft_consensus.cc:3060] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.231578 14331 raft_consensus.cc:2468] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:44.224601 14256 raft_consensus.cc:2468] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 2.
I20260709 12:13:44.221760 14257 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c8dd7608078408589de6ce879563845"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
 from {username='slave'} at 127.0.0.1:55540
I20260709 12:13:44.234071 14295 leader_election.cc:304] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:44.234241 14257 raft_consensus.cc:493] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:44.234714 14257 raft_consensus.cc:3060] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.235002 14511 raft_consensus.cc:2804] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:44.235513 14511 raft_consensus.cc:697] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 2 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:44.236276 14511 consensus_queue.cc:237] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.240489 14181 raft_consensus.cc:2468] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 2.
I20260709 12:13:44.251179 14332 raft_consensus.cc:2468] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 2.
I20260709 12:13:44.251718 14081 catalog_manager.cc:5697] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 1 to 2, leader changed from 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65) to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 2 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.252324 14148 leader_election.cc:304] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:44.253270 14526 raft_consensus.cc:2804] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:44.253703 14526 raft_consensus.cc:697] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Becoming Leader. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:44.254441 14526 consensus_queue.cc:237] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.257400 14257 raft_consensus.cc:515] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.263428 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8dd7608078408589de6ce879563845" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:44.264048 14181 raft_consensus.cc:3060] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.265640 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c8dd7608078408589de6ce879563845" candidate_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83908830118f4d05bad7445c0787e347"
I20260709 12:13:44.266238 14332 raft_consensus.cc:3055] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:44.266549 14332 raft_consensus.cc:740] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:44.267280 14332 consensus_queue.cc:260] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.271008 14181 raft_consensus.cc:2468] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:44.273507 14222 leader_election.cc:304] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 71ca7f4e83cb41219e57b0f71945cc7f; no voters: 
I20260709 12:13:44.267944 14257 leader_election.cc:290] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [CANDIDATE]: Term 2 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 83908830118f4d05bad7445c0787e347 (127.3.163.67:38565)
I20260709 12:13:44.274343 14255 raft_consensus.cc:2468] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b7ecc60066f4cbd9ba27353391146be in term 2.
I20260709 12:13:44.275938 14332 raft_consensus.cc:3060] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:44.277376 14499 raft_consensus.cc:2804] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:44.277801 14499 raft_consensus.cc:697] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Becoming Leader. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:44.278519 14499 consensus_queue.cc:237] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:44.281886 14332 raft_consensus.cc:2468] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71ca7f4e83cb41219e57b0f71945cc7f in term 2.
I20260709 12:13:44.285804 14079 catalog_manager.cc:5697] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f reported cstate change: term changed from 1 to 2, leader changed from 83908830118f4d05bad7445c0787e347 (127.3.163.67) to 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66). New cstate: current_term: 2 leader_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.286185 14081 catalog_manager.cc:5697] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be reported cstate change: term changed from 1 to 2, leader changed from 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66) to 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65). New cstate: current_term: 2 leader_uuid: "3b7ecc60066f4cbd9ba27353391146be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:44.351666 14526 consensus_queue.cc:1048] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.365309 14533 consensus_queue.cc:1048] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.541595 14332 raft_consensus.cc:1275] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.542904 14533 consensus_queue.cc:1048] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.549723 14255 raft_consensus.cc:1275] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.551928 14526 consensus_queue.cc:1048] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.593662 14181 raft_consensus.cc:1275] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.594718 14568 consensus_queue.cc:1048] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.604164 14332 raft_consensus.cc:1275] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.605518 14496 consensus_queue.cc:1048] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.617892 14332 raft_consensus.cc:1275] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.619163 14496 consensus_queue.cc:1048] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.624330 14181 raft_consensus.cc:1275] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.625694 14568 consensus_queue.cc:1048] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:44.675819 14331 raft_consensus.cc:1275] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.676996 14533 consensus_queue.cc:1048] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.684391 14255 raft_consensus.cc:1275] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Refusing update from remote peer 3b7ecc60066f4cbd9ba27353391146be: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.685941 14533 consensus_queue.cc:1048] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.727180 14255 raft_consensus.cc:1275] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Refusing update from remote peer 83908830118f4d05bad7445c0787e347: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.728210 14511 consensus_queue.cc:1048] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.735534 14181 raft_consensus.cc:1275] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 83908830118f4d05bad7445c0787e347: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.736912 14542 consensus_queue.cc:1048] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.772131 14181 raft_consensus.cc:1275] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.773748 14496 consensus_queue.cc:1048] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:44.786334 14332 raft_consensus.cc:1275] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Refusing update from remote peer 71ca7f4e83cb41219e57b0f71945cc7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:44.787742 14496 consensus_queue.cc:1048] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:46.957008 14081 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45056:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:13:46.975288 14081 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45056:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:13:47.032724  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:47.114576 14606 log.cc:927] Time spent T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:13:47.172024 14617 log.cc:927] Time spent T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:13:47.189837 14597 log.cc:927] Time spent T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 12:13:47.233462 14625 log.cc:927] Time spent T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:13:47.256831 14644 tablet.cc:1724] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.257165 14645 tablet.cc:1724] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.260990 14646 tablet.cc:1724] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:47.267658 14624 log.cc:927] Time spent T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
W20260709 12:13:47.277761 14626 log.cc:927] Time spent T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347: Append to log took a long time: real 0.095s	user 0.000s	sys 0.002s
I20260709 12:13:47.291862 14648 tablet.cc:1724] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:47.323163 14632 log.cc:927] Time spent T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: Append to log took a long time: real 0.141s	user 0.003s	sys 0.000s
I20260709 12:13:47.330792 14651 tablet.cc:1724] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.297986 14644 tablet.cc:1724] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.356652 14645 tablet.cc:1724] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.372052 14654 tablet.cc:1724] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.367373 14649 tablet.cc:1724] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.303499 14642 tablet.cc:1724] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.396366 14656 tablet.cc:1724] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.396481 14655 tablet.cc:1724] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.400444 14255 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a"
dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
mode: GRACEFUL
new_leader_uuid: "83908830118f4d05bad7445c0787e347"
 from {username='slave'} at 127.0.0.1:34032
I20260709 12:13:47.401160 14255 raft_consensus.cc:606] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Received request to transfer leadership to TS 83908830118f4d05bad7445c0787e347
I20260709 12:13:47.402216 14653 tablet.cc:1724] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.422685 14645 tablet.cc:1724] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.430732 14655 tablet.cc:1724] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.440866 14644 tablet.cc:1724] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.441604 14081 catalog_manager.cc:5789] TS 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337) does not have the latest schema for tablet 380bb6406e3341c1983816ebe5a1da9c (table soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]). Expected version 1 got 0
I20260709 12:13:47.442162 14651 tablet.cc:1724] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.433609 14646 tablet.cc:1724] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.447031 14654 tablet.cc:1724] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.450425 14081 catalog_manager.cc:5789] TS 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337) does not have the latest schema for tablet 4df90fddfb504abf832ba15818e34a12 (table soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]). Expected version 1 got 0
I20260709 12:13:47.453791 14659 tablet.cc:1724] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.454548 14079 catalog_manager.cc:5789] TS 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321) does not have the latest schema for tablet 6f7112e8f6e04e08b51523772802af7e (table soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]). Expected version 1 got 0
I20260709 12:13:47.455366 14079 catalog_manager.cc:5789] TS 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321) does not have the latest schema for tablet 9c8dd7608078408589de6ce879563845 (table soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8]). Expected version 1 got 0
I20260709 12:13:47.444432 14649 tablet.cc:1724] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.461138 14648 tablet.cc:1724] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.463410 14642 tablet.cc:1724] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.472901 14646 tablet.cc:1724] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.476380 14653 tablet.cc:1724] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.499912 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669"
dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
mode: GRACEFUL
new_leader_uuid: "83908830118f4d05bad7445c0787e347"
 from {username='slave'} at 127.0.0.1:57910
I20260709 12:13:47.500626 14181 raft_consensus.cc:606] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Received request to transfer leadership to TS 83908830118f4d05bad7445c0787e347
I20260709 12:13:47.495221 14642 tablet.cc:1724] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.502516  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:47.503115  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:47.503432 14653 tablet.cc:1724] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:47.515690 14078 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4: soft_deleted_table [id=ab7bf557333a492398fbf14642e715b8] alter complete (version 1)
I20260709 12:13:47.645255 14657 raft_consensus.cc:993] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be: : Instructing follower 83908830118f4d05bad7445c0787e347 to start an election
I20260709 12:13:47.645740 14628 raft_consensus.cc:1081] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Signalling peer 83908830118f4d05bad7445c0787e347 to start an election
I20260709 12:13:47.647095 14327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669"
dest_uuid: "83908830118f4d05bad7445c0787e347"
 from {username='slave'} at 127.0.0.1:54630
I20260709 12:13:47.647527 14327 raft_consensus.cc:493] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:47.647804 14327 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.653133 14327 raft_consensus.cc:515] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:47.654688 14327 leader_election.cc:290] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 3 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:47.655251 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:47.655638 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fe6f20f561487fb267d3a629481669" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:47.655781 14181 raft_consensus.cc:3055] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:47.656183 14257 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.656190 14181 raft_consensus.cc:740] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b7ecc60066f4cbd9ba27353391146be, State: Running, Role: LEADER
I20260709 12:13:47.657044 14181 consensus_queue.cc:260] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:47.657963 14181 raft_consensus.cc:3060] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.661007 14257 raft_consensus.cc:2468] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 3.
I20260709 12:13:47.662021 14295 leader_election.cc:304] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71ca7f4e83cb41219e57b0f71945cc7f, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:47.662674 14181 raft_consensus.cc:2468] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 3.
I20260709 12:13:47.662736 14586 raft_consensus.cc:2804] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.663286 14586 raft_consensus.cc:697] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 3 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:47.664016 14586 consensus_queue.cc:237] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } }
I20260709 12:13:47.671128 14079 catalog_manager.cc:5697] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 2 to 3, leader changed from 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65) to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 3 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:47.764175 14588 raft_consensus.cc:993] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f: : Instructing follower 83908830118f4d05bad7445c0787e347 to start an election
I20260709 12:13:47.764664 14633 raft_consensus.cc:1081] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Signalling peer 83908830118f4d05bad7445c0787e347 to start an election
I20260709 12:13:47.766074 14329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a"
dest_uuid: "83908830118f4d05bad7445c0787e347"
 from {username='slave'} at 127.0.0.1:54642
I20260709 12:13:47.766471 14329 raft_consensus.cc:493] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:47.766723 14329 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.771759 14329 raft_consensus.cc:515] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:47.773175 14329 leader_election.cc:290] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 3 election: Requested vote from peers 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337), 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321)
I20260709 12:13:47.773685 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3b7ecc60066f4cbd9ba27353391146be"
I20260709 12:13:47.774144 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b272e04e516c4710b058f8cf232bd70a" candidate_uuid: "83908830118f4d05bad7445c0787e347" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "71ca7f4e83cb41219e57b0f71945cc7f"
I20260709 12:13:47.774305 14181 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.774662 14257 raft_consensus.cc:3055] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:47.774910 14257 raft_consensus.cc:740] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71ca7f4e83cb41219e57b0f71945cc7f, State: Running, Role: LEADER
I20260709 12:13:47.775570 14257 consensus_queue.cc:260] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:47.776490 14257 raft_consensus.cc:3060] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.779292 14181 raft_consensus.cc:2468] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 3.
I20260709 12:13:47.780157 14296 leader_election.cc:304] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b7ecc60066f4cbd9ba27353391146be, 83908830118f4d05bad7445c0787e347; no voters: 
I20260709 12:13:47.780732 14586 raft_consensus.cc:2804] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:47.781240 14586 raft_consensus.cc:697] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 3 LEADER]: Becoming Leader. State: Replica: 83908830118f4d05bad7445c0787e347, State: Running, Role: LEADER
I20260709 12:13:47.781780 14257 raft_consensus.cc:2468] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83908830118f4d05bad7445c0787e347 in term 3.
I20260709 12:13:47.782069 14586 consensus_queue.cc:237] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } }
I20260709 12:13:47.789309 14079 catalog_manager.cc:5697] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 reported cstate change: term changed from 2 to 3, leader changed from 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66) to 83908830118f4d05bad7445c0787e347 (127.3.163.67). New cstate: current_term: 3 leader_uuid: "83908830118f4d05bad7445c0787e347" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83908830118f4d05bad7445c0787e347" member_type: VOTER last_known_addr { host: "127.3.163.67" port: 38565 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:48.110458 14179 raft_consensus.cc:1275] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Refusing update from remote peer 83908830118f4d05bad7445c0787e347: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:48.111485 14586 consensus_queue.cc:1048] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.121541 14255 raft_consensus.cc:1275] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Refusing update from remote peer 83908830118f4d05bad7445c0787e347: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:48.123009 14627 consensus_queue.cc:1048] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.330106 14179 raft_consensus.cc:1275] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Refusing update from remote peer 83908830118f4d05bad7445c0787e347: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:48.331265 14586 consensus_queue.cc:1048] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b7ecc60066f4cbd9ba27353391146be" member_type: VOTER last_known_addr { host: "127.3.163.65" port: 44337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.339704 14255 raft_consensus.cc:1275] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Refusing update from remote peer 83908830118f4d05bad7445c0787e347: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:48.341053 14627 consensus_queue.cc:1048] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71ca7f4e83cb41219e57b0f71945cc7f" member_type: VOTER last_known_addr { host: "127.3.163.66" port: 38321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:48.504025  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:48.509186  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:48.509496  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:49.510282  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:49.515208  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:49.515555  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:50.516448  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:50.521474  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:50.521852  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:51.522667  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:51.527894  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:51.528271  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:52.529177  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:52.534484  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:52.534869  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:53.535988  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:53.542847  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:53.543226  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:54.544215  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:54.549728  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:54.550184  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:55.551003  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:55.556245  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:55.556619  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:56.557502  3725 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:56.562422  3725 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:56.562805  3725 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:57.615283  3725 tablet_server.cc:179] TabletServer@127.3.163.65:0 shutting down...
W20260709 12:13:57.637357 14222 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 12:13:57.640838 14222 consensus_peers.cc:597] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f -> Peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Couldn't send request to peer 3b7ecc60066f4cbd9ba27353391146be. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.652549  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:57.653434  3725 tablet_replica.cc:333] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.654559  3725 raft_consensus.cc:2243] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.655632  3725 raft_consensus.cc:2272] T 380bb6406e3341c1983816ebe5a1da9c P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.658267  3725 tablet_replica.cc:333] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.659206  3725 raft_consensus.cc:2243] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.659911  3725 raft_consensus.cc:2272] T 6f7112e8f6e04e08b51523772802af7e P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.662712  3725 tablet_replica.cc:333] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.663259  3725 raft_consensus.cc:2243] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.663769  3725 raft_consensus.cc:2272] T 3644b1098aa44469a42f2dc81f380f25 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.665948  3725 tablet_replica.cc:333] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.666541  3725 raft_consensus.cc:2243] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.667346  3725 raft_consensus.cc:2272] T 98d05a2698654ed685a743c3cdca1de1 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.669476  3725 tablet_replica.cc:333] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.670017  3725 raft_consensus.cc:2243] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.670831  3725 raft_consensus.cc:2272] T 82b6d036eac84e9785398d28b710f4e4 P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.673111  3725 tablet_replica.cc:333] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.673645  3725 raft_consensus.cc:2243] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.674180  3725 raft_consensus.cc:2272] T d23c6108d3b14b75a805faa78588f175 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.676409  3725 tablet_replica.cc:333] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.676960  3725 raft_consensus.cc:2243] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.677450  3725 raft_consensus.cc:2272] T b272e04e516c4710b058f8cf232bd70a P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.679692  3725 tablet_replica.cc:333] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.680219  3725 raft_consensus.cc:2243] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.680754  3725 raft_consensus.cc:2272] T 170a4abc54c44e00ab91e97be147807e P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.682996  3725 tablet_replica.cc:333] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.683481  3725 raft_consensus.cc:2243] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.684307  3725 raft_consensus.cc:2272] T 4df90fddfb504abf832ba15818e34a12 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.686517  3725 tablet_replica.cc:333] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.687063  3725 raft_consensus.cc:2243] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.687502  3725 raft_consensus.cc:2272] T cf4151f44d6246b4b76f45d638162081 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.689816  3725 tablet_replica.cc:333] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.690294  3725 raft_consensus.cc:2243] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.691066  3725 raft_consensus.cc:2272] T ca3034c3e42b49968c32aa86a075e51f P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.693296  3725 tablet_replica.cc:333] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.693818  3725 raft_consensus.cc:2243] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.694239  3725 raft_consensus.cc:2272] T 9c8dd7608078408589de6ce879563845 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.696321  3725 tablet_replica.cc:333] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.696869  3725 raft_consensus.cc:2243] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.697266  3725 raft_consensus.cc:2272] T 0652e1447ce34e63908d5de2879a3e70 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.699329  3725 tablet_replica.cc:333] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.699790  3725 raft_consensus.cc:2243] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.700199  3725 raft_consensus.cc:2272] T 63019e141ca9403cb7799475cca37657 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.702978  3725 tablet_replica.cc:333] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.703570  3725 raft_consensus.cc:2243] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.704602  3725 raft_consensus.cc:2272] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:57.705050 14296 consensus_peers.cc:597] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 -> Peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Couldn't send request to peer 3b7ecc60066f4cbd9ba27353391146be. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.707098  3725 tablet_replica.cc:333] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.707623  3725 raft_consensus.cc:2243] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.708038  3725 raft_consensus.cc:2272] T 7d07f3cdd4924349852444f47b2ff44d P 3b7ecc60066f4cbd9ba27353391146be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.710127  3725 tablet_replica.cc:333] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.710562  3725 raft_consensus.cc:2243] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.710963  3725 raft_consensus.cc:2272] T f1fe6f20f561487fb267d3a629481669 P 3b7ecc60066f4cbd9ba27353391146be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.713222  3725 tablet_replica.cc:333] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be: stopping tablet replica
I20260709 12:13:57.713758  3725 raft_consensus.cc:2243] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.714571  3725 raft_consensus.cc:2272] T 865bd1a347b0463fbb3d141ae6987d56 P 3b7ecc60066f4cbd9ba27353391146be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.757654  3725 tablet_server.cc:196] TabletServer@127.3.163.65:0 shutdown complete.
W20260709 12:13:57.760519 14222 consensus_peers.cc:597] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f -> Peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Couldn't send request to peer 3b7ecc60066f4cbd9ba27353391146be. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:44337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.798274  3725 tablet_server.cc:179] TabletServer@127.3.163.66:0 shutting down...
W20260709 12:13:57.806421 14295 consensus_peers.cc:597] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 -> Peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Couldn't send request to peer 71ca7f4e83cb41219e57b0f71945cc7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:57.827764 14295 consensus_peers.cc:597] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 -> Peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Couldn't send request to peer 71ca7f4e83cb41219e57b0f71945cc7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.829149  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:57.829883  3725 tablet_replica.cc:333] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.830667  3725 raft_consensus.cc:2243] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.831467  3725 raft_consensus.cc:2272] T 6f7112e8f6e04e08b51523772802af7e P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.833822  3725 tablet_replica.cc:333] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.834596  3725 raft_consensus.cc:2243] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.835258  3725 raft_consensus.cc:2272] T 380bb6406e3341c1983816ebe5a1da9c P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.837709  3725 tablet_replica.cc:333] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.838284  3725 raft_consensus.cc:2243] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.838770  3725 raft_consensus.cc:2272] T ca3034c3e42b49968c32aa86a075e51f P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.840958  3725 tablet_replica.cc:333] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.841461  3725 raft_consensus.cc:2243] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.841913  3725 raft_consensus.cc:2272] T 98d05a2698654ed685a743c3cdca1de1 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.843863  3725 tablet_replica.cc:333] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.844332  3725 raft_consensus.cc:2243] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.845146  3725 raft_consensus.cc:2272] T 170a4abc54c44e00ab91e97be147807e P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.847111  3725 tablet_replica.cc:333] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.847592  3725 raft_consensus.cc:2243] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.847975  3725 raft_consensus.cc:2272] T cf4151f44d6246b4b76f45d638162081 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.850054  3725 tablet_replica.cc:333] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.850553  3725 raft_consensus.cc:2243] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.850999  3725 raft_consensus.cc:2272] T 4df90fddfb504abf832ba15818e34a12 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.853808  3725 tablet_replica.cc:333] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.854458  3725 raft_consensus.cc:2243] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.855221  3725 raft_consensus.cc:2272] T 7d07f3cdd4924349852444f47b2ff44d P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.857277  3725 tablet_replica.cc:333] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.857751  3725 raft_consensus.cc:2243] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.858433  3725 raft_consensus.cc:2272] T 9c8dd7608078408589de6ce879563845 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.860277  3725 tablet_replica.cc:333] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.860776  3725 raft_consensus.cc:2243] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.861506  3725 raft_consensus.cc:2272] T 0652e1447ce34e63908d5de2879a3e70 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.863343  3725 tablet_replica.cc:333] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.863785  3725 raft_consensus.cc:2243] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.864197  3725 raft_consensus.cc:2272] T 3644b1098aa44469a42f2dc81f380f25 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.866108  3725 tablet_replica.cc:333] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.866580  3725 raft_consensus.cc:2243] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.867007  3725 raft_consensus.cc:2272] T 82b6d036eac84e9785398d28b710f4e4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.869642  3725 tablet_replica.cc:333] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.870204  3725 raft_consensus.cc:2243] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.870714  3725 raft_consensus.cc:2272] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:57.872474 14296 consensus_peers.cc:597] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 -> Peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Couldn't send request to peer 3b7ecc60066f4cbd9ba27353391146be. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:44337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.873145  3725 tablet_replica.cc:333] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.873739  3725 raft_consensus.cc:2243] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.874151  3725 raft_consensus.cc:2272] T f1fe6f20f561487fb267d3a629481669 P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.876351  3725 tablet_replica.cc:333] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.876888  3725 raft_consensus.cc:2243] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.877278  3725 raft_consensus.cc:2272] T 865bd1a347b0463fbb3d141ae6987d56 P 71ca7f4e83cb41219e57b0f71945cc7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.879424  3725 tablet_replica.cc:333] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.879904  3725 raft_consensus.cc:2243] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.880632  3725 raft_consensus.cc:2272] T d23c6108d3b14b75a805faa78588f175 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.882584  3725 tablet_replica.cc:333] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.883042  3725 raft_consensus.cc:2243] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.883453  3725 raft_consensus.cc:2272] T b272e04e516c4710b058f8cf232bd70a P 71ca7f4e83cb41219e57b0f71945cc7f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.885692  3725 tablet_replica.cc:333] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f: stopping tablet replica
I20260709 12:13:57.886157  3725 raft_consensus.cc:2243] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:57.886933  3725 raft_consensus.cc:2272] T 63019e141ca9403cb7799475cca37657 P 71ca7f4e83cb41219e57b0f71945cc7f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:57.920409 14296 consensus_peers.cc:597] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 -> Peer 3b7ecc60066f4cbd9ba27353391146be (127.3.163.65:44337): Couldn't send request to peer 3b7ecc60066f4cbd9ba27353391146be. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.65:44337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:57.925238 14295 consensus_peers.cc:597] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 -> Peer 71ca7f4e83cb41219e57b0f71945cc7f (127.3.163.66:38321): Couldn't send request to peer 71ca7f4e83cb41219e57b0f71945cc7f. Status: Network error: Client connection negotiation failed: client connection to 127.3.163.66:38321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.929160  3725 tablet_server.cc:196] TabletServer@127.3.163.66:0 shutdown complete.
I20260709 12:13:57.964939  3725 tablet_server.cc:179] TabletServer@127.3.163.67:0 shutting down...
I20260709 12:13:57.989481  3725 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:57.990114  3725 tablet_replica.cc:333] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:57.990758  3725 raft_consensus.cc:2243] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.991255  3725 raft_consensus.cc:2272] T ca3034c3e42b49968c32aa86a075e51f P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.993571  3725 tablet_replica.cc:333] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:57.994125  3725 raft_consensus.cc:2243] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.994519  3725 raft_consensus.cc:2272] T 380bb6406e3341c1983816ebe5a1da9c P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.996486  3725 tablet_replica.cc:333] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:57.997026  3725 raft_consensus.cc:2243] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:57.997545  3725 raft_consensus.cc:2272] T 98d05a2698654ed685a743c3cdca1de1 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:57.999598  3725 tablet_replica.cc:333] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.000105  3725 raft_consensus.cc:2243] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.001003  3725 raft_consensus.cc:2272] T 3644b1098aa44469a42f2dc81f380f25 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.003074  3725 tablet_replica.cc:333] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.003713  3725 raft_consensus.cc:2243] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.004133  3725 raft_consensus.cc:2272] T 6f7112e8f6e04e08b51523772802af7e P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.006438  3725 tablet_replica.cc:333] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.006996  3725 raft_consensus.cc:2243] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.007442  3725 raft_consensus.cc:2272] T 170a4abc54c44e00ab91e97be147807e P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.009569  3725 tablet_replica.cc:333] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.010107  3725 raft_consensus.cc:2243] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.010911  3725 raft_consensus.cc:2272] T cf4151f44d6246b4b76f45d638162081 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.013034  3725 tablet_replica.cc:333] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.013553  3725 raft_consensus.cc:2243] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.014025  3725 raft_consensus.cc:2272] T 4df90fddfb504abf832ba15818e34a12 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.015951  3725 tablet_replica.cc:333] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.016472  3725 raft_consensus.cc:2243] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.016957  3725 raft_consensus.cc:2272] T 9c8dd7608078408589de6ce879563845 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.018862  3725 tablet_replica.cc:333] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.019356  3725 raft_consensus.cc:2243] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.019754  3725 raft_consensus.cc:2272] T 0652e1447ce34e63908d5de2879a3e70 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.021759  3725 tablet_replica.cc:333] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.022224  3725 raft_consensus.cc:2243] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.022620  3725 raft_consensus.cc:2272] T 7d07f3cdd4924349852444f47b2ff44d P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.024436  3725 tablet_replica.cc:333] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.024914  3725 raft_consensus.cc:2243] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.025303  3725 raft_consensus.cc:2272] T 82b6d036eac84e9785398d28b710f4e4 P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.027099  3725 tablet_replica.cc:333] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.027515  3725 raft_consensus.cc:2243] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.028296  3725 raft_consensus.cc:2272] T b272e04e516c4710b058f8cf232bd70a P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.030251  3725 tablet_replica.cc:333] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.030733  3725 raft_consensus.cc:2243] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.031201  3725 raft_consensus.cc:2272] T d23c6108d3b14b75a805faa78588f175 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.033099  3725 tablet_replica.cc:333] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.033548  3725 raft_consensus.cc:2243] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.033989  3725 raft_consensus.cc:2272] T 87871ccaf1dc47ae8f26dd9cd0ac25b4 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.035979  3725 tablet_replica.cc:333] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.036408  3725 raft_consensus.cc:2243] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.036855  3725 raft_consensus.cc:2272] T 63019e141ca9403cb7799475cca37657 P 83908830118f4d05bad7445c0787e347 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.038724  3725 tablet_replica.cc:333] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.039136  3725 raft_consensus.cc:2243] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:58.039523  3725 raft_consensus.cc:2272] T 865bd1a347b0463fbb3d141ae6987d56 P 83908830118f4d05bad7445c0787e347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.041357  3725 tablet_replica.cc:333] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347: stopping tablet replica
I20260709 12:13:58.041762  3725 raft_consensus.cc:2243] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.042472  3725 raft_consensus.cc:2272] T f1fe6f20f561487fb267d3a629481669 P 83908830118f4d05bad7445c0787e347 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.079994  3725 tablet_server.cc:196] TabletServer@127.3.163.67:0 shutdown complete.
I20260709 12:13:58.112986  3725 master.cc:562] Master@127.3.163.126:42641 shutting down...
I20260709 12:13:58.132745  3725 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:58.133299  3725 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:58.133579  3725 tablet_replica.cc:333] T 00000000000000000000000000000000 P 41d04d6d918a48f6a2f58ebfbea7bed4: stopping tablet replica
I20260709 12:13:58.171928  3725 master.cc:584] Master@127.3.163.126:42641 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (22041 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44719 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (343075 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:13:58.225528  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2206 messages since previous log ~35 seconds ago
I20260709 12:13:58.225739  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2206 messages since previous log ~35 seconds ago
I20260709 12:13:58.225904  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2204 messages since previous log ~35 seconds ago
I20260709 12:13:58.226100  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~56 seconds ago
I20260709 12:13:58.226287  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~56 seconds ago
I20260709 12:13:58.226477  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~130 seconds ago
I20260709 12:13:58.226655  3725 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~241 seconds ago
I20260709 12:13:58.226822  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~241 seconds ago
I20260709 12:13:58.227061  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 12:13:58.227334  3725 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
